-Robot based on urllib2: handle ftp (welcome message).
+Configuration file to configure defaults - global defaults for the system
+and local defaults for subsystems.
A new robot based on PycURL.
New storage managers: shelve, SQL, ZODB, MetaKit.
More robots (URL checkers): threading, asyncore-based;
robots that test many URLs in parallel.
-Configuration file to configure defaults - global defaults for the system
-and local defaults for subsystems.
Ruleset-based mechanisms to filter out what types of URLs to check: checking
based on URL schema, host, port, path, filename, extension, etc.
the DB.
WWW-interface to the database. User should import/export/edit bookmarks,
schedule robot run, etc.
+
+A program to collect and check links from a site.