X-Git-Url: https://git.phdru.name/?a=blobdiff_plain;f=doc%2FTODO;h=47b3e59642a46a17831c89a05821af1540ee1f1f;hb=22ff22eb1b087f197008ceaf926d952b226f07bf;hp=f98d0769a9116d382c103c62e6340ea8ce50012a;hpb=27c6253f3e707d0b90e67ee52f78e1335482e17e;p=bookmarks_db.git diff --git a/doc/TODO b/doc/TODO index f98d076..47b3e59 100644 --- a/doc/TODO +++ b/doc/TODO @@ -1,8 +1,13 @@ -Robot based on urllib2: handle timeout and ftp. +Python 3. -A new robot based on PycURL. +Configuration file to configure defaults - global defaults for the system +and local defaults for subsystems. + +Robot based on requests. + +Robot based on PycURL. -HTML parser based on BeautifulSoup4. +Robot based on Scrapy. A program to publish bookmarks with icons. @@ -18,8 +23,6 @@ Merge "writers" to storage managers. New storage managers: shelve, SQL, ZODB, MetaKit. More robots (URL checkers): threading, asyncore-based; robots that test many URLs in parallel. -Configuration file to configure defaults - global defaults for the system -and local defaults for subsystems. Ruleset-based mechanisms to filter out what types of URLs to check: checking based on URL schema, host, port, path, filename, extension, etc. @@ -32,3 +35,5 @@ Bigger database. Multiuser database. Robot should operates on a part of the DB. WWW-interface to the database. User should import/export/edit bookmarks, schedule robot run, etc. + +A program to collect and check links from a site.