X-Git-Url: https://git.phdru.name/?a=blobdiff_plain;f=doc%2FTODO;h=8fef568f6f1bd4d630e61e5074bde12ae2679690;hb=8a1de1f6955285e17c7cdf55caf34ff937cc55e7;hp=dac674c9b7a89b589ab54bd2a0ffa7327dd6de14;hpb=9eeb1d64b852f009b6252be78f4d1f4d0123e0e1;p=bookmarks_db.git diff --git a/doc/TODO b/doc/TODO index dac674c..8fef568 100644 --- a/doc/TODO +++ b/doc/TODO @@ -1,19 +1,26 @@ +Configuration file to configure defaults - global defaults for the system +and local defaults for subsystems. + +Robot based on requests. + +Robot based on PycURL. + +Robot based on Scrapy. + +A program to publish bookmarks with icons. + Fetch description from and store it in bookmark.description if the description is empty. (How to update old descriptions without replacing my own comments?) -A program to publish bookmarks with icons. - -Cleanup HTML before parsing using BeautifulSoap or Tidy. Parse (or interpret) downloaded file and get javascript redirects. More and better documentation. Merge "writers" to storage managers. New storage managers: shelve, SQL, ZODB, MetaKit. -More robots (URL checkers): threading, asyncore-based. -Configuration file to configure defaults - global defaults for the system -and local defaults for subsystems. +More robots (URL checkers): threading, asyncore-based; +robots that test many URLs in parallel. Ruleset-based mechanisms to filter out what types of URLs to check: checking based on URL schema, host, port, path, filename, extension, etc. @@ -26,3 +33,5 @@ Bigger database. Multiuser database. Robot should operates on a part of the DB. WWW-interface to the database. User should import/export/edit bookmarks, schedule robot run, etc. + +A program to collect and check links from a site.