X-Git-Url: https://git.phdru.name/?a=blobdiff_plain;f=doc%2FTODO;h=e4fe65203b33b6bb9f1f6a9652b3e97312e13f82;hb=3e7f48c2fc9e132806609f7811c62bf2a43ddf7c;hp=f8889bf500e65491544389d0a3f4c30d618ce5ef;hpb=ef83c2af99b6bd3258ad573a87e235c099464f95;p=bookmarks_db.git diff --git a/doc/TODO b/doc/TODO index f8889bf..e4fe652 100644 --- a/doc/TODO +++ b/doc/TODO @@ -1,16 +1,32 @@ -Get and store icon. +HTML parser based on BeautifulSoup4. Bs3 for Python 2, bs4 for Py3. + +Replace subproc.py with some IPC. Or update for Python 3. + +Python 3. + +Forbid external names to resolve to internal addresses (127.0.0.1, etc). + +Configuration file to configure defaults - global defaults for the system +and local defaults for subsystems. + +Robot based on PycURL. + +Robot based on Scrapy. + +A program to publish bookmarks with icons. + +Fetch description from and store it in +bookmark.description if the description is empty. (How to update old +descriptions without replacing my own comments?) -Cleanup HTML before parsing using BeautifulSoap or Tidy. Parse (or interpret) downloaded file and get javascript redirects. More and better documentation. Merge "writers" to storage managers. New storage managers: shelve, SQL, ZODB, MetaKit. -More robots (URL checkers): threading, asyncore-based. - -Configuration file to configure defaults - global defaults for the system -and local defaults for subsystems. +More robots (URL checkers): threading, asyncore-based; +robots that test many URLs in parallel. Ruleset-based mechanisms to filter out what types of URLs to check: checking based on URL schema, host, port, path, filename, extension, etc. @@ -23,3 +39,5 @@ Bigger database. Multiuser database. Robot should operates on a part of the DB. WWW-interface to the database. User should import/export/edit bookmarks, schedule robot run, etc. + +A program to collect and check links from a site.