Bookmarks Database and Internet Robot
WHAT IS IT
- There is a set of classes, libraries, programs and plugins I use to
-manipulate my bookmarks.html. I like Netscape Navigator, but I need more
-features, so I write and maintain these programs for my needs. I need to
-extend Navigator's "What's new" feature (Navigator 4 calls it "Update
-bookmarks").
+ A set of classes, libraries, programs and plugins I use to manipulate my
+bookmarks.html.
+WHAT'S NEW
+Version 5.2.5 (2024-03-05)
-WHAT'S NEW in version 3.3.2
- parse_html.py can now recode unicode entities in titles.
+ Feat(Robots/bkmk_rrequests): Ignore all problems with certificates.
+ Fix(Robots/bkmk_robot_base): Pass query part.
-WHAT'S NEW in version 3.3.0
- Required Python 2.2.
- HTML parser. If the protocol is HTTP, and there is Content-Type header, and
-content type is text/html, the object is parsed to extract its title; if the
-Content-Type header has charset, or if the HTML has <META> with charset, the
-title is converted from the given charset to the default charset. The object is
-also parsed to extract <META> tag with redirect.
+Version 5.2.4 (2024-03-04)
+ Fix(Robots/bkmk_rrequests): No need to re-check error 404 via proxy.
-WHAT'S NEW in version 3.0
- Complete rewrite from scratch. Created mechanism for pluggable storage
-managers, writers (DB dumpers/exporters) and robots.
+Version 5.2.3 (2024-03-03)
+ Feat(Robots/bkmk_rrequests): Report 40x and 50x errors.
-WHERE TO GET
- Master site: http://phd.pp.ru/Software/Python/#bookmarks_db
+ Fix HTML pasrer based on Bs4: Find "shortcut icon".
- Faster mirrors: http://phd.by.ru/Software/Python/#bookmarks_db
- http://phd2.chat.ru/Software/Python/#bookmarks_db
+Version 5.2.2 (2024-03-03)
+ Robots/bkmk_rrequests: Add request headers.
-AUTHOR
- Oleg Broytmann <phd@phd.pp.ru>
+ Robots/bkmk_robot_base: Process "data:image/" icons.
-COPYRIGHT
- Copyright (C) 1997-2002 PhiloSoft Design
+Version 5.2.1 (2024-03-02)
-LICENSE
- GPL
+ Speedup second access through proxy.
+
+Version 5.2.0 (2024-03-02)
+
+ For the robot based on requests allow to use a proxy.
+
+Version 5.1.0 (2024-03-01)
+
+ Robot based on requests.
-STATUS
- Storage managers: pickle, FLAD (Flat ASCII Database).
- Writers: HTML, text, FLAD (full database or only errors).
- Robots (URL checker): simple, simple+timeoutscoket, forking.
+Version 5.0.0 (2023-11-22)
-TODO
- Parse downloaded file and get some additional information out of headers
- and parsed data - title, for example. Or redirects using <META HTTP-Equiv>.
- (Partially done - now extracting title).
+ Python 3.
- Documentation.
+ Report redirects and set URLs.
- Merge "writers" to storage managers.
- New storage managers: shelve, SQL, ZODB, MetaKit.
- Robots (URL checkers): threading, asyncore-based.
- Aliases in bookmarks.html.
+ Delete URLs.
- Configuration file for configuring defaults - global defaults for the system
- and local defaults for subsystems.
+ Remove BeautifulSoup.py (use globally installed).
- Ruleset-based mechanisms to filter out what types of URLs to check: checking
- based on URL schema, host, port, path, filename, extension, etc.
- Detailed reports on robot run - what's old, what's new, what was moved,
- errors, etc.
- WWW-interface to the report.
+WHERE TO GET
+ Home page: https://phdru.name/Software/Python/#bookmarks_db
+ git clone https://git.phdru.name/bookmarks_db.git
+ git clone git://git.phdru.name/bookmarks_db.git
+
+ Requires: Python 2.7 or 3.4+, BeautifulSoup 4, lxml, m_lib 2.0+,
+ requests and requests-ftp.
+
+
+AUTHOR
+ Oleg Broytman <phd@phdru.name>
- Bigger database. Multiuser database. Robot should operate on a part of
- the DB.
- WWW-interface to the database. User will import/export/edit bookmarks,
- schedule robot run, etc.
+COPYRIGHT
+ Copyright (C) 1997-2024 PhiloSoft Design
+
+LICENSE
+ GPL
projects / bookmarks_db.git / blobdiff