]> git.phdru.name Git - bookmarks_db.git/log
bookmarks_db.git
16 years agoTitle (and refresh) can be None.
Oleg Broytman [Sun, 9 Mar 2008 15:55:20 +0000 (15:55 +0000)]
Title (and refresh) can be None.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@211 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoMinor optimization.
Oleg Broytman [Sun, 9 Mar 2008 15:40:42 +0000 (15:40 +0000)]
Minor optimization.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@210 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoFixed a misspelled HTML entity.
Oleg Broytman [Fri, 7 Mar 2008 22:39:37 +0000 (22:39 +0000)]
Fixed a misspelled HTML entity.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@209 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoSplit the title into subparts, reassemble the subparts and recode.
Oleg Broytman [Fri, 7 Mar 2008 20:56:06 +0000 (20:56 +0000)]
Split the title into subparts, reassemble the subparts and recode.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@208 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoNew database format: pyyaml.
Oleg Broytman [Fri, 7 Mar 2008 20:15:20 +0000 (20:15 +0000)]
New database format: pyyaml.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@207 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoLookup TITLE in HEAD, in HTML and in the root; test for None instead of AttributeError.
Oleg Broytman [Fri, 7 Mar 2008 20:14:12 +0000 (20:14 +0000)]
Lookup TITLE in HEAD, in HTML and in the root; test for None instead of AttributeError.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@206 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoFixed a misspelling.
Oleg Broytman [Fri, 7 Mar 2008 19:44:57 +0000 (19:44 +0000)]
Fixed a misspelling.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@205 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoPass charset from the command line.
Oleg Broytman [Fri, 7 Mar 2008 19:42:54 +0000 (19:42 +0000)]
Pass charset from the command line.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@204 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoExtract charset from "text/html; foo; charset=UTF-8, bar; baz;"
Oleg Broytman [Tue, 4 Mar 2008 12:07:52 +0000 (12:07 +0000)]
Extract charset from "text/html; foo; charset=UTF-8, bar; baz;"
("bar" is in case there are few Content-Type headers.)

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@203 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoFull name for "IGNORECASE".
Oleg Broytman [Tue, 4 Mar 2008 11:45:39 +0000 (11:45 +0000)]
Full name for "IGNORECASE".

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@202 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoConsider application/xhtml+xml as HTML.
Oleg Broytman [Tue, 4 Mar 2008 11:42:38 +0000 (11:42 +0000)]
Consider application/xhtml+xml as HTML.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@201 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoIgnore case for DOCTYPE.
Oleg Broytman [Tue, 4 Mar 2008 10:55:43 +0000 (10:55 +0000)]
Ignore case for DOCTYPE.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@200 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoCheck root.
Oleg Broytman [Tue, 4 Mar 2008 10:52:30 +0000 (10:52 +0000)]
Check root.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@199 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoapplication/xhtml+xml is HTML, too.
Oleg Broytman [Tue, 4 Mar 2008 10:52:17 +0000 (10:52 +0000)]
application/xhtml+xml is HTML, too.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@198 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoThere could be more than one semicolon in Content-Type header.
Oleg Broytman [Tue, 4 Mar 2008 10:40:14 +0000 (10:40 +0000)]
There could be more than one semicolon in Content-Type header.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@197 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoReparse the HTML if the charset was changed.
Oleg Broytman [Tue, 4 Mar 2008 10:32:18 +0000 (10:32 +0000)]
Reparse the HTML if the charset was changed.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@196 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoI have never saw pages in MacCyriliic.
Oleg Broytman [Tue, 4 Mar 2008 10:14:56 +0000 (10:14 +0000)]
I have never saw pages in MacCyriliic.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@195 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoReplace ISO-8859-2 to the default encoding.
Oleg Broytman [Tue, 4 Mar 2008 09:42:31 +0000 (09:42 +0000)]
Replace ISO-8859-2 to the default encoding.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@194 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoDo not log TypeError.
Oleg Broytman [Tue, 4 Mar 2008 09:37:45 +0000 (09:37 +0000)]
Do not log TypeError.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@193 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoIn the default hierarchy "root > html > head > title" any part can be absent.
Oleg Broytman [Mon, 3 Mar 2008 21:23:58 +0000 (21:23 +0000)]
In the default hierarchy "root > html > head > title" any part can be absent.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@192 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoLog more parsers errors.
Oleg Broytman [Mon, 3 Mar 2008 21:13:38 +0000 (21:13 +0000)]
Log more parsers errors.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@191 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoAlways log guessed charset even if it's utf-8.
Oleg Broytman [Mon, 3 Mar 2008 21:03:35 +0000 (21:03 +0000)]
Always log guessed charset even if it's utf-8.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@190 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoCharset was guessed if it is not from META and not from HTTP.
Oleg Broytman [Mon, 3 Mar 2008 17:50:06 +0000 (17:50 +0000)]
Charset was guessed if it is not from META and not from HTTP.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@189 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoFixed a bug in case there is no charset in META Content-Type.
Oleg Broytman [Mon, 3 Mar 2008 15:22:14 +0000 (15:22 +0000)]
Fixed a bug in case there is no charset in META Content-Type.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@188 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoTest meta charset by looking in META HTTP-Equiv.
Oleg Broytman [Mon, 3 Mar 2008 14:30:54 +0000 (14:30 +0000)]
Test meta charset by looking in META HTTP-Equiv.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@187 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoCreate the list of charsets outside of the parsers test loop.
Oleg Broytman [Mon, 3 Mar 2008 14:30:09 +0000 (14:30 +0000)]
Create the list of charsets outside of the parsers test loop.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@186 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years ago  is an entity that needs to be encoded.
Oleg Broytman [Mon, 25 Feb 2008 02:44:02 +0000 (02:44 +0000)]
  is an entity that needs to be encoded.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@185 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoUsed name2codepoint directly; recode it.
Oleg Broytman [Sun, 24 Feb 2008 21:37:24 +0000 (21:37 +0000)]
Used name2codepoint directly; recode it.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@184 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoCombined two "if"s.
Oleg Broytman [Sun, 24 Feb 2008 21:19:19 +0000 (21:19 +0000)]
Combined two "if"s.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@183 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoDo not unquote standard HTML entities.
Oleg Broytman [Sun, 24 Feb 2008 13:02:24 +0000 (13:02 +0000)]
Do not unquote standard HTML entities.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@182 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoEmulate log.
Oleg Broytman [Sun, 24 Feb 2008 12:27:21 +0000 (12:27 +0000)]
Emulate log.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@181 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoFixed a bug - break out of the loop after finding the first working charset.
Oleg Broytman [Sat, 23 Feb 2008 22:58:56 +0000 (22:58 +0000)]
Fixed a bug - break out of the loop after finding the first working charset.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@180 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoIt is not HTTP charset, it is guessed charset.
Oleg Broytman [Sat, 23 Feb 2008 22:40:56 +0000 (22:40 +0000)]
It is not HTTP charset, it is guessed charset.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@179 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoTry a list of charsets, including the universal (utf-8) and the default ones.
Oleg Broytman [Sat, 23 Feb 2008 22:34:24 +0000 (22:34 +0000)]
Try a list of charsets, including the universal (utf-8) and the default ones.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@178 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoStop meddling with cp1252.
Oleg Broytman [Wed, 13 Feb 2008 18:18:18 +0000 (18:18 +0000)]
Stop meddling with cp1252.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@177 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoReplace BeautifulSoup's guessed cp1252 with DEFAULT_CHARSET.
Oleg Broytman [Wed, 13 Feb 2008 18:17:53 +0000 (18:17 +0000)]
Replace BeautifulSoup's guessed cp1252 with DEFAULT_CHARSET.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@176 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agocurrent_charset is only needed in main.
Oleg Broytman [Tue, 12 Feb 2008 21:44:10 +0000 (21:44 +0000)]
current_charset is only needed in main.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@175 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoTimeout 5 minutes is enough (Squid uses 3 minutes).
Oleg Broytman [Mon, 11 Feb 2008 22:42:19 +0000 (22:42 +0000)]
Timeout 5 minutes is enough (Squid uses 3 minutes).

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@174 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoEncode entities.
Oleg Broytman [Mon, 11 Feb 2008 20:11:30 +0000 (20:11 +0000)]
Encode entities.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@173 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoRemoved dead code.
Oleg Broytman [Mon, 11 Feb 2008 20:11:05 +0000 (20:11 +0000)]
Removed dead code.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@172 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoRecode entities before num. entities.
Oleg Broytman [Mon, 11 Feb 2008 19:58:39 +0000 (19:58 +0000)]
Recode entities before num. entities.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@171 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoSwitched to utf-8.
Oleg Broytman [Mon, 11 Feb 2008 19:37:12 +0000 (19:37 +0000)]
Switched to utf-8.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@170 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoRecode HTML entities.
Oleg Broytman [Mon, 11 Feb 2008 16:16:11 +0000 (16:16 +0000)]
Recode HTML entities.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@169 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoRecode HTML entities.
Oleg Broytman [Mon, 11 Feb 2008 16:15:49 +0000 (16:15 +0000)]
Recode HTML entities.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@168 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoWHAT'S NEW in version 4.1.1.
Oleg Broytman [Mon, 11 Feb 2008 02:39:06 +0000 (02:39 +0000)]
WHAT'S NEW in version 4.1.1.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@167 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years ago2008.
Oleg Broytman [Mon, 11 Feb 2008 02:36:46 +0000 (02:36 +0000)]
2008.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@166 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoPython 2.5 allows try/except/finally in one clause.
Oleg Broytman [Mon, 11 Feb 2008 02:35:23 +0000 (02:35 +0000)]
Python 2.5 allows try/except/finally in one clause.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@165 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoNo need to catch BaseException.
Oleg Broytman [Sun, 10 Feb 2008 21:56:28 +0000 (21:56 +0000)]
No need to catch BaseException.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@164 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agofp could be None in http_error_default().
Oleg Broytman [Sun, 10 Feb 2008 21:49:40 +0000 (21:49 +0000)]
fp could be None in http_error_default().

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@163 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoCatch and print all exceptions.
Oleg Broytman [Sun, 10 Feb 2008 21:48:59 +0000 (21:48 +0000)]
Catch and print all exceptions.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@162 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years ago2008.
Oleg Broytman [Tue, 15 Jan 2008 19:51:59 +0000 (19:51 +0000)]
2008.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@161 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoRemoved the mirror at phd.by.ru.
Oleg Broytman [Sun, 13 Jan 2008 18:52:26 +0000 (18:52 +0000)]
Removed the mirror at phd.by.ru.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@160 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoDo the second check for title only if there is HEAD.
Oleg Broytman [Wed, 9 Jan 2008 09:38:10 +0000 (09:38 +0000)]
Do the second check for title only if there is HEAD.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@159 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoSome sites put TITLE in HTML outside of HEAD.
Oleg Broytman [Tue, 8 Jan 2008 16:01:08 +0000 (16:01 +0000)]
Some sites put TITLE in HTML outside of HEAD.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@158 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoSome sites put TITLE in HTML without HEAD.
Oleg Broytman [Tue, 8 Jan 2008 15:47:01 +0000 (15:47 +0000)]
Some sites put TITLE in HTML without HEAD.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@157 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoDo not return an empty string - pass it to BSoupParser.
Oleg Broytman [Tue, 8 Jan 2008 11:21:52 +0000 (11:21 +0000)]
Do not return an empty string - pass it to BSoupParser.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@156 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoIf there is HEAD but no TITLE - return empty title.
Oleg Broytman [Tue, 8 Jan 2008 11:20:40 +0000 (11:20 +0000)]
If there is HEAD but no TITLE - return empty title.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@155 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoFixed a bug created by removing module 'string'.
Oleg Broytman [Mon, 31 Dec 2007 20:51:12 +0000 (20:51 +0000)]
Fixed a bug created by removing module 'string'.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@154 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoCache icons.
Oleg Broytman [Mon, 31 Dec 2007 11:12:35 +0000 (11:12 +0000)]
Cache icons.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@153 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoAdded a comment.
Oleg Broytman [Sun, 30 Dec 2007 21:04:21 +0000 (21:04 +0000)]
Added a comment.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@152 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoBetter fake headers.
Oleg Broytman [Sun, 30 Dec 2007 20:31:36 +0000 (20:31 +0000)]
Better fake headers.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@151 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoFixed a bug - log can be None.
Oleg Broytman [Sun, 30 Dec 2007 20:31:16 +0000 (20:31 +0000)]
Fixed a bug - log can be None.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@150 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoLog is always open.
Oleg Broytman [Sat, 29 Dec 2007 23:13:33 +0000 (23:13 +0000)]
Log is always open.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@149 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoRemoved module 'string'.
Oleg Broytman [Sat, 29 Dec 2007 19:52:36 +0000 (19:52 +0000)]
Removed module 'string'.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@148 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoUnquote title for comparison.
Oleg Broytman [Sat, 29 Dec 2007 16:01:38 +0000 (16:01 +0000)]
Unquote title for comparison.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@147 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoRemoved timeoutsocket - the timeout functionality has been implemented in socket...
Oleg Broytman [Fri, 28 Dec 2007 20:08:03 +0000 (20:08 +0000)]
Removed timeoutsocket - the timeout functionality has been implemented in socket module.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@146 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoDo not display too much titles if they are equal.
Oleg Broytman [Fri, 28 Dec 2007 16:39:48 +0000 (16:39 +0000)]
Do not display too much titles if they are equal.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@145 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoFixed a bug.
Oleg Broytman [Fri, 28 Dec 2007 16:33:55 +0000 (16:33 +0000)]
Fixed a bug.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@144 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoMinor enhancements.
Oleg Broytman [Fri, 28 Dec 2007 15:44:13 +0000 (15:44 +0000)]
Minor enhancements.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@143 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoMinimal version of Python is 2.5 now.
Oleg Broytman [Fri, 28 Dec 2007 15:34:49 +0000 (15:34 +0000)]
Minimal version of Python is 2.5 now.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@142 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoShow version_info in X-User-Agent header.
Oleg Broytman [Fri, 28 Dec 2007 15:33:57 +0000 (15:33 +0000)]
Show version_info in X-User-Agent header.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@141 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoDocumentation update.
Oleg Broytman [Fri, 28 Dec 2007 14:46:21 +0000 (14:46 +0000)]
Documentation update.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@140 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoPut content type in apostrophes.
Oleg Broytman [Fri, 28 Dec 2007 14:40:28 +0000 (14:40 +0000)]
Put content type in apostrophes.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@139 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoFake headers to pretend this is a real browser.
Oleg Broytman [Thu, 27 Dec 2007 20:23:59 +0000 (20:23 +0000)]
Fake headers to pretend this is a real browser.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@138 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoHandle redirects when downloading the icon.
Oleg Broytman [Thu, 27 Dec 2007 19:49:06 +0000 (19:49 +0000)]
Handle redirects when downloading the icon.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@137 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoLog dups either to the logfile or to stdout but not to both.
Oleg Broytman [Thu, 27 Dec 2007 19:37:42 +0000 (19:37 +0000)]
Log dups either to the logfile or to stdout but not to both.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@136 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoStrip every line in title.
Oleg Broytman [Thu, 27 Dec 2007 19:33:24 +0000 (19:33 +0000)]
Strip every line in title.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@135 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoConvert redirect timeout to int if possible.
Oleg Broytman [Thu, 27 Dec 2007 19:33:01 +0000 (19:33 +0000)]
Convert redirect timeout to int if possible.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@134 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoAvoid double-escaping.
Oleg Broytman [Thu, 27 Dec 2007 19:31:26 +0000 (19:31 +0000)]
Avoid double-escaping.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@133 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoBeautifulSoap is already here.
Oleg Broytman [Thu, 27 Dec 2007 10:28:11 +0000 (10:28 +0000)]
BeautifulSoap is already here.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@132 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoOpen the error log in append mode.
Oleg Broytman [Mon, 24 Dec 2007 20:59:45 +0000 (20:59 +0000)]
Open the error log in append mode.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@131 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoVersion 4.1.
Oleg Broytman [Sun, 23 Dec 2007 10:57:10 +0000 (10:57 +0000)]
Version 4.1.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@130 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoFlush stderr.
Oleg Broytman [Sun, 23 Dec 2007 10:54:16 +0000 (10:54 +0000)]
Flush stderr.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@129 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoMark the error output from the subprocess with a prefix.
Oleg Broytman [Sun, 23 Dec 2007 10:53:34 +0000 (10:53 +0000)]
Mark the error output from the subprocess with a prefix.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@128 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoRedirect subprocess' stderr to my stderr.
Oleg Broytman [Sat, 22 Dec 2007 23:17:53 +0000 (23:17 +0000)]
Redirect subprocess' stderr to my stderr.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@127 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoRedirect stderr to catch 'close failed: [Errno 9] Bad file descriptor' message
Oleg Broytman [Sat, 22 Dec 2007 22:01:19 +0000 (22:01 +0000)]
Redirect stderr to catch 'close failed: [Errno 9] Bad file descriptor' message
from os.close() in Subprocess.die().

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@126 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoHandle redirects when downloading the icon.
Oleg Broytman [Sat, 22 Dec 2007 20:53:08 +0000 (20:53 +0000)]
Handle redirects when downloading the icon.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@125 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoDo not encode non-encodeable entities.
Oleg Broytman [Sat, 22 Dec 2007 20:52:14 +0000 (20:52 +0000)]
Do not encode non-encodeable entities.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@124 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoAlways close the input file.
Oleg Broytman [Sat, 22 Dec 2007 16:59:28 +0000 (16:59 +0000)]
Always close the input file.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@123 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoAdded BadDeclParser.
Oleg Broytman [Sat, 22 Dec 2007 16:58:32 +0000 (16:58 +0000)]
Added BadDeclParser.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@122 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoSimpler temp file name.
Oleg Broytman [Wed, 19 Dec 2007 10:42:31 +0000 (10:42 +0000)]
Simpler temp file name.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@121 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoSlightly changed warning message.
Oleg Broytman [Wed, 19 Dec 2007 10:18:30 +0000 (10:18 +0000)]
Slightly changed warning message.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@120 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoFixed a bug.
Oleg Broytman [Tue, 18 Dec 2007 18:42:18 +0000 (18:42 +0000)]
Fixed a bug.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@119 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoDo all manipulations with title in one place.
Oleg Broytman [Tue, 18 Dec 2007 18:40:42 +0000 (18:40 +0000)]
Do all manipulations with title in one place.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@118 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoTimout can be float.
Oleg Broytman [Tue, 18 Dec 2007 18:37:14 +0000 (18:37 +0000)]
Timout can be float.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@117 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoChanged User-agent header: I saw a number of sites that forbid "Mozilla compatible...
Oleg Broytman [Tue, 18 Dec 2007 18:16:18 +0000 (18:16 +0000)]
Changed User-agent header: I saw a number of sites that forbid "Mozilla compatible" browsers.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@116 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoI saw a number of sites that forbid "Mozilla compatible".
Oleg Broytman [Tue, 18 Dec 2007 17:58:37 +0000 (17:58 +0000)]
I saw a number of sites that forbid "Mozilla compatible".

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@115 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoLog the module's name of the failed parse_html.
Oleg Broytman [Tue, 18 Dec 2007 06:10:34 +0000 (06:10 +0000)]
Log the module's name of the failed parse_html.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@114 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoTry BeautifulSoup; if it fails - fall back to HTML Parser.
Oleg Broytman [Tue, 18 Dec 2007 05:55:31 +0000 (05:55 +0000)]
Try BeautifulSoup; if it fails - fall back to HTML Parser.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@113 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23

16 years agoRecode from DEFAULT_CHARSET if recoding from cp1252 (bad guess by BeautifulSoup)...
Oleg Broytman [Tue, 18 Dec 2007 05:52:48 +0000 (05:52 +0000)]
Recode from DEFAULT_CHARSET if recoding from cp1252 (bad guess by BeautifulSoup) failed.

git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@112 fdd5c36f-1aea-0310-aeeb-c58d7e2b6c23