]>
git.phdru.name Git - bookmarks_db.git/log
Oleg Broytman [Sun, 6 Jul 2014 01:34:29 +0000 (05:34 +0400)]
Minor refactoring: rename msg to e
Oleg Broytman [Sun, 6 Jul 2014 01:22:31 +0000 (05:22 +0400)]
Add robot based on urllib2
Oleg Broytman [Sun, 6 Jul 2014 01:11:24 +0000 (05:11 +0400)]
Don't use urllib._urlopener - it isn't available with urllib2
Oleg Broytman [Sun, 6 Jul 2014 01:04:43 +0000 (05:04 +0400)]
Minor refactoring
Oleg Broytman [Fri, 4 Jul 2014 22:56:11 +0000 (02:56 +0400)]
Remove self.cleanup
Oleg Broytman [Fri, 4 Jul 2014 22:15:03 +0000 (02:15 +0400)]
Minor refactoring
Oleg Broytman [Fri, 4 Jul 2014 22:12:23 +0000 (02:12 +0400)]
Change default subprocess robot to urllib_to
Oleg Broytman [Fri, 4 Jul 2014 22:09:10 +0000 (02:09 +0400)]
Pass subproc_* parameters to the subprocess
Oleg Broytman [Fri, 4 Jul 2014 21:55:56 +0000 (01:55 +0400)]
Allow to set default timeout from parameters
Lower default timeout to 1 minute.
Oleg Broytman [Fri, 4 Jul 2014 21:04:27 +0000 (01:04 +0400)]
Return redirect code/destination URL
Return redirect code and destination URL instead of raising
RedirectException.
Oleg Broytman [Fri, 4 Jul 2014 20:39:25 +0000 (00:39 +0400)]
Minor refactoring: reorder return values
Oleg Broytman [Fri, 4 Jul 2014 20:28:37 +0000 (00:28 +0400)]
Parse new storage name and set parameters
Oleg Broytman [Fri, 4 Jul 2014 20:28:22 +0000 (00:28 +0400)]
Remove unused import
Oleg Broytman [Fri, 4 Jul 2014 20:11:43 +0000 (00:11 +0400)]
Rename urlretrieve to get
Oleg Broytman [Fri, 4 Jul 2014 19:36:34 +0000 (23:36 +0400)]
Remove Accept-Charset even in case of error
Oleg Broytman [Sun, 29 Jun 2014 16:58:44 +0000 (20:58 +0400)]
Pass subproc parameter to the subprocess to allow different robots
Oleg Broytman [Sun, 29 Jun 2014 16:56:26 +0000 (20:56 +0400)]
Fix a bug
Oleg Broytman [Sun, 29 Jun 2014 16:26:05 +0000 (20:26 +0400)]
Upgrade subproc.py to version 1.15
Oleg Broytman [Sun, 29 Jun 2014 16:06:20 +0000 (20:06 +0400)]
Adapt to the latest code
Oleg Broytman [Sun, 29 Jun 2014 15:50:19 +0000 (19:50 +0400)]
Allow parameters in BKMK_* environment variables
For example, BKMK_ROBOT=forking:subproc=urllib or
BKMK_STORAGE=json:filename=bookmarks_db.json.
Oleg Broytman [Wed, 25 Jun 2014 16:49:21 +0000 (20:49 +0400)]
Make most classes new-style classes
Oleg Broytman [Sun, 22 Jun 2014 17:24:10 +0000 (21:24 +0400)]
Fix simple robot with timeout
Rename simple_tos robot to urllib_to.
Oleg Broytman [Thu, 12 Jun 2014 23:06:44 +0000 (03:06 +0400)]
Fix comments
Oleg Broytman [Thu, 12 Jun 2014 20:01:58 +0000 (00:01 +0400)]
Handle HTTP Error 303 redirects
Oleg Broytman [Thu, 12 Jun 2014 18:23:06 +0000 (22:23 +0400)]
Fix a bug: convert str to float
Oleg Broytman [Thu, 12 Jun 2014 13:56:51 +0000 (17:56 +0400)]
Update changelogs
Oleg Broytman [Thu, 12 Jun 2014 13:40:00 +0000 (17:40 +0400)]
Adapt JSON storage to recent Mozilla export format
Adapt JSON storage to recent export format. Tested with Firefox 29 and 30.
Remove root folder's attributes. Remove 'parent' key.
Process 'guid', and 'iconuri' keys. Store timestamps as floats.
Special handling for 'places:' "bookmarks".
Oleg Broytman [Thu, 12 Jun 2014 13:38:12 +0000 (17:38 +0400)]
Add helper scripts to debug JSON storage
Oleg Broytman [Sat, 31 May 2014 23:26:40 +0000 (03:26 +0400)]
Do not assign icon errors to bookmark.error
Oleg Broytman [Sat, 31 May 2014 20:06:45 +0000 (00:06 +0400)]
Next version will be 4.6.0
Oleg Broytman [Sat, 31 May 2014 20:05:43 +0000 (00:05 +0400)]
Relax record schema requirements
Oleg Broytman [Sat, 31 May 2014 19:58:51 +0000 (23:58 +0400)]
Split simple robot
Separate network operations and URL handling/HTML parsing.
Oleg Broytman [Tue, 20 May 2014 00:55:47 +0000 (04:55 +0400)]
Allow the script to be run only in the origin directory
Oleg Broytman [Mon, 19 May 2014 17:22:36 +0000 (21:22 +0400)]
Add update script
Oleg Broytman [Mon, 5 May 2014 18:46:56 +0000 (22:46 +0400)]
distribute now requires additional paramters
Oleg Broytman [Wed, 30 Apr 2014 18:07:20 +0000 (22:07 +0400)]
Split parse_html/__init__.py into __main__.py
Oleg Broytman [Wed, 30 Apr 2014 18:05:09 +0000 (22:05 +0400)]
Change parse_html to parse strings, not files
Oleg Broytman [Wed, 30 Apr 2014 00:23:31 +0000 (04:23 +0400)]
Add a few TODO items
Oleg Broytman [Wed, 30 Apr 2014 00:02:13 +0000 (04:02 +0400)]
Change goal
A new robot instead of switching the existing one.
Oleg Broytman [Wed, 30 Apr 2014 00:01:56 +0000 (04:01 +0400)]
Rename CWD to PROG_DIR
Oleg Broytman [Tue, 29 Apr 2014 21:49:18 +0000 (01:49 +0400)]
Add ChangeLog
Copyright (C) 2014.
Oleg Broytman [Sun, 9 Mar 2014 17:34:16 +0000 (21:34 +0400)]
Micro refactoring
Oleg Broytman [Fri, 24 Jan 2014 18:22:55 +0000 (22:22 +0400)]
Minor formatting enhancement
Oleg Broytman [Wed, 15 Jan 2014 04:36:04 +0000 (08:36 +0400)]
Switch branch before setting umask
Oleg Broytman [Tue, 14 Jan 2014 19:52:26 +0000 (23:52 +0400)]
Version 4.5.6: remove absolute directory ~/lib to make it portable
Oleg Broytman [Tue, 14 Jan 2014 18:07:39 +0000 (22:07 +0400)]
Remove absolute directory ~/lib to make it portable
Oleg Broytman [Tue, 24 Dec 2013 22:12:31 +0000 (02:12 +0400)]
TODO: remove absolute directory ~/lib to make it portable
Oleg Broytman [Tue, 24 Dec 2013 21:39:57 +0000 (01:39 +0400)]
find . -delete
find . ... -delete
instead of
find . ... | xargs rm -f
Oleg Broytman [Wed, 4 Dec 2013 20:53:59 +0000 (00:53 +0400)]
Version 4.5.5
Oleg Broytman [Wed, 4 Dec 2013 15:35:38 +0000 (19:35 +0400)]
Parse <meta charset="...">
Oleg Broytman [Sun, 1 Dec 2013 18:52:53 +0000 (22:52 +0400)]
Add an html fragment for gitweb
Oleg Broytman [Sat, 23 Nov 2013 15:23:47 +0000 (19:23 +0400)]
public_html has been removed from phdru.name paths
Oleg Broytman [Sat, 23 Nov 2013 14:58:41 +0000 (18:58 +0400)]
Version 4.5.4 (2013-11-23): publish through git/gitweb
Oleg Broytman [Sat, 23 Nov 2013 00:02:11 +0000 (04:02 +0400)]
Added third-party modules and scripts
Oleg Broytman [Fri, 1 Nov 2013 21:21:09 +0000 (01:21 +0400)]
Add 'Parse <meta charset="...">'
Oleg Broytman [Fri, 1 Nov 2013 21:19:30 +0000 (01:19 +0400)]
Do not test annos' type
Firefox since version 25.0 changed format for comments.
Oleg Broytman [Fri, 26 Jul 2013 19:29:08 +0000 (23:29 +0400)]
Version 4.5.3: minor tweak in Makefile
'fulldistr' is also a .PHONY target. Switched to git. Copyright 2013.
Oleg Broytman [Fri, 26 Jul 2013 19:17:00 +0000 (23:17 +0400)]
Added .gitattributes: do not export .git*
Oleg Broytman [Wed, 24 Jul 2013 10:49:38 +0000 (14:49 +0400)]
fulldistr is also a .PHONY target
Oleg Broytman [Tue, 23 Jul 2013 01:02:25 +0000 (05:02 +0400)]
svn export => git export
Oleg Broytman [Mon, 22 Jul 2013 19:11:31 +0000 (23:11 +0400)]
svn => git
Oleg Broytman [Fri, 19 Jul 2013 20:55:18 +0000 (00:55 +0400)]
Add .gitignore
Oleg Broytman [Sat, 17 Nov 2012 01:08:01 +0000 (01:08 +0000)]
phdru.co.cc => phdru.cu.cc
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@370
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sun, 21 Oct 2012 17:27:05 +0000 (17:27 +0000)]
Removed excessive trailing backslashes
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@369
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Wed, 26 Sep 2012 22:42:28 +0000 (22:42 +0000)]
phd.webhost.ru => phdru.co.cc
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@368
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Mon, 24 Sep 2012 12:36:18 +0000 (12:36 +0000)]
Version 4.5.2 was released 2012-09-24
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@367
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sun, 23 Sep 2012 22:54:49 +0000 (22:54 +0000)]
Extract html redirect even if ther is no title
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@366
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sun, 23 Sep 2012 22:54:31 +0000 (22:54 +0000)]
Insert an empty line between runs.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@365
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sun, 23 Sep 2012 19:04:01 +0000 (19:04 +0000)]
Added latest news.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@364
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sat, 22 Sep 2012 11:17:45 +0000 (11:17 +0000)]
Handle redirect 303
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@363
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Fri, 21 Sep 2012 22:54:58 +0000 (22:54 +0000)]
Fixed a bug in handling "place:" URLs -- do not add "//".
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@362
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Fri, 21 Sep 2012 22:50:18 +0000 (22:50 +0000)]
Handle HTTP Redirect 307.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@361
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sat, 14 Apr 2012 17:00:01 +0000 (17:00 +0000)]
Next version will be 4.5.2.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@360
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sat, 14 Apr 2012 16:58:39 +0000 (16:58 +0000)]
Removed svn:keywords. Extended copyright to 2012.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@359
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Wed, 28 Dec 2011 16:20:06 +0000 (16:20 +0000)]
Version 4.5.1 (2011-12-28).
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@358
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Wed, 28 Dec 2011 16:17:44 +0000 (16:17 +0000)]
Places, dammit.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@357
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Tue, 20 Dec 2011 04:50:24 +0000 (04:50 +0000)]
Convert date to/from mozilla-specific json format.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@356
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Mon, 19 Dec 2011 22:40:43 +0000 (22:40 +0000)]
Write netscape-formatted datetime.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@355
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Mon, 19 Dec 2011 22:34:53 +0000 (22:34 +0000)]
2039!
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@354
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Mon, 19 Dec 2011 22:29:52 +0000 (22:29 +0000)]
Process mozilla-specific date/time representation.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@353
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sun, 18 Dec 2011 17:48:28 +0000 (17:48 +0000)]
Changed the order or parser according to their success rate.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@352
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sun, 18 Dec 2011 17:36:10 +0000 (17:36 +0000)]
Version 4.5.0.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@351
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sun, 18 Dec 2011 17:35:19 +0000 (17:35 +0000)]
Pretty-print last_modified.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@350
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Mon, 12 Dec 2011 09:30:12 +0000 (09:30 +0000)]
Added a shell wrapper for set-title-list.py.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@349
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Mon, 12 Dec 2011 09:29:03 +0000 (09:29 +0000)]
Adapted to different Mozilla place URIs.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@348
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sun, 11 Dec 2011 03:43:17 +0000 (03:43 +0000)]
Debug HTML parsers.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@347
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sun, 11 Dec 2011 03:29:12 +0000 (03:29 +0000)]
Newer Mozilla versions use 'places://'.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@346
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sun, 11 Dec 2011 03:27:44 +0000 (03:27 +0000)]
Encode values from unicode.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@345
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Sun, 11 Dec 2011 03:27:18 +0000 (03:27 +0000)]
Convert to unicode and back again to unescape unichr'd entities.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@344
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Thu, 1 Dec 2011 12:21:32 +0000 (12:21 +0000)]
Moved robot_simple into run().
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@343
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Thu, 1 Dec 2011 12:20:34 +0000 (12:20 +0000)]
urllib2
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@342
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Thu, 1 Dec 2011 12:20:01 +0000 (12:20 +0000)]
Removed mirror at phd.by.ru.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@341
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Wed, 13 Jul 2011 13:43:23 +0000 (13:43 +0000)]
Underline IDNA encoding.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@340
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Tue, 12 Jul 2011 15:18:10 +0000 (15:18 +0000)]
Do not split/decode query and tag - only split host and path and recode the host.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@339
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Tue, 12 Jul 2011 14:37:25 +0000 (14:37 +0000)]
Split hrefs into domain and path components; recode only domain.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@338
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Mon, 11 Jul 2011 18:48:24 +0000 (18:48 +0000)]
Insert a space.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@337
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Mon, 11 Jul 2011 18:42:33 +0000 (18:42 +0000)]
Recode hrefs (due to international domain names) to the current charset.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@336
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Mon, 11 Jul 2011 18:19:22 +0000 (18:19 +0000)]
Fixed bugs related to keywords/positional parameters.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@335
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Mon, 11 Jul 2011 18:05:58 +0000 (18:05 +0000)]
last_visit could be None.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@334
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23
Oleg Broytman [Thu, 14 Apr 2011 15:25:28 +0000 (15:25 +0000)]
Moved DEFAULT_CHARSET to bkmk_objects.py.
git-svn-id: file:///home/phd/archive/SVN/bookmarks_db/trunk@333
fdd5c36f -1aea-0310-aeeb-
c58d7e2b6c23