Arthur de Jong

+2007-01-15 20:26 arthur

+

+ * [r308] schemes/http.py: catch any exception in HTTP module and

+ report is as a link problem

+

+2007-01-15 08:25 arthur

+

+ * [r307] HACKING, README, debian/rules: move section on webcheck

+ design into HACKING document

+

+2007-01-15 08:21 arthur

+

+ * [r306] README: fix the bugreporting section to more clearly state

+ the needed information

+

+2007-01-13 08:19 arthur

+

+ * [r305] debian/control, debian/pycompat, debian/rules: switch to

+ using latest syntax of python-support

+

+2006-10-23 21:09 arthur

+

+ * [r304] plugins/sitemap.py: present sitemap with all bases

+

+2006-10-23 21:08 arthur

+

+ * [r303] config.py: add USE_ROBOTS option

+

+2006-10-23 21:08 arthur

+

+ * [r302] crawler.py: include list of bases in Site class

+

+2006-10-23 21:05 arthur

+

+ * [r301] plugins/__init__.py: print reason why link is yanked if

+ available

+

+2006-09-29 10:27 arthur

+

+ * [r300] debian/control: include link to homepage in package

+ description

+

+2006-09-04 10:47 arthur

+

+ * [r299] schemes/http.py: explicitly transform username and

+ password to string in case either one isn't supplied

+

+2006-07-13 20:47 arthur

+

+ * [r298] schemes/http.py: also handle ssl related socket errors

+ (e.g. ssl timeout)

+

+2006-07-13 20:44 arthur

+

+ * [r297] crawler.py, parsers/html.py, schemes/http.py: add

+ set_encoding methond to Link object to do some basic encoding

+ santity checks

+

+2006-07-02 21:42 arthur

+

+ * [r295] ChangeLog, NEWS, TODO, config.py, debian/changelog,

+ webcheck.1: get files ready for 1.9.7 release

+

+ * [r287] serialize.py: make DeSerializeException a class instead of

+ a function and add fixme

+ * [r267] serialize.py: only write serialized data if it is diferent

+ from the constructor's default value

+ * [r266] serialize.py: clear anchors, linkproblems and pageproblems

+ from to be deserialized links to avoid duplicates as a link can

+ be deserialized multiple times

+ * [r244] webcheck.py: handle problems in regular expressions passed

+ on the command line a little more gracefully

+ * [r238] webcheck.css: revert to borderless links as they look ugly

+ in some (most) cases

+ back to system encoding) and add some TODO's to do extra encoding

+ checking

+ * [r229] plugins/__init__.py: do not include navigation for plugins

+ that do not generate output

+ any non-ascii characters to avoid problems later on (and add some

+ more debugging)

+ * [r204] crawler.py, webcheck.1, webcheck.py: add --internal option

+ to match internal URLs with a regular expression

+ * [r199] plugins/about.py: make copyright information a little more

+ compact

+ plugins/slow.py, plugins/urllist.py: move printing of description

+ into plugin instead of from __init__.py

+ plugins/problems.py, plugins/slow.py: replace backslases from end

+ of lines where they are not required

+ plugins/problems.py: store author and title in unicode internally

+ and ensure that they are output as utf-8

+ * [r174] plugins/__init__.py: improve code and documentation of the

+ open_file() function, adding an istext flag (defaults to True) to

+ open files as text

+ * [r173] webcheck.py: do not prepend output directory twice (thanks

+ to Stefan Schröder <stefan@tokonoma.de> for spotting this)

+ * [r162] plugins/__init__.py, webcheck.py: make error handling more

+ robust and have consisten error messages

+ * [r149] AUTHORS: add some other people to the AUTHORS file, mostly

+ based on contents of the Debian bug tracking system

+ ftp scheme, handling errors more gracefully and also crawl normal

+ ftp directories

+ * [r131] plugins/__init__.py: add missing newline and trim trailing

+ newline of extra link info

+ * [r130] schemes/file.py: complete reimplementation of file module,

+ reading index.html from directory, otherwise read directory

+ contents

+ mimetypes to scheme modules to only fetch content if we can parse

+ the content type

+ * [r125] parsers/html.py: put compiled regular expression on module

+ level so that it is compiled only once

+ * [r110] plugins/__init__.py: remove version and author from module

+ as no other module has one (except the plugins themselves)

+ traversal of the site to combine links into pages, combining page

+ children and determining depth of every page and using all this

+ in the sitemap

+ * [r86] README: clean up README removing sections that should be in

+ the manual page

+ * [r79] crawler.py: only add links to crawl list if they are not in

+ there allready

+ schemes/http.py, webcheck.py: almost complete rewrite of crawling

+ and site state code making children and parents link objects

+ instead of urls and giving link member variables better names,

+ change plugins accordingly, make scheme handling more pluggable

+ and only use one function call and have a better pluggable

+ structure for content parsing (currently only html)

+ functionality of rptlib.py to __init__.py so that we can just use

+ the plugins package

+ * [r57] plugins/about.py, plugins/badlinks.py, plugins/external.py,

+ plugins/images.py, plugins/notchkd.py, plugins/notitles.py,

+ plugins/problems.py, plugins/rptlib.py, plugins/sitemap.py,

+ plugins/slow.py, plugins/urllist.py, plugins/whatsnew.py,

+ plugins/whatsold.py, webcheck.css, webcheck.py: clean up html

+ output generating xhtml 1.1 without frames and using css for

+ styling also getting rid of the images

+ implement consistent sorting of all lists removing sort functions

+ from rptlib and using lambda functions where needed

+ * [r53] INSTALL, README, config.py, myUrlLib.py, plugins/rptlib.py,

+ schemes/http.py, webcheck.1, webcheck.py: name webcheck with

+ lower case

+ * [r47] config.py, plugins/urllist.py: add simple urllist plugin to

+ list all visited urls

+ plugins/whatsold.py, schemes/http.py, webcheck.py: pass reference

+ to Link class to plugins with parameter and make import config

+ where it is used instead of accessing it through another module

+ * [r40] plugins/badlinks.py, plugins/images.py, plugins/notchkd.py,

+ plugins/notitles.py: again use the url as link title for some

+ links

+ code, moving httpcodes to the only place they were used, cleaning

+ up plugin titles, version numbers and descriptios, adding

+ docstrings and using slightly more logical and consistent names

+ (plus some other cleanups)

+ * [r31] webcheck.1: initial version of manual page loosely based on

+ documentation

+ * [r30] AUTHORS: added myself as copyright holder and added Bastian

+ Kleineidam (previous debian package maintainer) as contributor

+ * [r23] contrib/plugins/about.py, myUrlLib.py, plugins/badlinks.py,

+ plugins/external.py, plugins/images.py, plugins/notchkd.py,

+ plugins/notitles.py, plugins/problems.py, plugins/rptlib.py,

+ plugins/sitemap.py, plugins/slow.py, plugins/whatsnew.py,

+ plugins/whatsold.py, schemes/http.py, webcheck.py: rename

+ linkList to linkMap

+ plugins/whatsnew.py, plugins/whatsold.py, schemes/http.py: indent

+ with spaces instead of tabs (tabs are evil)

+ schemes/filelink.py, schemes/ftplink.py, version.py, webcheck.py:

+ make nicer file (copyrights) headers

+ Delafond <sdelafond@gmx.net> (from http://bugs.debian.org/286017)

+ to fix problems with recent versions of python

+ contrib/plugins/about.py, debugio.py, htmlparse.py, httpcodes.py,

+ myUrlLib.py, plugins, plugins/__init__.py, plugins/badlinks.py,

+ plugins/external.py, plugins/images.py, plugins/notchkd.py,

+ plugins/notitles.py, plugins/problems.py, plugins/rptlib.py,

+ plugins/sitemap.py, plugins/slow.py, plugins/whatsnew.py,

+ plugins/whatsold.py, robotparser.py, schemes,

+ schemes/__init__.py, schemes/filelink.py, schemes/ftplink.py,

+ schemes/httplink.py, version.py, webcheck.css, webcheck.py,

+ webcheck.sh: import of release 1.0

+changes from 1.9.7 to 1.9.8

+---------------------------

+

+* some checks for properly handling unknown and wrong encodings have been

+ added

+* added proper error handling for SSL related socket problems (exceptions are

+ not a subclass of regular socket exceptions)

+* a bugfix for urls that contain a user name without a password or the other

+ way around

+* miscellaneous small report improvements

+

+

+ % tar -xvzf webcheck-1.9.8.tar.gz

+ % ln -s /opt/webcheck-1.9.8/webcheck.py /usr/local/bin/webcheck

+ % ln -s /opt/webcheck-1.9.8/webcheck.1 /usr/local/man/man1/webcheck.1

+ % man -l /opt/webcheck-1.9.8/webcheck.1

+* implement an option to ignore problems on pages (but do consider internal, etc) (e.g. for generated or legacy html)

+VERSION = '1.9.8'

+# Whether to fetch robots.txt files and do checking based on the information

+webcheck (1.9.8) unstable; urgency=low

+

+ * some checks for properly handling unknown and wrong encodings have been

+ added

+ * added proper error handling for SSL related socket problems (exceptions are

+ not a subclass of regular socket exceptions)

+ * a bugfix for urls that contain a user name without a password or the other

+ way around

+ * miscellaneous small report improvements

+ * switch packaging files to using latest syntax of python-support

+

+

+ -- Arthur de Jong <adejong@debian.org> Mon, 15 Jan 2007 21:30:00 +0100

+

+.\" Copyright (C) 2005, 2006, 2007 Arthur de Jong

+.TH "webcheck" "1" "Jan 2007" "Version 1.9.8" "User Commands"

+# Copyright (C) 2005, 2006, 2007 Arthur de Jong

+ 'Copyright (C) 1998, 1999, 2002, 2005, 2006, 2007 Albert Hopkins (marduk),\n'