| Commit message (Collapse) | Author | Age | Files | Lines |
| |
|
|
|
|
|
| |
This splits some common functionality from Link._get_child() and
Crawler.get_link() to the new Link.get_or_create() function.
|
|
|
|
|
| |
This should make some functions clearer and marks internal functions
with a leading underscore.
|
| |
|
|
|
|
|
|
| |
This converts problems to unicode so they can be stored correctly by
SQLAlchemy. This amongst other things fixes a problem when the web
server returns a status message with non-ASCII characters.
|
|
|
|
|
|
|
| |
This combines two queries using a union that already does distinct.
This also removes the distinct from the parents() function because it
uses a union which is supposed to use distinct already.
|
|
|
|
|
|
| |
pages
git-svn-id: http://arthurdejong.org/svn/webcheck/webcheck@463 86f53f14-5ff3-0310-afe5-9b438ce3f40c
|
|
|
|
|
|
| |
crawling based on a patch by Devin Bayer
git-svn-id: http://arthurdejong.org/svn/webcheck/webcheck@459 86f53f14-5ff3-0310-afe5-9b438ce3f40c
|
|
|
|
| |
git-svn-id: http://arthurdejong.org/svn/webcheck/webcheck@457 86f53f14-5ff3-0310-afe5-9b438ce3f40c
|
|
|
|
|
|
| |
the code to webcheck.db
git-svn-id: http://arthurdejong.org/svn/webcheck/webcheck@452 86f53f14-5ff3-0310-afe5-9b438ce3f40c
|
|
|
|
|
|
| |
make imports of config and debugio consistent
git-svn-id: http://arthurdejong.org/svn/webcheck/webcheck@447 86f53f14-5ff3-0310-afe5-9b438ce3f40c
|
|
|
|
| |
git-svn-id: http://arthurdejong.org/svn/webcheck/webcheck@443 86f53f14-5ff3-0310-afe5-9b438ce3f40c
|
|
the webcheck package and reorganise imports accordingly
git-svn-id: http://arthurdejong.org/svn/webcheck/webcheck@435 86f53f14-5ff3-0310-afe5-9b438ce3f40c
|