Age | Commit message (Expand) | Author |
---|---|---|
2012-09-06 | more splitting into libcrawl, crawl binary | Andreas Baumann |
2012-07-29 | somewhat working again | Andreas Baumann |
2012-07-29 | temporarily removed domain, domain filter is a host filter now | Andreas Baumann |
2012-07-29 | started to add simple parseUrl implementation | Andreas Baumann |
2012-07-28 | heavy redesign of URL class, must not contain any parsing logic as | Andreas Baumann |
2012-07-28 | started to add URL normalizers and testing environment for URLs | Andreas Baumann |
2012-07-15 | some investemnet in URL parsing | Andreas Baumann |
2012-07-15 | started to add URL filters | Andreas Baumann |
2012-07-14 | some pseudo URL normalization | Andreas Baumann |
2012-07-14 | first working crawler | Andreas Baumann |
2012-07-14 | first fetch works | Andreas Baumann |
2012-07-13 | added a test for a libfetch_streambuf | Andreas Baumann |
2012-07-12 | added basic structure | Andreas Baumann |
2009-12-29 | more reading and abstract interfacing | Andreas Baumann |