summaryrefslogtreecommitdiff
path: root/src/GNUmakefile
AgeCommit message (Collapse)Author
2015-03-05more lua fixesAndreas Baumann
2014-10-03fixed setting data from source in fetcher modulesAndreas Baumann
2014-09-28first Lua config of crawlerAndreas Baumann
2014-09-28some lua workAndreas Baumann
2014-09-28some testing and stabilizingAndreas Baumann
2014-07-23added parsing of Sitemap in robots.txtAndreas Baumann
2012-09-10fixed logger to liblogger renaming on LinuxAndreas Baumann
2012-09-10libutil move and liblogger rename on WindowsAndreas Baumann
2012-09-07added a libutil for porting stuff and helpersAndreas Baumann
2012-09-07fixed some linker errors on FreeBSD (should also affect Linux, but there ↵Andreas Baumann
everything worked?)
2012-09-06crawler fixed on LinuxAndreas Baumann
2012-09-06more splitting into libcrawl, crawl binaryAndreas Baumann
moved more public header to 'include' changed approach for dynamic linking on Windows
2012-09-05split away util, logger, and moduleAndreas Baumann
made a liblogger adapted all tests
2012-09-05added Windows WinDbg log sinkAndreas Baumann
some renames and cleanups
2012-09-05added syslog logger sinkAndreas Baumann
2012-09-04pimplified logger, hides list of sinks (internal implementation)Andreas Baumann
made logger test link statically again (for valgrind and gdb)
2012-09-02prefer dynamic to static linking (linking a non-PIC .a libraryAndreas Baumann
into a module is illegal, but on Linux!)
2012-08-22completly rewrote the logger as singletonAndreas Baumann
2012-08-21Merge branch 'master' of ssh://andreasbaumann.dyndns.org:2222/crawlerAndreas Baumann
2012-08-21-Andreas Baumann
2012-08-21-Andreas Baumann
2012-08-19-Andreas Baumann
2012-08-17added a common base class for spooling rewind input stream, adaptedAndreas Baumann
libfetch rewind input stream to use that one
2012-08-15renamedAndreas Baumann
2012-08-10first porting attempts to Windows:Andreas Baumann
nmake support from Wolframe module loader adapted tests for typeinfo and template trickery
2012-08-08added a file rewind input streamAndreas Baumann
started to add MIME type detection and a module based on libmagic (not finished yet)
2012-08-08modularized all other modulesAndreas Baumann
2012-08-08chain filter and modules with one ctor param work nowAndreas Baumann
2012-08-07started modularization of URL filtersAndreas Baumann
better registry function for loading the module (base class as signature) started to support variable arguments for registry create/constructor (work in progress) playing with some Alexandrescu idions :-)
2012-08-07more reduction of module code and fixed dependency problem when buildingAndreas Baumann
2012-08-07cleaned up url normalizer tests and made them use module loaderAndreas Baumann
2012-08-06first steps to make URL loader loadableAndreas Baumann
2012-08-04rearanged google test1 and added a GoogleUrlNormalizerAndreas Baumann
2012-07-29temporarily removed domain, domain filter is a host filter nowAndreas Baumann
2012-07-28started to add URL normalizers and testing environment for URLsAndreas Baumann
2012-07-19some interface fixesAndreas Baumann
2012-07-18added URLSeen componentAndreas Baumann
2012-07-15started to add URL filtersAndreas Baumann
2012-07-14first working crawlerAndreas Baumann
2012-07-14added streamhtmlparserAndreas Baumann
2012-07-13added a test for a libfetch_streambufAndreas Baumann
2012-07-12added basic structureAndreas Baumann
2012-07-12a restartAndreas Baumann
2009-12-29more reading and abstract interfacingAndreas Baumann
2009-12-25some starting hereAndreas Baumann