summaryrefslogtreecommitdiff
AgeCommit message (Expand)Author
2014-10-03..Andreas Baumann
2014-10-03added an experimental curl fetcherAndreas Baumann
2014-10-01reading some Lua globalsAndreas Baumann
2014-10-01cleanup and moved old cpp example crawler to examplesAndreas Baumann
2014-09-28.Andreas Baumann
2014-09-28first Lua config of crawlerAndreas Baumann
2014-09-28.Andreas Baumann
2014-09-28some lua workAndreas Baumann
2014-09-28added lua for writting/configuring the crawler (instead of a hard-coded crawl...Andreas Baumann
2014-09-28some testing and stabilizingAndreas Baumann
2014-07-25we also have to normilze with queryAndreas Baumann
2014-07-24..Andreas Baumann
2014-07-24reading complete sitemap indexes and sitemapsAndreas Baumann
2014-07-24..Andreas Baumann
2014-07-24sitemap processing (work in progress)Andreas Baumann
2014-07-23added parsing of Sitemap in robots.txtAndreas Baumann
2014-06-15added tinyxml and ticppAndreas Baumann
2014-06-15added error handling for textwolf testsAndreas Baumann
2014-06-15added "xpath"-like selection test for textwolfAndreas Baumann
2014-06-14..Andreas Baumann
2014-06-14added textwolf and a test for itAndreas Baumann
2014-05-31fixed and retested on gcc 4.9.0Andreas Baumann
2014-04-30started a robots.txt parserAndreas Baumann
2014-04-25fixed MIME detection using libmagicAndreas Baumann
2014-02-27fixed compilation issues on gcc 4.8Andreas Baumann
2013-05-12upgraded sqlite3 and fixed small documentation bugsAndreas Baumann
2012-09-10fixed logger to liblogger renaming on LinuxAndreas Baumann
2012-09-10libutil move and liblogger rename on WindowsAndreas Baumann
2012-09-07moved TypeDetect.hpp to crawler include filesAndreas Baumann
2012-09-07fixed error handling in module loaderAndreas Baumann
2012-09-07added a libutil for porting stuff and helpersAndreas Baumann
2012-09-07fixed some linker errors on FreeBSD (should also affect Linux, but there ever...Andreas Baumann
2012-09-07fixed all tests on Windows, still issues with static libcrawlAndreas Baumann
2012-09-07fixed more windows testsAndreas Baumann
2012-09-07fixed miracle of unresolved instance function in Singleton (weAndreas Baumann
2012-09-07-Andreas Baumann
2012-09-07fixed all tests and rewrote module testAndreas Baumann
2012-09-06crawler fixed on LinuxAndreas Baumann
2012-09-06works on Windows, after all the movedAndreas Baumann
2012-09-06more splitting into libcrawl, crawl binaryAndreas Baumann
2012-09-06first properly working logger on Windows (singleton dll issue)Andreas Baumann
2012-09-05started to solve the logger dll problem on WindowsAndreas Baumann
2012-09-05split away util, logger, and moduleAndreas Baumann
2012-09-05-Andreas Baumann
2012-09-05added Windows WinDbg log sinkAndreas Baumann
2012-09-05fixed syslog logger on WindowsAndreas Baumann
2012-09-05added syslog logger sinkAndreas Baumann
2012-09-04pimplified logger, hides list of sinks (internal implementation)Andreas Baumann
2012-09-02-Andreas Baumann
2012-09-02some more fixes in linkingAndreas Baumann