summaryrefslogtreecommitdiff
path: root/src/crawl
AgeCommit message (Expand)Author
2014-10-14crawler works now with Lua also on WindowsAndreas Baumann
2014-10-14added initialize_libcrawler instead of silly tolua trick in the main programAndreas Baumann
2014-10-14adapted google url normlazier Lua binding for WindowsAndreas Baumann
2014-10-11playing with some more obscure lua data typesAndreas Baumann
2014-10-11reading boolean recursive module path search in crawlerAndreas Baumann
2014-10-11reading debug level and module dir from configAndreas Baumann
2014-10-10added execution function to LuaVmAndreas Baumann
2014-10-09..Andreas Baumann
2014-10-09first running lua code with URL normalization, cleanup needed..Andreas Baumann
2014-10-09backported C++ string handling from tolua++ to toluaAndreas Baumann
2014-10-09first trials with a Google normalizer called from Lua, std::string is the pro...Andreas Baumann
2014-10-08compilation fix lua (how did it ever work!)Andreas Baumann
2014-10-08some fixes on WindowsAndreas Baumann
2014-10-03fixed setting data from source in fetcher modulesAndreas Baumann
2014-10-03added an experimental curl fetcherAndreas Baumann
2014-10-01reading some Lua globalsAndreas Baumann
2014-10-01cleanup and moved old cpp example crawler to examplesAndreas Baumann
2014-09-28.Andreas Baumann
2014-09-28first Lua config of crawlerAndreas Baumann
2014-09-28some lua workAndreas Baumann
2014-09-28some testing and stabilizingAndreas Baumann
2014-07-24reading complete sitemap indexes and sitemapsAndreas Baumann
2014-07-24..Andreas Baumann
2014-07-24sitemap processing (work in progress)Andreas Baumann
2014-07-23added parsing of Sitemap in robots.txtAndreas Baumann
2014-04-30started a robots.txt parserAndreas Baumann
2012-09-10fixed logger to liblogger renaming on LinuxAndreas Baumann
2012-09-10libutil move and liblogger rename on WindowsAndreas Baumann
2012-09-06crawler fixed on LinuxAndreas Baumann
2012-09-06more splitting into libcrawl, crawl binaryAndreas Baumann
generated by cgit v1.2.3-54-g00ecf (git 2.45.1) at 2024-05-20 16:53:42 +0000