summaryrefslogtreecommitdiff
path: root/src/crawl/crawl.cpp
AgeCommit message (Expand)Author
2015-02-09added a CRAWLER_UNUSED for lua specific module initialization codeAndreas Baumann
2015-01-28..Andreas Baumann
2014-10-25some desperate trials to use create on normalizer module loader to create Lua...Andreas Baumann
2014-10-17..Andreas Baumann
2014-10-17playing around with Lua debuggerAndreas Baumann
2014-10-17replaced log( "LEVEL") Lua function with 'log.level' table of C functions for...Andreas Baumann
2014-10-16..Andreas Baumann
2014-10-16added first simple Lua loggerAndreas Baumann
2014-10-16creating all module constructors now from Lua configurationAndreas Baumann
2014-10-16loading url normalizers now via Lua mechanoAndreas Baumann
2014-10-15..Andreas Baumann
2014-10-15first preliminary module searcherAndreas Baumann
2014-10-15added getstringarray to luavm layerAndreas Baumann
2014-10-14added initialize_libcrawler instead of silly tolua trick in the main programAndreas Baumann
2014-10-11playing with some more obscure lua data typesAndreas Baumann
2014-10-11reading boolean recursive module path search in crawlerAndreas Baumann
2014-10-11reading debug level and module dir from configAndreas Baumann
2014-10-10added execution function to LuaVmAndreas Baumann
2014-10-09first running lua code with URL normalization, cleanup needed..Andreas Baumann
2014-10-09first trials with a Google normalizer called from Lua, std::string is the pro...Andreas Baumann
2014-10-08compilation fix lua (how did it ever work!)Andreas Baumann
2014-10-03fixed setting data from source in fetcher modulesAndreas Baumann
2014-10-03added an experimental curl fetcherAndreas Baumann
2014-10-01reading some Lua globalsAndreas Baumann
2014-09-28first Lua config of crawlerAndreas Baumann
2014-09-28some lua workAndreas Baumann
2014-09-28some testing and stabilizingAndreas Baumann
2014-07-24reading complete sitemap indexes and sitemapsAndreas Baumann
2014-07-24..Andreas Baumann
2014-07-24sitemap processing (work in progress)Andreas Baumann
2014-04-30started a robots.txt parserAndreas Baumann
2012-09-06more splitting into libcrawl, crawl binaryAndreas Baumann
generated by cgit v1.2.3-54-g00ecf (git 2.44.0) at 2024-04-28 19:16:39 +0000