summaryrefslogtreecommitdiff
path: root/src/crawl
AgeCommit message (Expand)Author
2015-03-05more lua fixesAndreas Baumann
2015-02-09added a CRAWLER_UNUSED for lua specific module initialization codeAndreas Baumann
2015-01-28..Andreas Baumann
2014-10-25some desperate trials to use create on normalizer module loader to create Lua...Andreas Baumann
2014-10-23..Andreas Baumann
2014-10-17..Andreas Baumann
2014-10-17playing around with Lua debuggerAndreas Baumann
2014-10-17replaced log( "LEVEL") Lua function with 'log.level' table of C functions for...Andreas Baumann
2014-10-16..Andreas Baumann
2014-10-16added first simple Lua loggerAndreas Baumann
2014-10-16testing with two urlnormalizer modules (google and simple) in crawl.confAndreas Baumann
2014-10-16creating all module constructors now from Lua configurationAndreas Baumann
2014-10-16loading url normalizers now via Lua mechanoAndreas Baumann
2014-10-15..Andreas Baumann
2014-10-15first preliminary module searcherAndreas Baumann
2014-10-15added getstringarray to luavm layerAndreas Baumann
2014-10-14fixed linking of url/fetcher test (only links, doesn't run yet)Andreas Baumann
2014-10-14crawler works now with Lua also on WindowsAndreas Baumann
2014-10-14added initialize_libcrawler instead of silly tolua trick in the main programAndreas Baumann
2014-10-14adapted google url normlazier Lua binding for WindowsAndreas Baumann
2014-10-11playing with some more obscure lua data typesAndreas Baumann
2014-10-11reading boolean recursive module path search in crawlerAndreas Baumann
2014-10-11reading debug level and module dir from configAndreas Baumann
2014-10-10added execution function to LuaVmAndreas Baumann
2014-10-09..Andreas Baumann
2014-10-09first running lua code with URL normalization, cleanup needed..Andreas Baumann
2014-10-09backported C++ string handling from tolua++ to toluaAndreas Baumann
2014-10-09first trials with a Google normalizer called from Lua, std::string is the pro...Andreas Baumann
2014-10-08compilation fix lua (how did it ever work!)Andreas Baumann
2014-10-08some fixes on WindowsAndreas Baumann
2014-10-03fixed setting data from source in fetcher modulesAndreas Baumann
2014-10-03added an experimental curl fetcherAndreas Baumann
2014-10-01reading some Lua globalsAndreas Baumann
2014-10-01cleanup and moved old cpp example crawler to examplesAndreas Baumann
2014-09-28.Andreas Baumann
2014-09-28first Lua config of crawlerAndreas Baumann
2014-09-28some lua workAndreas Baumann
2014-09-28some testing and stabilizingAndreas Baumann
2014-07-24reading complete sitemap indexes and sitemapsAndreas Baumann
2014-07-24..Andreas Baumann
2014-07-24sitemap processing (work in progress)Andreas Baumann
2014-07-23added parsing of Sitemap in robots.txtAndreas Baumann
2014-04-30started a robots.txt parserAndreas Baumann
2012-09-10fixed logger to liblogger renaming on LinuxAndreas Baumann
2012-09-10libutil move and liblogger rename on WindowsAndreas Baumann
2012-09-06crawler fixed on LinuxAndreas Baumann
2012-09-06more splitting into libcrawl, crawl binaryAndreas Baumann