Mercator, the "Altavista" robot

http://mercator.comm.nsdlib.org/

authors working for Microsoft now :-)

Some Java roboter frameworks:

heritrix
crawler4j

mainly dead or unusable:

jspider
websphinx

A C++ web robot

http://code.google.com/p/whalebot/

Javascript support

phantomjs http://code.google.com/p/phantomjs/
https://github.com/mikeal/spider
https://github.com/joshfire/node-crawler

Php

http://www.makeuseof.com/tag/build-basic-web-crawler-pull-information-website/

Streams

http://www.mr-edd.co.uk/blog/beginners_guide_streambuf

Lua embedding

http://www.ibm.com/developerworks/linux/library/l-embed-lua/

Loadable modules in C++

http://www.isotton.com/devel/docs/C++-dlopen-mini-HOWTO/C++-dlopen-mini-HOWTO.html
http://www.linuxjournal.com/article/3687?page=0,1
http://www.artima.com/cppsource/subscription_problem.html
http://kristiannielsen.livejournal.com/11783.html

Meta Programming in C++

Model C++ Design (Alexandrescu)
The Loki Template library
http://www.codeproject.com/Articles/5629/Tiny-Template-Library-implementing-typelist
http://www.drdobbs.com/cpp/extracting-function-parameter-and-return/240000586?pgno=2
http://sourceforge.net/projects/toast/: portable type_info.name()
http://gcc.gnu.org/onlinedocs/libstdc++/manual/ext_demangling.html
http://tombarta.wordpress.com/category/gcc/
?? name of module or typeid of derived class in module?