1 2 3 4 5 6 7 8 9 10 11 12
Mercator, the "Altavista" robot http://mercator.comm.nsdlib.org/ authors working for Microsoft now :-) heritrix mainly dead or unusable: jspider websphinx