http://directory.fsf.org/wiki?title=Larbin&feed=atom&action=history 2013-05-20T00:24:54Z Revision history for this page on the wiki MediaWiki 1.20.2 http://directory.fsf.org/wiki?title=Larbin&diff=7448&oldid=prev 2011-04-12T15:43:34Z

<p>Created page with &quot;{{Entry |Name=Larbin |Short description=Web crawler |Full description=Larbin is an HTTP Web crawler that can fetch more than 5 million pages a day on a standard PC (pentium II 30...&quot;</p> <p><b>New page</b></p><div>{{Entry<br /> |Name=Larbin<br /> |Short description=Web crawler<br /> |Full description=Larbin is an HTTP Web crawler that can fetch more than 5 million pages a day on a standard PC (pentium II 300, 128 Mo SDRAM and a 10 Mbit ethernet card, with a good network). Larbin uses standard libraries, plus adns. The program is multithreaded but prefers using select instead of a lot of threads (for efficiency purposes). The advantage of Larbin over wget or ht://dig is that it is much faster (because it opens a lot of connexions at a time) and very easy to customize). Common uses include: a crawler for a standard search engine, a crawler for a specialized search engine (xml, images, mp3...), and to provide statistics about servers or page contents).<br /> |User level=none<br /> |Status=Live<br /> |Component programs=<br /> |Homepage URL=http://larbin.sourceforge.net/index-eng.html<br /> |VCS checkout command=<br /> |Computer languages=C++<br /> |Documentation note=User guide included<br /> |Paid support=<br /> |IRC help=<br /> |IRC general=<br /> |IRC development=<br /> |Related projects=ht:_Dig,Wget<br /> |Keywords=HTTP,Web,crawler,Larbin<br /> |Is GNU=n<br /> |Last review by=Janet Casey<br /> |Last review date=2008-06-24<br /> |Submitted by=Database conversion<br /> |Submitted date=2011-04-01<br /> |Version identifier=2.6.3<br /> |Version date=2002-07-16<br /> |Version status=stable<br /> |Version download=http://prdownloads.sourceforge.net/larbin/larbin-2.6.3.tar.gz?download<br /> |License verified date=2001-04-04<br /> |Version comment=2.6.3 stable released 2002-07-16<br /> }}<br /> {{Person<br /> |Role=Maintainer<br /> |Real name=Sebastien Ailleret<br /> |Email=sebastien@ailleret.com<br /> |Resource URL=<br /> }}<br /> {{Resource<br /> |Resource audience=Bug Tracking,Developer,Support<br /> |Resource kind=E-mail<br /> |Resource URL=mailto:sebastien@ailleret.com<br /> }}<br /> {{Software category<br /> |Interface=web<br /> |Internet-application=tool<br /> |Use=internet-application<br /> }}<br /> {{Project license<br /> |License=GPLv2<br /> |License verified by=Janet Casey<br /> |License verified date=2001-04-04<br /> }}</div>

WikiSysop