From Free Software Directory
Jump to: navigation, search


Web crawler

'Webbase' is an Internet crawler. It crawls the Web to get documents, stores them locally, and builds a full text MySQL database with them. It can also visit sites regularly to make sure the document is still there and update it if it changes. The database uses the local copies of documents to build a searchable index.


User guide available in HTML format from http://www.nongnu.org/webbase/doc.en.html


Download version 5.17 (stable)
released on 10 September 2001

VCS Checkout



Related Projects


LicenseVerified byVerified onNotes
License:GPLv2orlaterJanet Casey27 October 2000

Leaders and contributors

Loic Dachary Maintainer
Igor Genibel Contributor

Resources and communication

AudienceResource typeURI
DeveloperVCS Repository Webviewhttp://savannah.gnu.org/cvs?group_id=408
Bug Tracking,Developer,SupportE-mailmailto:loic@gnu.org

Software prerequisites

This entry (in part or in whole) was last reviewed on 6 January 2017.


Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the page “GNU Free Documentation License”.

The copyright and license notices on this page only apply to the text on this page. Any software or copyright-licenses or other similar notices described in this text has its own copyright notice and license, which can usually be found in the distribution or license text itself.