Elgorithms Software :: DownloadsDownloads for Web Developers.Grub's Distributed Web Crawling Project- April 19, 2005 Leveraging the power of distributed computing, Grub allows everyone with an internet connection to participate in the construction of a real-time snapshot of the internet. Grub runs as a screensaver that uses very little resources and bandwidth to help index the web. Grub has the potential of creating real-time internet snapshots on demand if enough people participate. If you run your own server Grub can auto-update your hosted web sites for search engine indexing.http://www.grub.org/ |