1 result found Sort:

postmodern
spidr postmodern
107
808
mit
28
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
web ruby spider crawler scraper web-spider web-crawler web-scraper spider-links web-scraping
Created 2009-03-08
887 commits to master branch, last one 3 days ago