2 results found Sort:

apache
nutch apache
1.2k
2.9k
apache-2.0
236
Apache Nutch is an extensible and scalable web crawler
java nutch apache hadoop crawling web-crawler
Created 2009-05-21
3,483 commits to master branch, last one 8 days ago
USCDataScience
sparkler USCDataScience
143
410
apache-2.0
45
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
solr tika nutch spark search big-data web-crawler search-engine distributed-systems information-retrieval
Created 2016-05-25
726 commits to main branch, last one about a year ago