2 results found Sort:

apache
nutch apache
1.3k
2.8k
apache-2.0
237
Apache Nutch is an extensible and scalable web crawler
java nutch apache hadoop crawling web-crawler
Created 2009-05-21
3,445 commits to master branch, last one 3 days ago
USCDataScience
sparkler USCDataScience
142
410
apache-2.0
47
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
solr tika nutch spark search big-data web-crawler search-engine distributed-systems information-retrieval
Created 2016-05-25
726 commits to main branch, last one about a year ago