Norconex / crawlers

Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or filesystem to various data repositories such as search engines.

Date Created 2013-02-20 (11 years ago)

Commits 1,042 (last one 3 months ago)

Stargazers 184 (0 this week)

Watchers 33 (0 this week)

Forks 67

License apache-2.0

Ranking

RepositoryStats indexes 595,856 repositories, of these Norconex/crawlers is ranked #192,199 (68th percentile) for total stargazers, and #66,144 for total watchers. Github reports the primary language for this repository as Java, for repositories using this language it is ranked #11,177/28,578.

Norconex/crawlers is also tagged with popular topics, for these it's ranked: java (#3,479/7759), crawler (#287/573), search-engine (#208/383)

Other Information

Norconex/crawlers has 4 open pull requests on Github, 154 pull requests have been merged over the lifetime of the repository.

Github issues are enabled, there are 27 open issues and 800 closed issues.

There have been 33 releases, the latest one was published on 2023-07-09 (about a year ago) with the name v3.0.2.

Homepage URL: https://opensource.norconex.com/crawlers

All Topics

java crawler crawlers flexible web-crawler collector-fs search-engine collector-http filesystem-crawler

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

1,042 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

The primary language is Java but there's also others...

updated: 2024-12-20 @ 08:22pm, id: 8323037 / R_kgDOAH7_3Q