Norconex / crawlers

Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or filesystem to various data repositories such as search engines.

Date Created 2013-02-20 (12 years ago)
Commits 1,257 (last one 12 days ago)
Stargazers 185 (0 this week)
Watchers 33 (0 this week)
Forks 68
License apache-2.0
Ranking

RepositoryStats indexes 616,861 repositories, of these Norconex/crawlers is ranked #195,687 (68th percentile) for total stargazers, and #66,569 for total watchers. Github reports the primary language for this repository as Java, for repositories using this language it is ranked #11,220/29,100.

Norconex/crawlers is also tagged with popular topics, for these it's ranked: java (#3,496/7890),  crawler (#289/580),  search-engine (#211/389)

Other Information

Norconex/crawlers has 1 open pull request on Github, 175 pull requests have been merged over the lifetime of the repository.

Github issues are enabled, there are 30 open issues and 801 closed issues.

There have been 33 releases, the latest one was published on 2023-07-09 (about a year ago) with the name v3.0.2.

Homepage URL: https://opensource.norconex.com/crawlers

Star History

Github stargazers over time

200200180180160160140140120120100100808060604040202000201420142015201520162016201720172018201820192019202020202021202120222022202320232024202420252025

Watcher History

Github watchers over time, collection started in '23

363635.535.5353534.534.5343433.533.5333332.532.5323220232023Feb '23Feb '23Apr '23Apr '23Jun '23Jun '23Aug '23Aug '23Oct '23Oct '23Dec '23Dec '23Feb '24Feb '24Apr '24Apr '24Jun '24Jun '24Aug '24Aug '24Oct '24Oct '24Dec '24Dec '24Feb '25Feb '25

Recent Commit History

1,257 commits on the default branch (main) since jan '22

1.4k1.4k1.2k1.2k1k1k80080060060040040020020000Jul '22Jul '2220232023Jul '23Jul '2320242024Jul '24Jul '2420252025

Yearly Commits

Commits to the default branch (main) per year

800800700700600600500500400400300300200200100100002013201320142014201520152016201620172017201820182019201920202020202120212022202220242024

Issue History

Total Issues
Open Issues
Closed Issues
90090080080070070060060050050040040030030020020010010000201420142015201520162016201720172018201820192019202020202021202120222022202320232024202420252025

Languages

The primary language is Java but there's also others...

JavaJavaHTMLHTMLBatchfileBatchfileShellShell

updated: 2025-02-18 @ 09:56pm, id: 8323037 / R_kgDOAH7_3Q