samclarke / robots-parser

NodeJS robots.txt parser with support for wildcard (*) matching.

Date Created 2014-09-27 (10 years ago)

Commits 90 (last one 10 days ago)

Stargazers 150 (0 this week)

Watchers 6 (0 this week)

Forks 19

License mit

Ranking

RepositoryStats indexes 579,555 repositories, of these samclarke/robots-parser is ranked #217,987 (62nd percentile) for total stargazers, and #296,754 for total watchers. Github reports the primary language for this repository as JavaScript, for repositories using this language it is ranked #26,824/64,929.

samclarke/robots-parser is also tagged with popular topics, for these it's ranked: javascript (#7,097/13697), nodejs (#3,142/6838)

Other Information

samclarke/robots-parser has Github issues enabled, there is 1 open issue and 17 closed issues.

There have been 3 releases, the latest one was published on 2023-02-21 (about a year ago) with the name Version 3.0.1.

All Topics

nodejs rfc-9309 javascript robots-txt user-agent robots-parser robots-exclusion-standard

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

19 commits on the default branch (master) since jan '22

Yearly Commits

Commits to the default branch (master) per year

Issue History

Languages

The only known language in this repository is JavaScript

updated: 2024-10-30 @ 12:59am, id: 24531228 / R_kgDOAXZRHA