samclarke / robots-parser

NodeJS robots.txt parser with support for wildcard (*) matching.

Date Created 2014-09-27 (10 years ago)

Commits 90 (last one about a month ago)

Stargazers 150 (0 this week)

Watchers 6 (0 this week)

Forks 19

License mit

Ranking

RepositoryStats indexes 589,134 repositories, of these samclarke/robots-parser is ranked #220,557 (63rd percentile) for total stargazers, and #298,964 for total watchers. Github reports the primary language for this repository as JavaScript, for repositories using this language it is ranked #26,977/65,568.

samclarke/robots-parser is also tagged with popular topics, for these it's ranked: javascript (#7,150/13824), nodejs (#3,172/6894)

Other Information

samclarke/robots-parser has Github issues enabled, there is 1 open issue and 17 closed issues.

There have been 3 releases, the latest one was published on 2023-02-21 (about a year ago) with the name Version 3.0.1.

All Topics

nodejs rfc-9309 javascript robots-txt user-agent robots-parser robots-exclusion-standard

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

19 commits on the default branch (master) since jan '22

Yearly Commits

Commits to the default branch (master) per year

Issue History

Languages

The only known language in this repository is JavaScript

updated: 2024-10-30 @ 12:59am, id: 24531228 / R_kgDOAXZRHA