5 results found Sort:
- Filter by Primary Language:
- R (2)
- JavaScript (1)
- Rust (1)
- TypeScript (1)
- +
Be nice on the web
Created
2018-07-23
84 commits to develop branch, last one about a year ago
Makes it easy to add robots.txt, sitemap and web app manifest during build to your Astro app.
Created
2022-04-26
377 commits to main branch, last one about a year ago
A native Rust port of Google's robots.txt parser and matcher C++ library.
Created
2020-04-02
61 commits to master branch, last one 3 years ago
R 📦 for parsing and checking robots.txt files 🤖
Created
2015-12-01
315 commits to main branch, last one 6 days ago
Generator robots.txt for node js
Created
2014-11-07
173 commits to master branch, last one 4 years ago