5 results found Sort:

14
326
other
6
Be nice on the web
Created 2018-07-23
84 commits to develop branch, last one about a year ago
Makes it easy to add robots.txt, sitemap and web app manifest during build to your Astro app.
Created 2022-04-26
377 commits to main branch, last one about a year ago
13
88
apache-2.0
6
A native Rust port of Google's robots.txt parser and matcher C++ library.
Created 2020-04-02
61 commits to master branch, last one 3 years ago
R 📦 for parsing and checking robots.txt files 🤖
Created 2015-12-01
315 commits to main branch, last one 6 days ago
Generator robots.txt for node js
Created 2014-11-07
173 commits to master branch, last one 4 years ago