2 results found Sort:

jimsmart
grobotstxt jimsmart
6
100
apache-2.0
4
grobotstxt is a native Go port of Google's robots.txt parser and matcher library.
go robots-txt robots-exclusion-protocol
Created 2020-04-21
70 commits to main branch, last one 2 years ago
cicirello
generate-sitemap cicirello
14
66
mit
3
Generate an XML sitemap for a GitHub Pages site using GitHub Actions
xml html site robots actions lastmod noindex sitemap webpage website workflows xml-sitemap github-pages github-actions sitemap-generator robots-exclusion-protocol
Created 2020-07-31
484 commits to master branch, last one 17 days ago