2 results found Sort:

jimsmart
grobotstxt jimsmart
7
108
apache-2.0
4
grobotstxt is a native Go port of Google's robots.txt parser and matcher library.
go robots-txt robots-exclusion-protocol
Created 2020-04-21
70 commits to main branch, last one 2 years ago
cicirello
generate-sitemap cicirello
15
75
mit
3
Generate an XML sitemap for a GitHub Pages site using GitHub Actions
xml html site robots actions lastmod noindex sitemap webpage website workflows xml-sitemap github-pages github-actions sitemap-generator robots-exclusion-protocol
Created 2020-07-31
486 commits to master branch, last one about a month ago