1 result found Sort:

ArchiveTeam
wget-lua ArchiveTeam
14
88
gpl-3.0
20
Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.
ftp lua warc wget zstd crawl spider crawler scraper crawlers crawling scraping wget-lua archiving downloader archiveteam webarchiving
Created 2019-09-07
4,428 commits to v1.21.3-at branch, last one 6 months ago