Search Results - RepositoryStats

1.2k

22.8k

mit

175

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

Created 2017-05-05

4,606 commits to dev branch, last one 11 hours ago

waybackpy akamhy

33

489

mit

11

Wayback Machine API interface & a command-line tool

osint cdx-api savepagenow webarchiving web-archiving archive-webpage wayback-machine archive-webpages internet-archive internet-archiving wayback-machine-api wayback-machine-python

Created 2020-05-02

497 commits to master branch, last one 2 years ago

wikipedia-mirror pirate

32

367

mit

8

🌐 Guide and tools to run a full offline mirror of Wikipedia.org with three different approaches: Nginx caching proxy, Kiwix + ZIM dump, and MediaWiki/XOWA + XML dump

zim html wiki xowa kiwix nginx docker openzim mwdumper archiving mediawiki wikipedia datascience docker-compose wikipedia-dump wikipedia-mirror internet-archiving kiwix-offline-wikipedia

Created 2019-09-08

37 commits to master branch, last one 3 years ago

good-karma-kit ArchiveBox

9

324

mit

7

😇 A Docker Compose bundle to run on servers with spare CPU, RAM, disk, and bandwidth to help the world. Includes Tor, ArchiveWarrior, BOINC, and more...

i2p sia tor ipfs pywb boinc kiwix storj docker zimfarm archivebox good-karma foldingathome archivewarrior docker-compose internet-archiving distributed-storage distributed-computing

Created 2021-04-12

64 commits to main branch, last one 7 months ago

archivebox-browser-extension ArchiveBox

25

264

mit

9

Official ArchiveBox browser extension: automatically/manually preserve your browsing history using ArchiveBox.

svelte digipres archiving archivebox web-archiving chrome-extension browser-extension firefox-extension internet-archiving digital-preservation

Created 2021-06-30

54 commits to master branch, last one 29 days ago

electron-archivebox ArchiveBox

15

179

gpl-3.0

8

Desktop Electron app for ArchiveBox internet archiver. (ALPHA: not ready for general use)

gui linux macos docker desktop windows digipres electron archivebox web-archiving desktop-electron internet-archiving

Created 2020-11-23

58 commits to main branch, last one about a year ago

vandal vegetableman

6

156

agpl-3.0

6

Navigator for Web Archive

webarchive firefox-addon wayback-machine chrome-extension internet-archiving

Created 2019-05-27

253 commits to master branch, last one 3 years ago

forum-dl mikwielgus

2

76

mit

4

Scrape posts, threads from forums, news aggregators, mail archives, export to JSONL, mailbox, WARC

warc forum phpbb python scraper discourse data-fetching simplemachines internet-archiving

Created 2023-02-05

420 commits to develop branch, last one about a year ago

abx-dl ArchiveBox

2

52

mit

4

⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless Chrome to get HTML, JS, CSS, images/video/audio/s...

cli curl wget chrome yt-dlp cli-tool crawling headless scraping puppeteer archivebox downloader gallery-dl playwright youtube-dl ai-scraping http-client internet-archiving

Created 2024-10-21

92 commits to main branch, last one 11 hours ago

internet-archiving-talk pirate

5

51

unknown

5

🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.

warc wget talks ethics slideshow archivebox censorship web-archiving internet-archiving

Created 2020-02-08

17 commits to master branch, last one 4 months ago

docker-archivebox ArchiveBox

12

50

gpl-3.0

3

Home of the official docker image for ArchiveBox

oci image docker podman digipres container archivebox kubernetes docker-image docker-compose internet-archiving

Created 2020-11-26

34 commits to main branch, last one 8 days ago

hoardy-web Own-Data-Privateer

2

46

gpl-3.0

2

Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing, mirroring, and/or indexing. Your own personal private Wayback...

cli archive backups archiver internet snapshot archiving auto-save self-hosted web-archive web-browsing web-archiving offline-reading wayback-machine website-archive browser-extension internet-archiving

Created 2023-08-20

1,028 commits to master branch, last one 4 days ago