Categories
Self-Hosted Bookmarks Web Archiving Content Backup Data Hoarding Digital Preservation Research ToolsDeveloper links
ArchiveBox
Backed by 27,700+ GitHub stars and actively developed with the v0.9.x architectural overhaul introducing an event-driven plugin ecosystem, ArchiveBox delivers the open-source self-hosted web archiving platform that preserves websites, bookmarks, social posts, media, source code, and research material in durable formats before link rot, platform shutdowns, and censorship erase them permanently. Feed it URLs one at a time or schedule automated imports from browser history, RSS feeds, Pocket, Pinboard, Instapaper, Wallabag, Shaarli, JSON, CSV, HTML bookmark exports, and browser extension captures. Each snapshot stores redundant copies as original HTML, rendered single-file HTML via SingleFile, full-page PDF, screenshot PNG, WARC archive, article text via Readability, favicons, HTTP headers, media files via yt-dlp, git repository clones, and structured metadata in SQLite. The Docker Compose deployment bundles Chrome, wget, curl, yt-dlp, SingleFile, and Readability parsers with automatic dependency management and isolation. Interact through the self-hosted web UI with search, tagging, and admin controls, the comprehensive CLI for batch operations, the REST API for programmatic access, or the Python API for custom integrations. The new abx-plugins system enables community extractors with per-plugin configuration, while the append-only-log architecture provides resumable crawls and audit trails. S3, B2, and Google Cloud storage backends sync archives to remote storage via rclone. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
Benefits
- Redundant Multi-Format Preservation
- Every URL saved simultaneously as HTML, PDF, PNG screenshot, WARC, article text, media, and metadata ensuring content survives even if individual formats become inaccessible over time.
- Import From Any Source
- Schedule automated imports from browser history, RSS feeds, Pocket, Pinboard, Instapaper, Wallabag, Shaarli, JSON, CSV, HTML bookmark files, and browser extension captures with deduplication.
- Docker Bundled Dependencies
- Docker Compose deployment includes Chrome, wget, curl, yt-dlp, SingleFile, Readability, and article parsers pre-configured with automatic updates and process isolation for reliable archiving.
- Multiple Access Interfaces
- Interact through the web UI with search and tagging, comprehensive CLI for batch operations, REST API for programmatic access, Python API for custom integrations, or direct filesystem browsing.
Features
- Multi-Format Snapshot Engine
- Capture original HTML, SingleFile rendered pages, PDF, PNG screenshots, WARC archives, article text, favicons, headers, media via yt-dlp, and git clones for each URL.
- Scheduled Import Automation
- Automated recurring imports from RSS feeds, browser history exports, Pocket, Pinboard, Instapaper, Wallabag, and any URL list with configurable intervals and deduplication.
- Plugin Ecosystem (abx-plugins)
- Community-driven extractor plugins with per-plugin configuration, dependencies, hooks, and independent operation through the standalone abx-dl CLI or within ArchiveBox.
- Full-Text Search and Tagging
- Web UI provides full-text search across archived content, tag-based organization, admin controls, and browsable snapshot history with live progress monitoring.
- Remote Storage Sync
- Sync archived data to S3, Backblaze B2, Google Cloud Storage, or any rclone-compatible backend for offsite backup and distributed access to preserved content.