Logo
Deploy Now

Categories

Developer Tools AI Automation API LLM Web Scraping Data Extraction

Stars

2,213

Forks

131

Watchers

5

Developer links

Last Updated: 08-22-2026 02:54 PM (UTC)

Anakin

Backed by Y Combinator and powering scraping infrastructure across 195 countries, Anakin delivers a production-grade web scraping API purpose-built for AI agents and RAG pipelines that need clean, structured data from sites that actively block conventional scrapers. The single Go binary server handles JavaScript-heavy SPAs through its Camoufox anti-detect browser service with automatic fingerprint rotation, while the HTTP-first handler chain tries lightweight extraction before escalating to full browser rendering — keeping response times under 2 seconds for static pages. The built-in React 19 dashboard provides visual scraping with live results, job tracking with status filters, domain configuration management with handler chain CRUD, and proxy performance monitoring via Thompson Sampling scoring. Structured JSON extraction leverages Gemini AI to transform raw HTML into typed schemas without manual selector maintenance. SDKs span Python, TypeScript, Go, .NET, Java, and Ruby, while the MCP server exposes all 21 tools directly to Claude, Cursor, Windsurf, and any Model Context Protocol-compatible agent. The hosted platform extends the open-source engine with AI web search returning full page content with citations, multi-source agentic research across 20+ sources per query, Wire pre-built actions covering 944 websites with 5,201 structured endpoints, persistent browser sessions for authenticated scraping, and website change monitoring with scheduled alerts. Deploy via Docker Compose with three containers or run the binary directly with optional PostgreSQL persistence. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Anakin
Anakin
Anakin

Benefits

  • Zero-Dependency Go Binary Deployment
  • Single Go binary starts the scraping server with zero external dependencies, optionally adding PostgreSQL for persistence and Camoufox browser service for JavaScript-heavy sites via Docker Compose.
  • AI-Powered Structured Extraction
  • Gemini AI transforms raw HTML into typed JSON schemas without manual CSS selectors, eliminating maintenance when target websites change their DOM structure or class names.
  • Anti-Detect Browser Intelligence
  • Camoufox stealth browser with automatic fingerprint rotation and Thompson Sampling proxy scoring bypasses anti-bot systems while optimizing for speed across residential and datacenter pools.
  • Universal Agent Integration via MCP
  • Model Context Protocol server exposes 21 tools to Claude, Cursor, Windsurf, and any MCP-compatible AI agent for native scraping, search, crawling, and Wire actions without custom glue code.

Features

  • React Web Dashboard
  • Built-in Vite + Tailwind UI for visual scraping, job tracking with status filters, domain config management, and proxy performance monitoring via Thompson Sampling scores.
  • Handler Chain Architecture
  • Workers execute HTTP, browser, and API fallback handlers sequentially per domain, automatically escalating from lightweight extraction to full Camoufox rendering.
  • Batch and Async Scraping
  • Submit up to 10 URLs per batch request with async job polling, or use synchronous mode that blocks up to 30 seconds for immediate single-page results.
  • Multi-SDK Support
  • Official SDKs for Python, TypeScript, Go, .NET, Java, and Ruby provide typed clients with async support, plus a CLI for human terminal use and scripting.
  • Site Crawling and Mapping
  • Recursive crawl API discovers up to 5,000 URLs per domain via sitemap parsing, robots.txt discovery, and link following with glob include/exclude filters.