Categories
Self-Hosted API Web Scraping Business Intelligence Data Extraction Lead Generation Google MapsStars
Forks
Watchers
Developer links
Google Maps Scraper
The leading open-source tool for extracting business leads from Google Maps at production scale. The Go-based engine processes approximately 120 places per minute with optimized concurrency, extracting 33+ data points per listing including business name, address, phone number, website URL, rating, review count, latitude and longitude, opening hours, price level, and optionally crawling business websites for email addresses. Three interfaces serve different workflows: the CLI accepts query files for cron jobs and CI/CD pipelines with output to CSV, JSON, PostgreSQL, S3, or LeadsDB; the Web UI provides a browser-based dashboard with real-time job monitoring, a map view of scraped places, and interactive query submission; and the REST API at /api/v1 enables programmatic integration with full Swagger documentation at /api/docs. Built-in proxy rotation supports SOCKS5, HTTP, and HTTPS with authentication for large-scale runs, while the architecture scales from a laptop to Kubernetes clusters with queue-based worker distribution. The SaaS edition adds multi-user access with API key management, admin UI with 2FA, job queue orchestration, and one-command cloud deployment via an interactive wizard. An AI Agent Skill enables coding agents to run scrapes programmatically. Deploy via Docker or build from source requiring Go 1.26.5+. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
Benefits
- 120 Places Per Minute Extraction
- Optimized Go concurrency engine processes approximately 120 business listings per minute with configurable parallelism, proxy rotation, and automatic retry on rate limits.
- 33+ Business Data Points
- Extracts business name, address, phone, website, rating, reviews, coordinates, opening hours, price level, and optionally crawls business websites for email addresses.
- CLI, Web UI, and REST API
- Three interfaces for different workflows — CLI for scripts and automation, browser-based Web UI for interactive use, and REST API with Swagger docs for system integration.
- Single Machine to Kubernetes
- Scales horizontally from a laptop to multi-worker Kubernetes clusters with queue-based job distribution, Docker deployment, and optional serverless execution on AWS Lambda.
Features
- Web UI Dashboard
- Browser-based interface for interactive query submission, real-time job monitoring, map view of scraped places, and CSV/JSON result download.
- Proxy Rotation Engine
- Built-in SOCKS5, HTTP, and HTTPS proxy support with authentication and automatic rotation to handle large-scale scraping without IP blocking.
- Flexible Output Plugins
- Writes results to CSV, JSON, PostgreSQL, Amazon S3, LeadsDB, or custom output plugins with configurable field selection and formatting.
- SaaS Multi-User Platform
- Optional self-hosted platform adding API key management, admin UI with 2FA, worker provisioning, and one-command cloud deployment.
- AI Agent Skill Integration
- Provides a SKILL.md file enabling AI coding agents to run scrapes programmatically, submit queries, and retrieve results through natural language instructions.