Apache SeaTunnel screenshot thumbnail

Apache SeaTunnel

Apache SeaTunnel is a distributed integration platform that runs batch, streaming, and change-data-capture pipelines between databases, message queues, data lakes, lakehouses, and SaaS applications without hand-rolled scripts. Pipelines are declared once in a configuration file and executed on your choice of the native Zeta engine, Apache Flink, or Apache Spark, so the same job definition travels across engines without connector rewrites. Real-time CDC captures row changes from major databases with a snapshot-first handoff that never locks the source, while checkpoint-backed recovery restarts jobs from the last completed checkpoint with exactly-once semantics. When an upstream table gains a column, schema evolution propagates the change downstream automatically instead of pausing the pipeline for manual surgery. Roughly two hundred connectors cover relational databases, Kafka, object storage, search indexes, vector stores, and business apps, and the multi-table routing keeps every record on the right destination path. Engineers can dry-run configurations against sampled data before a full launch, isolate failures per table, and route bad records to dead-letter queues. Release 3.0.0 adds AI-assisted configuration generation from natural language, Python sources and transforms, and document parsing with text chunking for RAG preparation. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Deploy
Airbyte screenshot thumbnail

Airbyte

Backed by over 21,800 GitHub stars and more than 1,000 community contributors, Airbyte has become the standard open-source data movement platform, powering ELT pipelines for organizations ranging from startups to Fortune 500 enterprises. The platform provides 600+ pre-built connectors covering PostgreSQL, MySQL, MongoDB, Snowflake, BigQuery, Redshift, S3, Salesforce, HubSpot, Stripe, Shopify, Google Analytics, and hundreds of additional APIs, databases, and SaaS applications. The no-code Connector Builder lets practitioners create new source connectors in minutes by pointing at an API documentation URL, while the Python CDK enables custom connectors with full programmatic control for complex authentication flows and pagination strategies. Airbyte's AI agent capabilities include the MCP Gateway for Model Context Protocol integration, the open-source Agent SDK compatible with pydantic-ai, LangChain, OpenAI Agents, and FastMCP, and a Context Store that lets AI agents query business data across connected systems without runtime API stitching. Change Data Capture streams incremental updates from PostgreSQL, MySQL, and SQL Server using Debezium, while dbt integration handles post-load transformations within the pipeline. Self-hosted deployment uses Kubernetes via the abctl CLI tool, which bootstraps a local kind cluster with a single command, or Helm charts for production clusters with Keycloak OIDC authentication and secrets management through AWS Secrets Manager, Google Secrets Manager, or HashiCorp Vault. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. ELv2 licensed with MIT-licensed connectors.

Deploy