Conductor
Originally built at Netflix to orchestrate microservices powering 230 million subscribers and now trusted in production at Tesla, LinkedIn, and J.P. Morgan, Conductor is the most battle-tested open-source workflow engine available — with 32,000 GitHub stars and horizontal scalability to billions of executions. The architecture cleanly separates orchestration from business logic: workflows are defined in declarative JSON while workers execute tasks in any of seven supported languages (Java, Python, Go, JavaScript, C#, Ruby, Rust) with zero framework constraints. Durable execution persists every state transition, enabling automatic retries, configurable timeouts, crash recovery, and instant replay from any failure point without re-executing completed tasks. Native AI agent orchestration supports 14+ LLM providers (Anthropic, OpenAI, Google Gemini, AWS Bedrock, Mistral, Cohere, HuggingFace, Ollama), MCP tool calling, function calling, human-in-the-loop approval gates, and vector database integration (Pinecone, pgvector, MongoDB Atlas) for RAG pipelines. Deploy with your choice of five persistence backends (PostgreSQL, Redis, MySQL, Cassandra, SQLite), six message brokers, and Elasticsearch or OpenSearch for workflow indexing — all configurable via Docker Compose files included in the repository. The built-in web UI provides workflow visualization, execution monitoring, task queue inspection, and manual intervention controls. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
Kestra
With over 27,000 GitHub stars and an ecosystem of 1,900+ plugins covering every major cloud provider, database, and SaaS platform, Kestra is the orchestration engine that brings Infrastructure as Code principles to workflow automation — defining complex multi-step pipelines in readable YAML that execute across any language, runtime, or infrastructure boundary. The built-in VS Code-style editor provides syntax highlighting, auto-completion, real-time validation, and an AI Copilot that generates workflow YAML from natural language descriptions. Tasks execute in Python, Node.js, Go, R, Shell, SQL, or any Docker container, with event-driven triggers listening for file arrivals on SFTP and cloud storage, messages from Kafka, Redis, Pulsar, AMQP, MQTT, NATS, AWS SQS, Google Pub/Sub, and Azure Event Hubs in real time. The topology view visualizes workflow DAGs with execution state, duration, and output artifacts for each task node. Namespaces organize workflows into isolated environments with configurable secrets, while subflows enable modular composition with inputs, outputs, and conditional branching. Retry policies, timeouts, error handlers, and automatic backfills for missed schedules ensure reliability across production workloads. Git integration pushes workflows directly to branches from the UI with CI/CD pipeline support for automated deployment. The REST API enables programmatic workflow management, execution triggering, and resource provisioning. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.
Dagu
With over 3,700 GitHub stars and growing adoption among teams tired of managing complex orchestration platforms, Dagu delivers a complete workflow engine as a single Go binary that requires no external database, message broker, or framework installation. Define directed acyclic graphs in declarative YAML — specifying dependencies, schedules, retries, timeouts, approvals, and notifications — while keeping existing shell scripts, containers, and tools completely unchanged. The built-in Web UI provides live pipeline visualization, per-step log streaming, run history browsing, artifact previewing, manual retry controls, and workflow YAML editing without SSHing into servers. Execute steps as shell commands, Docker containers, Kubernetes Jobs, SSH remote commands, SQL queries, or HTTP requests, with conditional branching and parallel execution handled natively. The integrated Model Context Protocol server exposes dagu_read, dagu_change, and dagu_execute tools, enabling AI agents like Claude, Codex, and Cursor to inspect workflow state, preview YAML modifications, and control runs through authenticated endpoints. The harness.run executor lets external coding-agent CLIs operate inside DAG steps with full scheduling and approval gate support. Scale beyond a single machine with the distributed worker mode, which dispatches tasks to remote nodes via gRPC with automatic label-based routing and worker selection. Deploy with Docker, the official Helm chart for Kubernetes, or a simple binary download requiring only a Linux, macOS, or Windows host. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. GPLv3 licensed.