Apache DolphinScheduler screenshot thumbnail

Apache DolphinScheduler

When nightly SQL, Spark, and Python jobs outgrow cron, Apache DolphinScheduler replaces the tangle with a visual workflow orchestrator where every dependency is a line on a drag-and-drop canvas. More than 30 built-in task types cover Shell, SQL, Python, HTTP, Spark, Flink, Kubernetes, SeaTunnel, and Jupyter, while logic nodes add sub-workflows, conditions, switches, and dependencies across projects. Workflows can also be written as code through a Python SDK, YAML, or the Open API and run on timezone-aware cron schedules. Backfill reruns a workflow across a date range or a hand-picked list of dates, in serial or parallel, and any instance can be modified, rolled back, and rerun without touching the saved template. Kill, pause, and resume running tasks, and choose whether a failure ends the run or lets parallel branches continue. Alert groups route results to Email, Slack, Telegram, PagerDuty, Feishu, DingTalk, webhooks, or custom scripts. Tenants, worker groups, and environments isolate teams on shared infrastructure, with project and data source permissions. A Resource Center stores scripts and task files locally or on HDFS, MinIO, and cloud object storage, and the monitor page shows master, worker, and database health at a glance. Standalone, Cluster, Docker, and Kubernetes deployments scale from one node to many masters and workers that can join or leave a running cluster. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

Deploy