Stars
Forks
Watchers
Developer links
Apache Doris
Dashboards should not wait minutes for yesterday's data, so Apache Doris answers analytical SQL over fresh data with a massively parallel, fully vectorized engine that processes column batches instead of row after row. Frontends receive queries over the MySQL protocol, plan them with a cost-based optimizer, and coordinate execution, while Backends store columnar tablets and run scans, joins, and aggregations in parallel pipelines across cores. Data lands continuously through stream and batch loads, broker imports from object storage, and change capture from operational databases, and it is queryable immediately for reporting that reflects the last minutes rather than the last nightly job. Tables outside Doris join the same SQL through catalogs for Hive, Iceberg, Paimon, Hudi, and JDBC sources, with local caching and materialized views accelerating the lakehouse queries your team runs every day. Search workloads live here too: an inverted index and a SEARCH function provide full-text retrieval, vector indexes support similarity search, and AI functions call language models from SQL for extraction and summarization, so hybrid queries mix keywords, semantics, and structured filters in one statement. Workload groups, resource controls, and compute-storage separation in cloud mode keep interactive dashboards fast while heavy ETL spills safely to disk. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
Benefits
- Real-Time Answers, Standard SQL
- Frontends accept MySQL-protocol connections from existing BI tools and drivers, while Backends execute vectorized MPP pipelines, so analysts query freshly loaded data with familiar SQL and sub-second interactive responses.
- Warehouse And Lakehouse Together
- External catalogs query Hive, Iceberg, Paimon, Hudi, and JDBC sources in place, with metadata and data caching plus materialized views accelerating repeated lake queries toward local-table performance.
- Search Built Into The Warehouse
- Inverted indexes with a SEARCH function, ANN vector indexes, and SQL AI functions for extraction and summarization let one engine serve dashboards, full-text search, and semantic retrieval without extra systems.
- Ingestion Without Batch Windows
- Stream Load, Broker Load from object storage, routine loads, and MySQL change capture keep tables current continuously, while spill-to-disk keeps heavy ETL jobs stable when memory runs short.
Features
- Vectorized Pipeline Execution
- Every operator processes columnar blocks of up to 4,096 rows with SIMD-accelerated filters, joins, and aggregations, and the pipeline scheduler interleaves stages across all backend cores.
- Materialized View Acceleration
- Transparent materialized views rewrite queries to precomputed aggregates automatically, including multi-table views, so recurring dashboards speed up without application changes.
- Flexible Data Models
- Duplicate, aggregate, and unique key models cover logs, precomputed reporting, and updatable records, with partitioning and bucketing controlling layout for pruning and parallelism.
- Workload Isolation Controls
- Workload groups cap CPU, memory, and concurrency per tenant or job class, and compute-storage separation in Doris cloud mode scales query compute independently of data.
- Frontend Web Console
- The Frontend serves a browser interface on its HTTP port for cluster status, session and query inspection, and configuration, alongside the MySQL protocol port for clients.