Deploy Now

Stars

5,263

Forks

530

Watchers

44

Developer links

Fluvio

Fluvio is a distributed data streaming platform that moves records between your applications on partitioned topics and transforms them in flight with WebAssembly modules before they land anywhere. Producers publish to topics and consumers read at their own pace, with client libraries for Rust, Python, and JavaScript plus a full command line for producing and consuming interactively. SmartModules are reusable WebAssembly functions that filter, reshape, and enrich records inside the stream, so cleanup and routing logic runs once at the platform layer instead of inside every consumer. Stateful DataFlow builds continuous processing on top of the same streams, keeping state across records to aggregate, join, and react as data arrives. Inbound connectors collect from HTTP endpoints, webhooks, MQTT brokers, and Kafka clusters, and outbound connectors deliver to HTTP, SQL databases, and Kafka, with a development kit for building connectors to your own systems. A local cluster starts with one command for development, and the same platform deploys on Kubernetes for production streaming at the edge or in the cloud. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Fluvio
Fluvio

Benefits

  • Transform Data In Flight
  • SmartModules are WebAssembly functions that filter, reshape, and enrich records inside the stream, so transformation logic runs once at the platform layer instead of inside every consumer application.
  • Connectors For Every System
  • Inbound connectors collect from HTTP endpoints, webhooks, MQTT brokers, and Kafka, and outbound connectors deliver to HTTP, SQL databases, and Kafka, with a kit for custom connectors.
  • Stateful Stream Processing Built In
  • Stateful DataFlow keeps state across records on the same streams, aggregating, joining, and reacting continuously instead of forcing you to bolt on a separate processing engine.
  • Edge To Kubernetes Deployment
  • Start a local cluster with one command, then deploy the same Rust platform on Kubernetes, running anywhere from small edge nodes to production cloud clusters.

Features

  • Partitioned Topics And Consumers
  • Producers publish records to partitioned topics and consumers read at their own pace with tracked offsets, from the CLI or Rust, Python, and JavaScript clients.
  • WebAssembly SmartModules
  • Reusable transformation functions run as WebAssembly inside the streaming path, filtering, mapping, and enriching records before they reach consumers or storage.
  • Stateful DataFlow Processing
  • Stateful DataFlow defines continuous dataflows over Fluvio streams that keep per-key state, aggregate over time, and join streams as records arrive.
  • Inbound And Outbound Connectors
  • Native connectors ingest from HTTP, webhooks, MQTT, and Kafka, and sink to HTTP, SQL, and Kafka, with experimental DuckDB, Redis, and S3 sinks.
  • One-Command Local Cluster
  • The Fluvio Version Manager installs the CLI and a local cluster starts with fluvio cluster start, giving you topics and consumers in about two minutes.

Apps Similar to Fluvio