Estuary

Real-time data integration platform combining CDC, streaming ETL, and batch in a unified system with millisecond latency.

Visit Website → GitHub

Key Features

✓ Millisecond latency: True streaming capture
✓ Log-based CDC: Minimal source impact
✓ Full and incremental: Initial load + ongoing
✓ Schema evolution: Automatic handling
✓ Batch + streaming: Same pipeline definition
✓ Historical backfill: Seamless initial loads
✓ Exactly-once: End-to-end guarantees
✓ Idempotent writes: Safe re-processing
✓ Declarative: YAML pipeline definitions
✓ TypeScript transforms: Custom logic
✓ Reactive dataflows: Event-driven processing
✓ Local development: Test before deploy
✓ Warehouses: Snowflake, BigQuery, Redshift, Databricks
✓ Databases: PostgreSQL, MySQL, MongoDB
✓ Lakes: S3, GCS (Parquet, Delta, Iceberg)
✓ Streaming: Kafka, Kinesis