dbt
Free tier availableTransform data in your warehouse using SQL and software engineering best practices
📖 Overview
dbt (data build tool) is the industry standard for data transformation. It enables analysts and engineers to transform data in their warehouses using SQL with software engineering practices like version control, testing, and documentation. dbt pioneered the "T" in ELT and created the analytics engineering discipline. Originally created by Fishtown Analytics (now dbt Labs), dbt has grown from a simple tool to the foundation of the analytics engineering movement. With over 40,000 GitHub stars and 8,000+ companies using it in production, dbt has become essential infrastructure for data teams.
✨ Key Features
- ✓ SQL-based Transformations: Write transforms in SQL with Jinja templating
- ✓ Built-in Testing: Test your data with schema tests and custom assertions
- ✓ Auto-documentation: Generate documentation from your models
- ✓ Incremental Models: Efficient processing of large datasets
- ✓ Packages: Reusable macros and models from the community
- ✓ Lineage Graphs: Visualize data dependencies
💰 Pricing
👍 Pros
- + Industry standard with massive community
- + Excellent documentation and learning resources
- + dbt Cloud handles orchestration and CI/CD
- + Works with every major warehouse
- + Free and open-source core
- + Strong job market for dbt skills
👎 Cons
- − SQL-only (no Python transforms in core)
- − dbt Cloud can get expensive at scale
- − Learning curve for advanced features (macros, packages)
- − Not ideal for real-time/streaming use cases
🎯 Best For
Any team doing analytics or building data products. Essential for modern data stacks. Works for teams of 1 to 1000+. **Common use cases:** - Building dimensional models for BI (Looker, Tableau, Metabase) - Creating metrics layers and semantic models - Transforming raw ELT data from Airbyte/Fivetran into analytics-ready tables - Data quality testing and freshness monitoring - Automating documentation for data catalogs
🔗 Works With
📁 More Transformation Tools
