Week 10 - SQL Transformations with dbt

Introduction to dbt Core

dbt Setup for Azure PostgreSQL

SQL and Jinja Templating

dbt Tests

Incremental Models, Docs, and Snapshots

Building Your First Mart

Week 10 Gotchas & Pitfalls

Practice

Week 10 Assignment: Build a Daily Borough Stats Mart with dbt

Week 10 - Video Guide

Week 10 Lesson Plan (Teachers)

Incremental Models, Docs, and Snapshots

Content coming soon...

Suggested Topics

• Materializations recap: table, view, ephemeral, and incremental
• When to use incremental models: large datasets where full refresh is too slow
• Incremental model syntax: isincremental() macro and the uniquekey config
• Handling late-arriving data in incremental models
• dbt docs: generating documentation with dbt docs generate
• Exploring lineage graphs in the dbt docs site
• Adding descriptions to models and columns in schema.yml
• dbt snapshots: tracking slowly changing dimensions over time
• Clarify that dbt manages CREATE VIEW/TABLE DDL automatically, unlike the manual SQL views from Week 9
• Snapshot strategies: timestamp vs check strategy

The HackYourFuture curriculum is licensed under CC BY-NC-SA 4.0 *https://hackyourfuture.net/*

Built with ❤️ by the HackYourFuture community · Thank you, contributors

Found a mistake or have a suggestion? Let us know in the feedback form.