Introduction to Orchestration

Airflow Fundamentals

Scheduling and Triggers

Sequential Pipeline Steps

Parameterized Runs and Backfills

Monitoring and Debugging

Practice

Assignment

Gotchas & Pitfalls

Week 12 Lesson Plan (Teachers)

Content

Practice

Content coming soon...

Suggested Activities

• Writing a simple Airflow DAG with two sequential tasks (ingest then transform)
• Configuring a cron schedule and observing runs in the Airflow UI
• Parameterizing a DAG to accept a date argument and backfilling a date range
• Debugging a failing DAG by reading task logs and fixing the issue
• Setting up a task with retry logic and observing retry behavior
• Connecting an ingestion task to a dbt run task using task dependencies
• Deploy your DAG to Astronomer and verify it appears in the Astronomer UI

The HackYourFuture curriculum is licensed under CC BY-NC-SA 4.0

*https://hackyourfuture.net/*

Found a mistake or have a suggestion? Let us know in the feedback form.