Introduction to Orchestration

Airflow Fundamentals

Scheduling and Triggers

Sequential Pipeline Steps

Parameterized Runs and Backfills

Monitoring and Debugging

Practice

Assignment

Gotchas & Pitfalls

Week 12 Lesson Plan (Teachers)

Week 12 Lesson Plan (Teachers)

Content coming soon...

Suggested Topics to Cover

• Demo: live walkthrough of the Airflow UI showing DAG runs, task logs, and graph view
• Demo: writing and deploying a simple DAG with sequential tasks
• Workshop: students write their own two-step DAG (ingest then transform)
• Pair exercise: debug a broken DAG by reading task logs and fixing the issue
• Live demo: running a backfill for a date range and observing the results
• Discussion: when to use orchestration vs simple cron jobs
• Code review: examining student DAGs for dependency design and parameterization
• Assessment rubric: correct scheduling, sequential dependencies, parameterized dates, error handling
• Live demo: deploy a DAG to Astronomer using astro deploy and view it in the Astronomer UI
• Time allocation guidance (Astronomer setup and first deploy can take 20-30 minutes)
• Pre-class setup: students must have the Astronomer CLI installed and access to the HYF-provided Astronomer workspace
• Primary platform: HYF-provided Astronomer workspace for all students
• Assessment rubric with concrete scoring criteria

The HackYourFuture curriculum is licensed under CC BY-NC-SA 4.0

*https://hackyourfuture.net/*

Found a mistake or have a suggestion? Let us know in the feedback form.