Introduction to Orchestration

Airflow Fundamentals

Scheduling and Triggers

Sequential Pipeline Steps

Parameterized Runs and Backfills

Monitoring and Debugging

Practice

Assignment

Gotchas & Pitfalls

Week 12 Lesson Plan (Teachers)

Scheduling and Triggers

Content coming soon...

Suggested Topics

• Cron expressions: syntax, common patterns (daily, hourly, weekdays only)
• Airflow schedule_interval: setting cron-based schedules on DAGs
• Execution date vs logical date: understanding Airflow's date model
• Catchup behavior: what happens when a DAG is paused and then resumed
• Manual triggers: running a DAG on-demand from the UI or CLI
• Event-driven triggers: sensors, external triggers, and dataset-based scheduling
• Time zones: handling UTC vs local time in schedule definitions
• Best practices: choosing the right schedule frequency for your use case

The HackYourFuture curriculum is licensed under CC BY-NC-SA 4.0

*https://hackyourfuture.net/*

Found a mistake or have a suggestion? Let us know in the feedback form.