Introduction to IaC and Data Loading

Infrastructure as Code Concepts

Azure Bicep

Data Loading Tools (Fivetran/Airbyte)

Airbyte Cloud Lab

Practice

Assignment

Gotchas & Pitfalls

Week 14 Lesson Plan (Teachers)

Data Loading Tools (Fivetran/Airbyte)

Content coming soon...

Suggested Topics

• What are managed data loading tools: pre-built connectors that move data from sources to destinations
• Fivetran: a fully managed SaaS platform with hundreds of connectors
• Airbyte: an open-source alternative with a cloud-hosted option
• How connectors work: source extraction, schema mapping, incremental sync, and destination loading
• EL vs ELT: loading raw data first and transforming later with dbt
• Connector catalog: databases, APIs, SaaS tools (Salesforce, Stripe, Google Analytics)
• Build vs buy: when custom Python scripts are better and when managed connectors save time
• Cost considerations: pricing models, usage-based billing, and total cost of ownership
• Schema evolution: how these tools handle source schema changes automatically

The HackYourFuture curriculum is licensed under CC BY-NC-SA 4.0

*https://hackyourfuture.net/*

Found a mistake or have a suggestion? Let us know in the feedback form.