Week 14 - Infrastructure & Data Loading

Introduction to IaC and Data Loading

Infrastructure as Code Concepts

Azure Bicep

Data Loading Tools (Fivetran/Airbyte)

Airbyte Cloud Lab

Gotchas & Pitfalls

7. Practice

8. Assignment

Week 14 Lesson Plan (Teachers)

Introduction to IaC and Data Loading

Content coming soon...

Suggested Topics

• The two remaining pieces of a production data platform: infrastructure and connectors
• Why clicking through cloud portals does not scale: drift, lack of reproducibility, onboarding friction
• Infrastructure as Code: defining cloud resources in version-controlled config files
• Managed data loading: outsourcing ingestion to specialized tools instead of writing scripts
• How IaC and data loading tools complement each other in a modern data stack
• The build-vs-buy spectrum: when to write custom code vs when to use off-the-shelf tools
• Overview of tools covered this week: Terraform for IaC, Airbyte and Fivetran for loading
• Real-world scenario: setting up a new data environment from scratch using IaC and managed connectors

The HackYourFuture curriculum is licensed under CC BY-NC-SA 4.0 *https://hackyourfuture.net/*

Built with ❤️ by the HackYourFuture community · Thank you, contributors

Found a mistake or have a suggestion? Let us know in the feedback form.