Week 7 - Mid-Track Project

The HackYourFuture curriculum is licensed under CC BY-NC-SA 4.0 *https://hackyourfuture.net/*

Built with ❤️ by the HackYourFuture community · Thank you, contributors

Found a mistake or have a suggestion? Let us know in the feedback form.

Project Brief

Project Requirements

Week 7 Gotchas & Pitfalls

project_week_7.mp4

Week 7 - Mid-Track Project

Welcome to Week 7! This is your mid-track project week. This is a solo project. You will apply everything you have learned so far: Python pipelines, data ingestion, Docker, CI/CD, and Azure, to build and deploy a custom container app of your own choosing. The week concludes with a technical interview where you present and defend your project.

This is a free-form project week. You pick the data source and the use case. We provide the guidelines and the goal.

Learning goals

• Design and scope a data engineering project independently
• Build a complete data pipeline from ingestion to storage
• Containerize the project with Docker and push the image to Azure Container Registry
• Deploy and run the container app on Azure Container Apps
• Store pipeline results in Azure Postgres or Azure Blob Storage
• Present technical decisions clearly in a technical interview setting
• Reflect on trade-offs, challenges, and lessons learned during the project

Chapters

1. Project Brief
2. Project Requirements
3. Gotchas & Pitfalls
4. Interview Preparation