Week 15 - Final Project

Welcome to Week 15! This is the capstone of the Data Track. You will work in a cross-track team to build a portfolio-ready project that demonstrates the full range of skills you have learned. The final project is your chance to create something you can proudly show to potential employers.

The default format is a web application built by a team with members from each HYF track. As a data track graduate, your contribution is an Azure-hosted data product with daily batch processing that powers the application with real, up-to-date data.

Learning goals

Scope and plan a data product as part of a larger cross-track application
Design and implement an end-to-end data pipeline: ingestion, transformation, modeling, and delivery
Deploy the pipeline on Azure with automated daily batch processing
Collaborate with web development and other tracks to integrate data into a shared product
Run and verify the starter pipeline end to end before extending it for your own project
Apply production best practices: error handling, monitoring, documentation, and version control
Present and demo the project in a professional setting
Produce a portfolio-ready deliverable with clear documentation

Chapters

Project Ideas and Inspiration: pick a source and project shape
Cross-Track Collaboration
The Project Architecture
Ingestion, ACA, and CI/CD: Python package, Container Apps jobs, data-ci-cd.yaml
dbt models: variables, read_files, schemas, stg → marts
Publish to Postgres: which mart lands in Railway
Running the Pipeline Locally: Path A - run all three by hand
Orchestrating with Airflow
Promoting to Production
Secrets & Variables (reference)

Supplementary

Glossary: Week 15

Career relevance: Week 15

Teachers

Final Project Brief

Requirements and Deliverables