Post-Track Material

Projects, Python and Datasets

System Design

Working with AI

Other Common Tools

Cloud and Certifications

Books

System Design

System design is planning how the parts of a system fit together before you build it: where data comes from, where it is stored, how it moves, and what happens when something fails or the data grows.

In data engineering you make these choices all the time. Batch or streaming, a warehouse or a lakehouse, how to partition files, how to retry a failed load without creating duplicates. You already made several of them in the final project. In interviews at companies this usually comes up as questions about your own project or a take home assignment: in both cases, you need to be ready to explain why you chose a tool, what happens when the source API is down, how you would handle ten times more data.

Start here

Data engineering specific

Going deeper


The HackYourFuture curriculum is licensed under CC BY-NC-SA 4.0 https://hackyourfuture.net/

CC BY-NC-SA 4.0 Icons

Built with ❤️ by the HackYourFuture community · Thank you, contributors

Found a mistake or have a suggestion? Let us know in the feedback form.