Going Further

This page is optional. Nothing here is required for Week 13's learning goals or the assignment. Week 13 has five content chapters: The lakehouse idea, Workspace & Unity Catalog, PySpark in Databricks, dbt on Databricks, and Scheduling dbt Jobs.

Optional deep-dives live in the topic pages below. They are real skills, but they are not needed to pass the week. Skip around.

Topic pages

Compute & notebooks: creating your own compute, serverless notebooks, migrating notebooks to applications, unit-testing a PySpark module locally
Lakehouse deep dive: ACID across Postgres, cloud warehouses, plain lakes, and Delta
Ingestion, DLT & medallion: Auto Loader, Lakeflow Connect, Delta Live Tables, medallion architecture (bronze / silver / gold)
Jobs & Asset Bundles: Git-backed and multi-task Jobs, Job notifications, Databricks Asset Bundles (DABs)
AI, Unity Catalog & quality: Genie and AI SQL functions, managed vs external tables, Unity Catalog Volumes and governance, Lakehouse Monitoring
Streaming, internals & platforms: Structured Streaming, Kafka, Event Hubs, Spark cluster architecture (driver / executors / cluster manager), Delta Lake and Catalyst, platform comparisons

The HackYourFuture curriculum is licensed under CC BY-NC-SA 4.0 https://hackyourfuture.net/

CC BY-NC-SA 4.0 Icons

Built with ❤️ by the HackYourFuture community · Thank you, contributors

Found a mistake or have a suggestion? Let us know in the feedback form.