Week 3 - Ingesting and Validating Data

Introduction to Data Ingestion

Ingesting from APIs

Reading Multiple File Formats

Pydantic for Data Validation

Writing to Databases

Error Handling and Logging

Practice

Assignment

Gotchas & Pitfalls

• Teachers

Back to Track

Content

7. Practice

Content coming soon...

Suggested Activities

• Building an API ingestion script with pagination and error handling
• Reading and parsing CSV files with different delimiters and encodings
• Validating JSON records with Pydantic and reporting bad data
• Writing validated data to a local Postgres instance
• Creating error reports in JSON format
• Hands-on: fixing a broken ingestion pipeline
• Integration exercise: ingest → validate → store in one script

Back to sidebar

*https://hackyourfuture.net/*

Found a mistake or have a suggestion? Let us know in the feedback form.