Week 4 - Data Processing with Pandas

Introduction to Pandas

DataFrame operations

Grouping and Aggregation

Joining and Merging

Different Data Types

Advanced Transformations

Writing Data

Alternatives to Pandas

Practice

Assignment

Gotchas & Pitfalls

• Teachers

Back to Track

7. Writing Data

Content coming soon...

Suggested Topics

• Writing to CSV: basic output format, handling encoding and delimiters
• Writing to Parquet: introduction to columnar format, when to use vs CSV (brief overview, details in Week 13)
• Writing to SQLite: connecting from Pandas, to_sql() method, replacing vs appending
• Reconnecting to Week 3 database knowledge: building on what you learned
• Schema handling: letting Pandas infer vs explicit type specification
• Data validation before writing: ensuring clean data
• Handling duplicates: unique constraints, preventing errors
• Verifying written data: reading back and comparing
• Performance: batch sizes, chunking large datasets
• Real example: transforming data and writing to multiple formats

Back to sidebar

*https://hackyourfuture.net/*

Found a mistake or have a suggestion? Let us know in the feedback form.