📊 Data Engineering with dlt

Welcome to my public learning journey with dlt — an open-source Python library that makes it easy to build robust, modern ELT (Extract-Load-Transform) pipelines with minimal code.

🎯 Goal

This repository is a hands-on, beginner-to-advanced guide to learning dlt. It includes weekly examples, use cases, and walkthroughs — from ingesting data from APIs and databases to integrating with Airbyte, dbt, and cloud warehouses.

Whether you're new to data engineering or looking to streamline your pipeline development, this repo will guide you through:

• ✅ Ingesting data from public APIs, files, and databases
• ✅ Loading data to destinations like BigQuery, DuckDB, and PostgreSQL
• ✅ Integrating with Airbyte and dbt for scalable pipeline orchestration
• ✅ Building reusable, production-ready Python pipelines

📅 Weekly Learning Series

Each week, I explore a new feature or use case, share my learnings, and post a tutorial or project here. You can also follow along on LinkedIn for bite-sized updates and context.

📁 Structure

• week-01_intro-to-dlt/ – Getting started with dlt
• week-02-load-to-bigquery/ – Loading to cloud data warehouses
• week-03-airbyte-integration/ – Airbyte + dlt
• week-04-dbt-integration/ – Combining dlt with dbt
• week-05-streaming-data/ – Handling streaming and near real-time ingestion

👨🏾‍💻 About Me

I'm Mahadi Nagassou, a data scientist passionate about simplifying AI and data engineering for African developers and organizations. Through this project, I hope to make learning dlt easy and accessible for anyone curious about building clean, scalable data pipelines with Python.

⭐ Stay Connected

If you find this helpful, star the repo ⭐ and follow me on LinkedIn to learn in public with me.

---

#dlt #dataengineering #python #opensource #learninginpublic