Data Engineering Collection

◆

◆

◆

◆

💎Aqua

★★★★

“Apache Superset is a Data Visualization and Data Exploration Platform”

◆

◆

◆

◆

📦Normal

★★★★

“Learn how to develop, deploy and iterate on production-grade ML applications.”

◆

◆

◆

◆

🔮Psychic

★★★★

“Apache Airflow - A platform to programmatically author, schedule, and monitor workflows”

◆

◆

◆

◆

📦Normal

★★★★

“Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here 👇🏼”

◆

◆

◆

◆

📦Normal

★★★★

“📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.”

◆

◆

◆

◆

🔮Psychic

★★★★

“Prefect is a workflow orchestration framework for building resilient data pipelines in Python.”

◆

◆

◆

◆

🔮Psychic

★★★★

“Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.”

◆

◆

◆

◆

🔮Psychic

★★★

“Turns Data and AI algorithms into production-ready web applications in no time.”

◆

◆

◆

◆

🌊Water

★★★

“Workflow Engine for Kubernetes”

◆

◆

◆

◆

🔮Psychic

★★★

“An orchestration platform for the development, production, and observation of data assets.”

◆

◆

◆

◆

🔮Psychic

★★★

“The Data Engineering Cookbook”

◆

◆

◆

◆

📦Normal

★★★

“Roadmap to becoming a data engineer in 2021”

◆

◆

◆

◆

🔮Psychic

★★★

“Always know what to expect from your data.”

◆

◆

◆

◆

🔮Psychic

★★★

“Incremental engine for long horizon agents 🌟 Star if you like it!”

◆

◆

◆

◆

🔮Psychic

★★★

“🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.”

◆

◆

◆

◆

⚙️Steel

★★★

“Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.”

◆

◆

◆

◆

🔮Psychic

★★★

“🧙 Build, run, and manage data pipelines for integrating and transforming data.”

◆

◆

◆

◆

🌊Water

★★★

“Fancy stream processing made operationally mundane”