DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Streamlining ETL Pipelines with Docker and Docker Compose in Data Engineering
petermuriya profile

Streamlining ETL Pipelines with Docker and Docker Compose in Data Engineering

#automation #dataengineering #devops #docker
Comments
3 min read
keep your snapshots simple
shrouwoods profile

keep your snapshots simple

#dbt #snapshots #type2scd #dataengineering
1
Comments
10 min read
Containerizing Apache Airflow: Building Portable Data Pipelines with Docker
petermuriya profile

Containerizing Apache Airflow: Building Portable Data Pipelines with Docker

#dataengineering #devops #docker #tutorial
Comments
1 min read
Data Engineer Skills Companies Want in 2026: 6,877-Posting Analysis
gnana_6392e836fd500a957dc profile
Gnana

Data Engineer Skills Companies Want in 2026: 6,877-Posting Analysis

#dataengineering #jobsearch #interview #career
1
Comments
17 min read
I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.
niclydon profile

I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.

#apple #postgres #privacy #dataengineering
1
Comments 1
6 min read
DatAasee 0.9 Released
gramian profile

DatAasee 0.9 Released

#metadata #lakehouse #dataengineering #database
Comments
1 min read
Add Data Quality Checks to Your Airflow DAG in 5 Minutes
vahid_saber_d47950be99729 profile

Add Data Quality Checks to Your Airflow DAG in 5 Minutes

#airflow #dataengineering #python #dataquality
Comments
3 min read
Managed Iceberg Data Lakes: A Guide
jonisar profile

Managed Iceberg Data Lakes: A Guide

#data #database #dataengineering #opensource
Comments
14 min read
That Time One Field Change Took Down an Entire Production Pipeline
reetesh_kumar profile

That Time One Field Change Took Down an Entire Production Pipeline

#backend #dataengineering #distributedsystems #systemdesign
1
Comments
4 min read
Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published
amaranarun profile

Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published

#dataengineering #observability #mlops #dataquality
Comments
8 min read
Data Engineer Salaries Are Splitting in Two. Which Side Are You On?
datadriven profile

Data Engineer Salaries Are Splitting in Two. Which Side Are You On?

#dataengineering #career #beginners #interview
Comments
7 min read
Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs
lawrence_murithi profile

Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs

#docker #virtualmachine #virtualenvironment #dataengineering
Comments
8 min read
A Step-by-Step Starter Kit for Building a Data Quality Framework
balapriya profile

A Step-by-Step Starter Kit for Building a Data Quality Framework

#data #dataengineering #testing #tutorial
Comments
6 min read
Data Series: Understanding ETL & Medallion Architecture — Part 1
deepak_shankar_4421c006b5 profile

Data Series: Understanding ETL & Medallion Architecture — Part 1

#architecture #beginners #dataengineering #tutorial
1
Comments
2 min read
Why Your ADF Pipeline Shows Success But Your Data Is Wrong
chandramouli_kondamudi_82 profile

Why Your ADF Pipeline Shows Success But Your Data Is Wrong

#azure #dataengineering #data #etl
Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.