DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Why Data Partitioning Is Harder Than It Looks
dct_technology profile

Why Data Partitioning Is Harder Than It Looks

#webdev #database #programming #dataengineering
1
Comments
2 min read
Part 2: Snowflake's Autonomous Future
taro_matsui_japan profile

Part 2: Snowflake's Autonomous Future

#dataengineering #ai #snowflake
Comments
8 min read
Collecting Africa’s Energy Insights:
evlyn_njagi_a32f3ab6c984 profile

Collecting Africa’s Energy Insights:

#dataengineering #data #automation #python
3
Comments
4 min read
Containerization for Data Engineering: A Practical Guide with Docker and Docker Compose
eric_kahindi_cfbfda3bd0f7 profile

Containerization for Data Engineering: A Practical Guide with Docker and Docker Compose

#dataengineering #containers #tutorial #docker
Comments
5 min read
Making JSON Compression Searchable — SEE (Schema-Aware Encoding)
kodomonocch1 profile

Making JSON Compression Searchable — SEE (Schema-Aware Encoding)

#dataengineering #finops #cloud #compression
1
Comments
2 min read
Apache Iceberg Dev List Digest (Sept 15–19, 2025)
alexmercedcoder profile

Apache Iceberg Dev List Digest (Sept 15–19, 2025)

#dataengineering #data #opensource #learning
Comments
3 min read
Data Engineering with Docker: A Hands-On Guide to Containerization
aineahsimiyu profile

Data Engineering with Docker: A Hands-On Guide to Containerization

#docker #containers #dataengineering #automation
7
Comments 2
3 min read
From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks
kepha_mwandiki profile

From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks

#dataengineering #automation #tutorial #sql
3
Comments 1
10 min read
Understanding the Basics of Linux Operating System
eden_wetende profile

Understanding the Basics of Linux Operating System

#linux #dataengineering #basic
Comments
1 min read
Why you need to learn Apache Airflow - right now
eric_kahindi_cfbfda3bd0f7 profile

Why you need to learn Apache Airflow - right now

#dataengineering #airflow #python
Comments
3 min read
Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery
gurudev_prasadteketi profile

Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery

#dataengineering #analytics #architecture #aws
1
Comments
8 min read
Apache Kafka Deep Dive: Concepts, Applications, and Production
walnold profile

Apache Kafka Deep Dive: Concepts, Applications, and Production

#kafka #eventdriven #zookeeper #dataengineering
Comments
4 min read
A Dive into Apache Iceberg™'s Metadata
thedanicafine profile

A Dive into Apache Iceberg™'s Metadata

#dataengineering #iceberg #database #architecture
Comments
4 min read
Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana
oliver_samuel_028c6f65ad6 profile

Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana

#dataengineering #analytics #architecture #python
7
Comments
5 min read
Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer
alexmercedcoder profile

Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer

#dataengineering #analytics #architecture #ai
1
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.