DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Day 26: Spark Streaming Joins

Day 26: Spark Streaming Joins

Comments
1 min read
Exploring the Potential of AWS Glue Python Shell as a Long-Running Batch Execution Environment

Exploring the Potential of AWS Glue Python Shell as a Long-Running Batch Execution Environment

4
Comments
7 min read
DataOps 101: What It Is and Why Enterprises Can’t Ignore It in 2026

DataOps 101: What It Is and Why Enterprises Can’t Ignore It in 2026

Comments
2 min read
Day 25: Streaming Aggregations in Spark

Day 25: Streaming Aggregations in Spark

Comments
1 min read
What Is Data Fabric Architecture? A Beginner’s Guide (Explained Simply)

What Is Data Fabric Architecture? A Beginner’s Guide (Explained Simply)

Comments
2 min read
Data Processing Does Not Belong in the Message Broker

Data Processing Does Not Belong in the Message Broker

Comments
3 min read
Can you describe a complex data architecture you’ve designed or implemented in the past?

Can you describe a complex data architecture you’ve designed or implemented in the past?

Comments
1 min read
Apache SeaTunnel Community Year-End Review 2025

Apache SeaTunnel Community Year-End Review 2025

1
Comments
7 min read
Day 24: Spark Structured Streaming

Day 24: Spark Structured Streaming

Comments
1 min read
Tools of the Trade: What Powers Modern Data Engineering

Tools of the Trade: What Powers Modern Data Engineering

4
Comments 1
5 min read
Basics of Git and GitHub

Basics of Git and GitHub

2
Comments
4 min read
Day 23: Spark Shuffle Optimization

Day 23: Spark Shuffle Optimization

Comments
1 min read
RAG Is a Data Engineering Problem Disguised as AI

RAG Is a Data Engineering Problem Disguised as AI

Comments 1
5 min read
4th Winter Data & AI Meetup

4th Winter Data & AI Meetup

1
Comments
1 min read
Learning SQL Server the Hard Way: 16 Days of Real-World Database Work

Learning SQL Server the Hard Way: 16 Days of Real-World Database Work

2
Comments 2
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.