DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast
leosuky profile

⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast

#dataengineering #webscraping #python #webdev
2
Comments 1
3 min read
đź“Š Understanding 6 Common Data Formats in Data Analytics
rethan_kumarcv_c7864238f profile

đź“Š Understanding 6 Common Data Formats in Data Analytics

#dataengineering #analytics #datascience #database
Comments
4 min read
Introduction to Apache Kafka for Beginners
mutindakioko profile

Introduction to Apache Kafka for Beginners

#kafka #dataengineering #tutorial #beginners
1
Comments
5 min read
Apache Kafka — Deep Dive: Core Concepts, Data-Engineering Applications, and Real-World Production Practices
kemboijebby profile

Apache Kafka — Deep Dive: Core Concepts, Data-Engineering Applications, and Real-World Production Practices

#dataengineering #programming #ai
1
Comments
4 min read
Apache Iceberg Dev List Digest August 25-29
alexmercedcoder profile

Apache Iceberg Dev List Digest August 25-29

#database #datascience #dataengineering
Comments
5 min read
How I Built a MongoDB Archiving System for Crawled Data
pradippanjiyar profile

How I Built a MongoDB Archiving System for Crawled Data

#dataengineering #database #architecture #mongodb
1
Comments 2
7 min read
Complete Guide: Dockerizing Spark, Kafka, and Jupyter for YouTube Pipeline
lagat_josiah_f024a2c855bc profile

Complete Guide: Dockerizing Spark, Kafka, and Jupyter for YouTube Pipeline

#dataengineering #architecture #docker #tutorial
Comments
9 min read
Dockerized Spark and Kafka: YouTube Data Pipeline Implementation
lagat_josiah_f024a2c855bc profile

Dockerized Spark and Kafka: YouTube Data Pipeline Implementation

#dataengineering #architecture #docker #tutorial
Comments
7 min read
RIP Amazon Data Firehose Change Data Capture
psantus profile

RIP Amazon Data Firehose Change Data Capture

#dataengineering #aws #cloud #firehose
7
Comments 3
4 min read
Event-Driven Architectures on AWS: Beyond Lambda
nidhi_0105 profile

Event-Driven Architectures on AWS: Beyond Lambda

#blog #aws #dataengineering #lambda
4
Comments
2 min read
YouTube Data Processing Pipeline
lagat_josiah_f024a2c855bc profile

YouTube Data Processing Pipeline

#postgres #python #dataengineering #architecture
2
Comments 1
4 min read
🔄 ETL vs ELT: What’s the Difference and Why It Matters?
shagun_khandelwal profile

🔄 ETL vs ELT: What’s the Difference and Why It Matters?

#dataengineering #python #sql #datawarehouse
Comments
2 min read
CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium
tsypuk profile

CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium

#dataengineering #mysql #aws #kafka
1
Comments
5 min read
LLPY-03: ExtracciĂłn y Procesamiento Inteligente de Datos Legales
jesus_oviedoriquelme_084 profile

LLPY-03: ExtracciĂłn y Procesamiento Inteligente de Datos Legales

#dataengineering #spanish #rag #llm
Comments
21 min read
🏗️ The Role of a Data Engineer: Beyond Pipelines
parth_maniar_3012 profile

🏗️ The Role of a Data Engineer: Beyond Pipelines

#datascience #dataengineering #bigdata #career
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.