DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How I Streamed Live Binance L2 Order Book Data on AWS for ~$10/Month
goodiegoody profile

How I Streamed Live Binance L2 Order Book Data on AWS for ~$10/Month

#aws #fintech #infrastructure #dataengineering
5
Comments
14 min read
Stop Waiting for the Cloud: Building a Hybrid SQL+Python Data Pipeline Locally with DuckDB
markolekic profile

Stop Waiting for the Cloud: Building a Hybrid SQL+Python Data Pipeline Locally with DuckDB

#python #sql #dataengineering #tooling
Comments
5 min read
Decommissioning the Dinosaur: A 4-Phase Playbook for Migrating Your Legacy Data Warehouse to Databricks
shubhojeet2001 profile

Decommissioning the Dinosaur: A 4-Phase Playbook for Migrating Your Legacy Data Warehouse to Databricks

#datascience #databricks #devops #dataengineering
Comments
4 min read
The Data Analytics Lifecycle
hammoudi_wissem_2a55b8cc2 profile

The Data Analytics Lifecycle

#dataengineering #analytics
Comments
3 min read
Set up an open-source AI analyst for PostgreSQL in 2 minutes
bagofwords profile

Set up an open-source AI analyst for PostgreSQL in 2 minutes

#ai #dataengineering #data #opensource
1
Comments
5 min read
The Semantic Gap in Data Quality: Why Your Monitoring is Lying to You
vivekjami profile

The Semantic Gap in Data Quality: Why Your Monitoring is Lying to You

#googlecloud #fivetran #python #dataengineering
1
Comments 1
7 min read
Azure Data Solutions: Data Factory, Synapse, Data Lake & Databricks Integration
borisgigovic profile

Azure Data Solutions: Data Factory, Synapse, Data Lake & Databricks Integration

#azure #dataengineering #analytics #databricks
2
Comments 1
4 min read
Building an Enterprise Patching Dashboard with AWS - A Complete Guide
debapriya_dey_aada54b7766 profile

Building an Enterprise Patching Dashboard with AWS - A Complete Guide

#aws #devops #cloud #dataengineering
5
Comments
5 min read
Building an Automated Data Pipeline: Injuries vs Performance in the Premier League
james_kariuki profile

Building an Automated Data Pipeline: Injuries vs Performance in the Premier League

#dataengineering #python #data
Comments
6 min read
2025-2026 Guide to Learning about Apache Iceberg, Data Lakehouse & Agentic AI
alexmercedcoder profile

2025-2026 Guide to Learning about Apache Iceberg, Data Lakehouse & Agentic AI

#agents #dataengineering #learning #architecture
Comments
9 min read
Evolution of Processing: SPL One-Click Acceleration for Log-to-Metric Conversion
observabilityguy profile

Evolution of Processing: SPL One-Click Acceleration for Log-to-Metric Conversion

#monitoring #dataengineering #tooling #performance
Comments
6 min read
My First Data Engineering Project: Building a Real-Time IoT Pipeline on Azure
humza_inam profile

My First Data Engineering Project: Building a Real-Time IoT Pipeline on Azure

#azure #iot #dataengineering #beginners
Comments
6 min read
The Data Engineer’s Codex: From First Principles to the Modern Lakehouse
datatechbridge profile

The Data Engineer’s Codex: From First Principles to the Modern Lakehouse

#systemdesign #distributedsystems #dataengineering #architecture
6
Comments
10 min read
Breaking Into Gaming Analytics: From 1 Billion Mobile Users to 5B Daily Events
sai_krishnachaitanyachi profile

Breaking Into Gaming Analytics: From 1 Billion Mobile Users to 5B Daily Events

#dataengineering #analytics #gaminganalytics #careerpivot
Comments 1
6 min read
Building a Real-Time Data Lake on AWS: S3, Glue, and Athena in Production
wanjohichristopher profile

Building a Real-Time Data Lake on AWS: S3, Glue, and Athena in Production

#architecture #aws #dataengineering
1
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.