DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
BI MCP or Warehouse MCP? A 7-toggle rubric for picking the right doorway
sangaraju1988 profile

BI MCP or Warehouse MCP? A 7-toggle rubric for picking the right doorway

#mcp #ai #llm #dataengineering
Comments
3 min read
Postgres and Iceberg: pg_lake, pg_duckdb and the Postgres lakehouse
mohammed_arshadansari_f2 profile

Postgres and Iceberg: pg_lake, pg_duckdb and the Postgres lakehouse

#dataengineering #database #sql #opensource
Comments
3 min read
Enterprise AI Agents in 2026: Platforms, Deployment Services, and Why Most Projects Fail
revos_ai profile
RevOS for RevOS.ai

Enterprise AI Agents in 2026: Platforms, Deployment Services, and Why Most Projects Fail

#ai #agents #mcp #dataengineering
Comments
10 min read
Your first-seen product count is not a launch count
dataspryva profile

Your first-seen product count is not a launch count

#datascience #python #analytics #dataengineering
Comments
6 min read
Your Iceberg tables are rotting: we measured it, then built a fix (free, Apache 2.0)
aamir_dataeng profile

Your Iceberg tables are rotting: we measured it, then built a fix (free, Apache 2.0)

#dataengineering #opensource #python #iceberg
Comments
6 min read
Your Dashboard Is Lying: The Spend Fan-Out Trap and the Lead I Lost When the API Went Down
emadaed profile

Your Dashboard Is Lying: The Spend Fan-Out Trap and the Lead I Lost When the API Went Down

#n8n #sql #datamodeling #dataengineering
1
Comments 2
3 min read
Change Data Capture: A Guide to Database Synchronization
jp0809 profile

Change Data Capture: A Guide to Database Synchronization

#database #dataengineering #beginners #postgres
Comments
5 min read
Why PostHog Left DuckDB at 2 PB (and How to Check Your DuckLake Catalog)
alanwest profile

Why PostHog Left DuckDB at 2 PB (and How to Check Your DuckLake Catalog)

#database #dataengineering #programming #opensource
Comments
7 min read
Null rate data quality check in SQL, per column
refaeldakar profile

Null rate data quality check in SQL, per column

#sql #postgres #dataengineering #monitoring
Comments
2 min read
Power BI Service on ClickHouse, without an ODBC driver on your gateway
sergeisemenkov profile

Power BI Service on ClickHouse, without an ODBC driver on your gateway

#powerbi #clickhouse #semanticlayer #dataengineering
Comments
5 min read
Apache Airflow for Java Engineers: Orchestrating Data Pipelines Beyond Python
said_olano profile

Apache Airflow for Java Engineers: Orchestrating Data Pipelines Beyond Python

#java #airflow #dataengineering #architecture
Comments
8 min read
dbt snapshots are not an audit log
aniketsoni profile

dbt snapshots are not an audit log

#sql #analytics #dataengineering #dataquality
1
Comments
4 min read
openFDA's count= aggregation shows you the top 1,000 values and never tells you it stopped
fetchsmith profile

openFDA's count= aggregation shows you the top 1,000 values and never tells you it stopped

#webscraping #api #opendata #dataengineering
Comments
6 min read
Your Python Script Works on 1,000 Rows. Then the Real CSV Arrives.
emilywoodsnyc profile

Your Python Script Works on 1,000 Rows. Then the Real CSV Arrives.

#python #dataengineering #programming #interview
Comments 1
8 min read
Running CDC in Production: The WAL Slot Trap
pipelinewhiteboard profile

Running CDC in Production: The WAL Slot Trap

#postgres #dataengineering #devops #aws
Comments
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.