DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Scraping Adversarial Municipal Portals: A Permit Pipeline That Knows When It Failed
andrewmaury profile

Scraping Adversarial Municipal Portals: A Permit Pipeline That Knows When It Failed

#dataengineering #python #webscraping #proptech
Comments
11 min read
Amazon S3 Tables Alternatives for Production Iceberg
jonisar profile

Amazon S3 Tables Alternatives for Production Iceberg

#iceberg #aws #datalakehouse #dataengineering
Comments
14 min read
Best Data Modeling Tools for Cloud Data Warehouse Migration (2026): SQLDBM, ER/Studio, erwin & dbt Compared
joonsystems profile

Best Data Modeling Tools for Cloud Data Warehouse Migration (2026): SQLDBM, ER/Studio, erwin & dbt Compared

#cloud #database #dataengineering #tools
Comments
11 min read
Unity Catalog Is Becoming the Operating Layer for Enterprise Data Governance
laura_williams profile

Unity Catalog Is Becoming the Operating Layer for Enterprise Data Governance

#databricks #unitycatalog #datagovernance #dataengineering
Comments
5 min read
One Table, Many Engines: Running BigQuery, Spark, and Trino on a Single Iceberg Copy
carlosrgomes profile

One Table, Many Engines: Running BigQuery, Spark, and Trino on a Single Iceberg Copy

#googlecloud #apacheiceberg #bigquery #dataengineering
1
Comments
14 min read
Is SQLazy Something Missing from Your dbt Workflow?
esproc_spl profile
Judy

Is SQLazy Something Missing from Your dbt Workflow?

#analytics #dataengineering #sql
5
Comments
6 min read
Modeling Liquidity Without a Misleading Score — Johan Wirakarsa, Ph.D.
johanwirakarsaphd profile

Modeling Liquidity Without a Misleading Score — Johan Wirakarsa, Ph.D.

#dataclasses #dataengineering #python #johanwirakarsaphd
Comments
2 min read
Designing a Production-Ready Data Science Pipeline: From Raw Events to Monitored Models
mick_michaels_b9eb profile

Designing a Production-Ready Data Science Pipeline: From Raw Events to Monitored Models

#datascience #dataengineering #sql #datamodeling
Comments
5 min read
Dynamic Pricing Is a Data Freshness Problem Before It Is a Model Problem
anakin_writers profile

Dynamic Pricing Is a Data Freshness Problem Before It Is a Model Problem

#dataengineering #pricing #typescript #marketplaces
Comments
4 min read
Moving product analytics safely: start with the ingestion boundary
sensorflow profile

Moving product analytics safely: start with the ingestion boundary

#opensource #dataengineering
Comments
2 min read
When I killed the Korean version: what channel mismatch actually looks like
hannune profile

When I killed the Korean version: what channel mismatch actually looks like

#python #dataengineering #startup #programming
1
Comments
2 min read
Power BI Data Modelling, Relationships & Joins: A Practical Technical Guide
zabartrevor profile

Power BI Data Modelling, Relationships & Joins: A Practical Technical Guide

#powerfuldevs #beginners #dataengineering #data
Comments
11 min read
Your entity resolution pipeline works on database records. Then you point it at news text.
hannune profile

Your entity resolution pipeline works on database records. Then you point it at news text.

#entityresolution #dataengineering #nlp #python
Comments
2 min read
Your Orchestrator Is an Operating Model, Not a Feature List
sudeephazra profile

Your Orchestrator Is an Operating Model, Not a Feature List

#dataengineering
Comments
5 min read
Four Iceberg Tools, Three Agent Frameworks: What Ports, and What Doesn't
xbill profile

Four Iceberg Tools, Three Agent Frameworks: What Ports, and What Doesn't

#iceberg #aiagents #lakehouse #dataengineering
Comments
18 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.