DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Synthetic Time Series Data: A Practical Guide META
thiam_lee profile

Synthetic Time Series Data: A Practical Guide META

#ai #database #machinelearning #dataengineering
Comments
6 min read
CDC with Sling: When Log-Based Works and When Query-Based Is Enough
flarco profile

CDC with Sling: When Log-Based Works and When Query-Based Is Enough

#mysql #dataengineering #etl #database
Comments 1
8 min read
Data Pipelines Explained: Benefits, Types, and Use Cases
sergiiklius profile

Data Pipelines Explained: Benefits, Types, and Use Cases

#dataengineering #datascience #automation #tutorial
Comments
4 min read
95% of My PySpark Job Finished in 4 Minutes. The Last Task Took 40. Here's Why.
maithreyan11 profile

95% of My PySpark Job Finished in 4 Minutes. The Last Task Took 40. Here's Why.

#pyspark #dataengineering #apachespark #databricks
Comments
5 min read
dbt Was Not Designed for Multi-Tenant SaaS. Here's How I Made It Work.
eu_ti_f127c5b5d7535b7174f profile

dbt Was Not Designed for Multi-Tenant SaaS. Here's How I Made It Work.

#dataengineering #sql #python #architecture
Comments
4 min read
Building a real-time price monitoring pipeline that does not poison your data
anakin_writers profile

Building a real-time price monitoring pipeline that does not poison your data

#webdev #dataengineering #scraping #analytics
Comments
4 min read
Building an investing knowledge graph, part 3: same company, seven names
hannune profile

Building an investing knowledge graph, part 3: same company, seven names

#graphdb #knowledgegraph #dataengineering #entityresolution
2
Comments
4 min read
The Pipeline Worked. Then the Research Outgrew It.
daemonic01 profile

The Pipeline Worked. Then the Research Outgrew It.

#dataengineering #python #programming #productivity
Comments
4 min read
Subqueries vs CTEs: Query Optimizer Internals & Memory Spooling Explained
arpitmbangre profile

Subqueries vs CTEs: Query Optimizer Internals & Memory Spooling Explained

#database #sql #dataengineering #performance
Comments
2 min read
Four Iceberg Tools, Three Agent Frameworks: What Ports, and What Doesn't
xbill profile

Four Iceberg Tools, Three Agent Frameworks: What Ports, and What Doesn't

#iceberg #aiagents #lakehouse #dataengineering
7
Comments 1
18 min read
Time-Series Cardinality: Why One More Indexed Column Costs More Than a Million More Rows
tigerdata_dev profile

Time-Series Cardinality: Why One More Indexed Column Costs More Than a Million More Rows

#timeseriesdata #postgres #dataengineering
Comments
13 min read
Building a Quote Monitoring Pipeline for Insurance Pricing
anakin_writers profile

Building a Quote Monitoring Pipeline for Insurance Pricing

#python #dataengineering #webscraping #analytics
Comments
4 min read
We tested "JSON-LD only" article extraction against 8 real news sites. It got 0.
fetchsmith profile

We tested "JSON-LD only" article extraction against 8 real news sites. It got 0.

#webscraping #api #javascript #dataengineering
Comments 1
5 min read
What Should a Real Data Engineer Assessment Actually Test?
bobby_ray_581732c715283b2 profile

What Should a Real Data Engineer Assessment Actually Test?

#anzibloom #dataengineering #career #interviewing
Comments
3 min read
Thin-Film Measurement Data: What to Check Before Building a Dashboard
chesky0418 profile
ches

Thin-Film Measurement Data: What to Check Before Building a Dashboard

#python #iot #dataengineering #tutorial
Comments 1
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.