Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Nikita Almakov

Jul 21 '25

Generate Blazing-Fast Ad-Hoc Python Functions From Declarative Rules

#python #performance #etl #dataengineering

2 min read

Vinicius Fagundes

Jul 20 '25

🧱 OLTP vs OLAP: When Transaction Meets Analytics

#datafoundation #dataengineering #ai #sql

2 min read

jayanti-neu

Jul 20 '25

Building a Real-Time Healthcare Data Pipeline with Apache Spark: From SQS to Parquet (Part 2)

#spark #dataengineering #healthcare #python

8 min read

mrcaption49

Jul 20 '25

Virtual Private Database (VPD) | DBMS_RLS | fine-grained access control (FGAC) | mrcaption49

#database #data #datascience #dataengineering

5 min read

Dinesh Arney

Jun 16 '25

Kafka Internal Architecture and Mechanisms

#kafka #distributedsystems #eventdriven #dataengineering

14 min read

mrcaption49

Jul 20 '25

DBMS_SCHEDULER with Practical example | mrcaption49

#database #data #datascience #dataengineering

4 min read

Muhammet Ali AKBAK

Jul 19 '25

🖼️ PixelSink: Hunt Hidden Data Inside Images

#cybersecurity #flask #dataengineering #datascience

1 min read

Roxana Maria Haidiner

Jul 18 '25

SQL Server 2025 - What’s New and How to Visualize the Schema

#sqlserver #database #sql #dataengineering

7 min read

Dror Atariah

Jul 18 '25

SQL CASE Statements: The Order Matters!

#sql #database #dataengineering #python

2 min read

Alex Merced

Jul 17 '25

Apache Iceberg Table Optimization #10: The Endgame — Building an Autonomous Optimization Pipeline for Apache Iceberg

#database #datascience #dataengineering #apacheiceberg

3 min read

Alex Merced

Jul 17 '25

Apache Iceberg Table Optimization #8: Hidden Pitfalls — Compaction and Partition Evolution in Apache Iceberg

#database #datascience #dataengineering #apacheiceberg

3 min read

Alex Merced

Jul 17 '25

Apache Iceberg Table Optimization #9: Managing Large-Scale Optimizations — Parallelism, Checkpointing, and Fail Recovery

#database #datascience #dataengineering #apacheiceberg

3 min read

Alex Merced

Jul 17 '25

Apache Iceberg Table Optimization #2: The Basics of Compaction — Bin Packing Your Data for Efficiency

#dataengineering #database #datascience #apacheiceberg

3 min read

Alex Merced

Jul 17 '25

Apache Iceberg Table Optimization #4: Smarter Data Layout — Sorting and Clustering Iceberg Tables

#database #datascience #dataengineering #apacheiceberg

3 min read

Alex Merced

Jul 17 '25

Apache Iceberg Table Optimization #5: Avoiding Metadata Bloat with Snapshot Expiration and Rewriting Manifests

#database #datascience #dataengineering #apacheiceberg

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# dataengineering

Generate Blazing-Fast Ad-Hoc Python Functions From Declarative Rules

🧱 OLTP vs OLAP: When Transaction Meets Analytics

Building a Real-Time Healthcare Data Pipeline with Apache Spark: From SQS to Parquet (Part 2)

Virtual Private Database (VPD) | DBMS_RLS | fine-grained access control (FGAC) | mrcaption49

Kafka Internal Architecture and Mechanisms

DBMS_SCHEDULER with Practical example | mrcaption49

🖼️ PixelSink: Hunt Hidden Data Inside Images

SQL Server 2025 - What’s New and How to Visualize the Schema

SQL CASE Statements: The Order Matters!

Apache Iceberg Table Optimization #10: The Endgame — Building an Autonomous Optimization Pipeline for Apache Iceberg

Apache Iceberg Table Optimization #8: Hidden Pitfalls — Compaction and Partition Evolution in Apache Iceberg

Apache Iceberg Table Optimization #9: Managing Large-Scale Optimizations — Parallelism, Checkpointing, and Fail Recovery

Apache Iceberg Table Optimization #2: The Basics of Compaction — Bin Packing Your Data for Efficiency

Apache Iceberg Table Optimization #4: Smarter Data Layout — Sorting and Clustering Iceberg Tables

Apache Iceberg Table Optimization #5: Avoiding Metadata Bloat with Snapshot Expiration and Rewriting Manifests