Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Precise Data Extraction: Pattern-Based Partitioning for Structured Extraction
Sarah Guthals, PhD
Sarah Guthals, PhD
Sarah Guthals, PhD
Follow
for
Tensorlake
Oct 15 '25
Precise Data Extraction: Pattern-Based Partitioning for Structured Extraction
#
automation
#
dataengineering
#
llm
1
 reaction
Comments
Add Comment
3 min read
Apache Gravitino 1.0.0 — From Metadata Management to Contextual Engineering
Alex Yan
Alex Yan
Alex Yan
Follow
for
Datastrato
Oct 5 '25
Apache Gravitino 1.0.0 — From Metadata Management to Contextual Engineering
#
dataengineering
#
opensource
#
cloud
#
architecture
1
 reaction
Comments
Add Comment
7 min read
Chinese DBA's Story: Hu Zhonghao - The Journey of Becoming a DBA for Domestic Distributed Databases
XINZ
XINZ
XINZ
Follow
Oct 16 '25
Chinese DBA's Story: Hu Zhonghao - The Journey of Becoming a DBA for Domestic Distributed Databases
#
database
#
oracle
#
dataengineering
Comments
1
 comment
7 min read
Apache Kafka in Data engineering
Eden Wetende
Eden Wetende
Eden Wetende
Follow
Sep 17 '25
Apache Kafka in Data engineering
#
dataengineering
#
kafka
6
 reactions
Comments
1
 comment
1 min read
đź§System Design Roadmap for Data Engineers
Sajjad Rahman
Sajjad Rahman
Sajjad Rahman
Follow
Oct 17 '25
đź§System Design Roadmap for Data Engineers
#
database
#
dataengineering
#
systemdesign
#
beginners
4
 reactions
Comments
Add Comment
3 min read
Orchestrating and Observing Data Pipelines with Airflow, PostgreSQL, and Polar
Chandrashekhar Kachawa
Chandrashekhar Kachawa
Chandrashekhar Kachawa
Follow
Oct 15 '25
Orchestrating and Observing Data Pipelines with Airflow, PostgreSQL, and Polar
#
postgres
#
dataengineering
#
docker
#
devops
2
 reactions
Comments
Add Comment
3 min read
đź’Ą Polars vs. Pandas: Why Your Next ETL Pipeline Should Run on Rust (Part 1/5)
Narayan
Narayan
Narayan
Follow
Oct 14 '25
đź’Ą Polars vs. Pandas: Why Your Next ETL Pipeline Should Run on Rust (Part 1/5)
#
dataengineering
#
rust
#
python
#
performance
1
 reaction
Comments
Add Comment
2 min read
(â…ˇ) A Complete Guide to Core Data Warehouse Design Standards: From Layers, Types to Lifecycle
Apache SeaTunnel
Apache SeaTunnel
Apache SeaTunnel
Follow
Sep 12 '25
(â…ˇ) A Complete Guide to Core Data Warehouse Design Standards: From Layers, Types to Lifecycle
#
datascience
#
bigdata
#
datawarehouse
#
dataengineering
Comments
Add Comment
6 min read
Building Distributed Systems with Ray—Just Like Running a Restaurant
Nasim
Nasim
Nasim
Follow
Oct 14 '25
Building Distributed Systems with Ray—Just Like Running a Restaurant
#
dataengineering
#
architecture
#
tutorial
#
ray
1
 reaction
Comments
Add Comment
7 min read
The State of Apache Iceberg v4 - October 2025 Edition
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 14 '25
The State of Apache Iceberg v4 - October 2025 Edition
#
dataengineering
#
architecture
#
opensource
#
database
3
 reactions
Comments
Add Comment
6 min read
Data Automation: A Deep Dive
Amit
Amit
Amit
Follow
Oct 15 '25
Data Automation: A Deep Dive
#
bigdata
#
dataengineering
#
data
#
automation
1
 reaction
Comments
Add Comment
5 min read
TikTok Data Engineer Full 3-Round Interview
net programhelp
net programhelp
net programhelp
Follow
Oct 14 '25
TikTok Data Engineer Full 3-Round Interview
#
interview
#
dataengineering
#
tutorial
#
career
2
 reactions
Comments
Add Comment
4 min read
Why Data Partitioning Is Harder Than It Looks
DCT Technology Pvt. Ltd.
DCT Technology Pvt. Ltd.
DCT Technology Pvt. Ltd.
Follow
Sep 12 '25
Why Data Partitioning Is Harder Than It Looks
#
webdev
#
database
#
programming
#
dataengineering
1
 reaction
Comments
Add Comment
2 min read
Part 2: Snowflake's Autonomous Future
Taro.Matsui
Taro.Matsui
Taro.Matsui
Follow
Oct 13 '25
Part 2: Snowflake's Autonomous Future
#
dataengineering
#
ai
#
snowflake
Comments
Add Comment
8 min read
Collecting Africa’s Energy Insights:
Evalyn Njagi
Evalyn Njagi
Evalyn Njagi
Follow
Oct 12 '25
Collecting Africa’s Energy Insights:
#
dataengineering
#
data
#
automation
#
python
3
 reactions
Comments
Add Comment
4 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account