DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Phase 1: Document Ingestion - The Hidden Complexity Before Embeddings
surajrkhonde profile

Phase 1: Document Ingestion - The Hidden Complexity Before Embeddings

#ai #dataengineering #llm #rag
2
Comments
20 min read
Understanding Data in Data Engineering: A Comprehensive Guide
esthernaisimoi profile

Understanding Data in Data Engineering: A Comprehensive Guide

#beginners #data #dataengineering #tutorial
Comments
26 min read
What does a Data Engineer do in Production (No Hype)
agusmazzeo profile

What does a Data Engineer do in Production (No Hype)

#dataengineering #etl #analitycsengineering
Comments 1
2 min read
DuckDB: Python Dünyasının Gizli Gücü
vebendeakademi profile

DuckDB: Python Dünyasının Gizli Gücü

#database #dataengineering #datascience #python
Comments
4 min read
Quantitative Finance Doesn't Need Better Algorithms—It Needs Better Data Engineers
abdeladime_benali_98428b3 profile

Quantitative Finance Doesn't Need Better Algorithms—It Needs Better Data Engineers

#data #dataengineering #datascience #machinelearning
Comments
4 min read
Qué hace un Data Engineer en producción (sin humo)
agusmazzeo profile

Qué hace un Data Engineer en producción (sin humo)

#dataengineering #etl #analyticsengineering
Comments
2 min read
Day 28 of 100 Days of ClickHouse® – Understanding TTL (Time To Live) for Automated Data Lifecycle Management
kanishga_subramani_49ad73 profile

Day 28 of 100 Days of ClickHouse® – Understanding TTL (Time To Live) for Automated Data Lifecycle Management

#clickhouse #database #dataengineering #analytics
3
Comments
4 min read
Data Backfilling with Apache Airflow: Architectures and Implementations for Historical Data Processing
sudoruss profile

Data Backfilling with Apache Airflow: Architectures and Implementations for Historical Data Processing

#architecture #automation #data #dataengineering
2
Comments 1
3 min read
How I Added dbt Cloud to Coral — My Open Source Hackathon Journey
gaurang_bhatt_b6d91a19879 profile

How I Added dbt Cloud to Coral — My Open Source Hackathon Journey

#showdev #dataengineering #opensource #sql
1
Comments
2 min read
How AI Is Reshaping the Data Engineer Role in 2026
gnana_6392e836fd500a957dc profile

How AI Is Reshaping the Data Engineer Role in 2026

#dataengineering #aiskills #generativeai #llm
6
Comments
12 min read
ASF Project Spotlight: Apache Iceberg
wtrue profile

ASF Project Spotlight: Apache Iceberg

#architecture #data #dataengineering #opensource
Comments
10 min read
Capacity Governance in Microsoft Fabric: The Layer Most Teams Forget
prachibhende profile

Capacity Governance in Microsoft Fabric: The Layer Most Teams Forget

#msfabric #governance #dataengineering #capacitymonitoring
Comments
4 min read
Building a DAG Workflow Orchestration Engine from Scratch in Python
hajirufai profile

Building a DAG Workflow Orchestration Engine from Scratch in Python

#python #dataengineering #tutorial #opensource
Comments
5 min read
Data Normalization Across Dublin Rental Portals: How to Make Listings Comparable
caspar_bannink_3728f095d1 profile

Data Normalization Across Dublin Rental Portals: How to Make Listings Comparable

#data #dataengineering #sideprojects #webscraping
Comments
4 min read
I Built an Open Healthcare Data Dictionary with 100k+ ISO-11179 Terms — Here's What I Learned
season_mudbhary_7856e4083 profile

I Built an Open Healthcare Data Dictionary with 100k+ ISO-11179 Terms — Here's What I Learned

#dataengineering #dbt #database #dictionary
Comments 1
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.