DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Why PDF-Style RAG Fails on Structured Enterprise Data
zeeshan_ghazanfar_97 profile

Why PDF-Style RAG Fails on Structured Enterprise Data

#ai #database #dataengineering #rag
Comments 1
1 min read
keep your snapshots simple
shrouwoods profile

keep your snapshots simple

#dbt #snapshots #type2scd #dataengineering
1
Comments
10 min read
Foundational Concepts in Data Engineering Using an E-Commerce Platform Example
motanga profile
MJ-O

Foundational Concepts in Data Engineering Using an E-Commerce Platform Example

#architecture #beginners #data #dataengineering
1
Comments
8 min read
Data Engineering Pipeline: Understanding ETL vs ELT
sudoruss profile

Data Engineering Pipeline: Understanding ETL vs ELT

#dataengineering #python #tutorial
2
Comments
2 min read
How to Query Parquet Files in Object Storage with BigQuery External Tables
mirlan_de profile

How to Query Parquet Files in Object Storage with BigQuery External Tables

#dataengineering #bigquery #opensource #tutorial
1
Comments 1
8 min read
I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.
niclydon profile

I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.

#apple #postgres #privacy #dataengineering
1
Comments 1
6 min read
DatAasee 0.9 Released
gramian profile

DatAasee 0.9 Released

#metadata #lakehouse #dataengineering #database
Comments
1 min read
Add Data Quality Checks to Your Airflow DAG in 5 Minutes
vahid_saber_d47950be99729 profile

Add Data Quality Checks to Your Airflow DAG in 5 Minutes

#airflow #dataengineering #python #dataquality
Comments
3 min read
Managed Iceberg Data Lakes: A Guide
jonisar profile

Managed Iceberg Data Lakes: A Guide

#data #database #dataengineering #opensource
Comments
14 min read
That Time One Field Change Took Down an Entire Production Pipeline
reetesh_kumar profile

That Time One Field Change Took Down an Entire Production Pipeline

#backend #dataengineering #distributedsystems #systemdesign
1
Comments
4 min read
Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published
amaranarun profile

Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published

#dataengineering #observability #mlops #dataquality
Comments
8 min read
Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs
lawrence_murithi profile

Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs

#docker #virtualmachine #virtualenvironment #dataengineering
Comments
8 min read
A Step-by-Step Starter Kit for Building a Data Quality Framework
balapriya profile

A Step-by-Step Starter Kit for Building a Data Quality Framework

#data #dataengineering #testing #tutorial
Comments
6 min read
Data Series: Understanding ETL & Medallion Architecture — Part 1
deepak_shankar_4421c006b5 profile

Data Series: Understanding ETL & Medallion Architecture — Part 1

#architecture #beginners #dataengineering #tutorial
1
Comments
2 min read
Why Your ADF Pipeline Shows Success But Your Data Is Wrong
chandramouli_kondamudi_82 profile

Why Your ADF Pipeline Shows Success But Your Data Is Wrong

#azure #dataengineering #data #etl
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.