DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Streamlining ETL Pipelines with Docker and Docker Compose in Data Engineering
petermuriya profile

Streamlining ETL Pipelines with Docker and Docker Compose in Data Engineering

#automation #dataengineering #devops #docker
Comments
3 min read
Why PDF-Style RAG Fails on Structured Enterprise Data
zeeshan_ghazanfar_97 profile

Why PDF-Style RAG Fails on Structured Enterprise Data

#ai #database #dataengineering #rag
Comments 1
1 min read
Data Engineering Pipeline: Understanding ETL vs ELT
sudoruss profile

Data Engineering Pipeline: Understanding ETL vs ELT

#dataengineering #python #tutorial
3
Comments 1
2 min read
Foundational Concepts in Data Engineering Using an E-Commerce Platform Example
motanga profile
MJ-O

Foundational Concepts in Data Engineering Using an E-Commerce Platform Example

#architecture #beginners #data #dataengineering
1
Comments
8 min read
Linux Fundamentals for Data Engineering
kiplangat_brian profile

Linux Fundamentals for Data Engineering

#linux #dataengineering #postgres #beginners
1
Comments
6 min read
How to Query Parquet Files in Object Storage with BigQuery External Tables
mirlan_de profile

How to Query Parquet Files in Object Storage with BigQuery External Tables

#dataengineering #bigquery #opensource #tutorial
1
Comments 1
8 min read
From Dashboards to Autonomous Action: Why You Need to Attend Google Cloud Labs
joey_lynne profile

From Dashboards to Autonomous Action: Why You Need to Attend Google Cloud Labs

#googlecloud #agents #dataengineering
23
Comments
2 min read
I Just Wanted dbt State Without Another Account
sudo_pradip profile

I Just Wanted dbt State Without Another Account

#dbt #opensource #dataengineering #elt
3
Comments
2 min read
I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.
niclydon profile

I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.

#apple #postgres #privacy #dataengineering
1
Comments 1
6 min read
Add Data Quality Checks to Your Airflow DAG in 5 Minutes
vahid_saber_d47950be99729 profile

Add Data Quality Checks to Your Airflow DAG in 5 Minutes

#airflow #dataengineering #python #dataquality
Comments
3 min read
DatAasee 0.9 Released
gramian profile

DatAasee 0.9 Released

#metadata #lakehouse #dataengineering #database
Comments
1 min read
That Time One Field Change Took Down an Entire Production Pipeline
reetesh_kumar profile

That Time One Field Change Took Down an Entire Production Pipeline

#backend #dataengineering #distributedsystems #systemdesign
1
Comments
4 min read
Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published
amaranarun profile

Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published

#dataengineering #observability #mlops #dataquality
Comments
8 min read
Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs
lawrence_murithi profile

Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs

#docker #virtualmachine #virtualenvironment #dataengineering
Comments
8 min read
A Step-by-Step Starter Kit for Building a Data Quality Framework
balapriya profile

A Step-by-Step Starter Kit for Building a Data Quality Framework

#data #dataengineering #testing #tutorial
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.