DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Building a Dockerized Cryptocurrency ETL Pipeline with Apache Airflow
karen_langat_299784e2c330 profile

Building a Dockerized Cryptocurrency ETL Pipeline with Apache Airflow

#cryptocurrency #dataengineering #docker #postgres
1
Comments
4 min read
Python 101
renee_mumbi_w profile

Python 101

#ai #python #datascience #dataengineering
Comments
7 min read
A Beginners guide to Real-time Data Streaming with Apache Kafka
geraldm profile

A Beginners guide to Real-time Data Streaming with Apache Kafka

#beginners #kafka #datascience #dataengineering
2
Comments
6 min read
Building a Real-Time Kafka + Cassandra Pipeline
geraldm profile

Building a Real-Time Kafka + Cassandra Pipeline

#dataengineering #cassandra #kafka
1
Comments
6 min read
Beyond the SELECT: Mastering Advanced SQL for Surgical BI
dattasable profile

Beyond the SELECT: Mastering Advanced SQL for Surgical BI

#sql #businessintelligence #dataengineering #analytics
Comments
2 min read
Managed Iceberg: Optimizing a Modern Lakehouse
jonisar profile

Managed Iceberg: Optimizing a Modern Lakehouse

#data #dataengineering #devops #backend
Comments
16 min read
OLAP vs OLTP: What's the Difference and Why Does It Matter?
robert_njuguna profile

OLAP vs OLTP: What's the Difference and Why Does It Matter?

#luxdev #database #dataengineering
Comments
3 min read
How a 500 MB Buffer Killed Our Archival Job — And Why Streaming Fixed It
harishteens profile

How a 500 MB Buffer Killed Our Archival Job — And Why Streaming Fixed It

#dataengineering #go #kubernetes #performance
7
Comments 1
6 min read
Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms
hasanhaider profile

Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms

#aws #dataengineering #devops #infrastructure
Comments
9 min read
Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms
hasanhaider profile

Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms

#automation #aws #dataengineering #devops
Comments
9 min read
Streamlining ETL Pipelines with Docker and Docker Compose in Data Engineering
petermuriya profile

Streamlining ETL Pipelines with Docker and Docker Compose in Data Engineering

#automation #dataengineering #devops #docker
Comments
3 min read
Why PDF-Style RAG Fails on Structured Enterprise Data
zeeshan_ghazanfar_97 profile

Why PDF-Style RAG Fails on Structured Enterprise Data

#ai #database #dataengineering #rag
Comments 1
1 min read
keep your snapshots simple
shrouwoods profile

keep your snapshots simple

#dbt #snapshots #type2scd #dataengineering
1
Comments
10 min read
I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.
niclydon profile

I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.

#apple #postgres #privacy #dataengineering
1
Comments 1
6 min read
DatAasee 0.9 Released
gramian profile

DatAasee 0.9 Released

#metadata #lakehouse #dataengineering #database
Comments
1 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.