DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The Silent Bug That Exposed All Tenant Data in Databricks Unity Catalog
spkibe profile

The Silent Bug That Exposed All Tenant Data in Databricks Unity Catalog

#databricks #datamasking #dataengineering #unitycatalog
Comments
6 min read
Debugging a Multi-Container Airflow Pipeline: Kafka Network Isolation and the YAML Indentation Trap
lee_yao_cfeb14fb9b141b8c5 profile

Debugging a Multi-Container Airflow Pipeline: Kafka Network Isolation and the YAML Indentation Trap

#dataengineering #devops #docker #networking
Comments
7 min read
The Great Data Debate: Should You Build Your Warehouse Top-Down or Bottom-Up?
lawrence_murithi profile

The Great Data Debate: Should You Build Your Warehouse Top-Down or Bottom-Up?

#kimball #dataengineering #architecture
Comments
6 min read
Data Lake Architecture for Data Engineering Interviews
gowthampotureddi profile

Data Lake Architecture for Data Engineering Interviews

#python #sql #interview #dataengineering
Comments
44 min read
Building a Dockerized Cryptocurrency ETL Pipeline with Apache Airflow
karen_langat_299784e2c330 profile

Building a Dockerized Cryptocurrency ETL Pipeline with Apache Airflow

#cryptocurrency #dataengineering #docker #postgres
1
Comments
4 min read
Python 101
renee_mumbi_w profile

Python 101

#ai #python #datascience #dataengineering
Comments
7 min read
A Beginners guide to Real-time Data Streaming with Apache Kafka
geraldm profile

A Beginners guide to Real-time Data Streaming with Apache Kafka

#beginners #kafka #datascience #dataengineering
2
Comments
6 min read
Building a Real-Time Kafka + Cassandra Pipeline
geraldm profile

Building a Real-Time Kafka + Cassandra Pipeline

#dataengineering #cassandra #kafka
1
Comments
6 min read
Beyond the SELECT: Mastering Advanced SQL for Surgical BI
dattasable profile

Beyond the SELECT: Mastering Advanced SQL for Surgical BI

#sql #businessintelligence #dataengineering #analytics
Comments
2 min read
Managed Iceberg: Optimizing a Modern Lakehouse
jonisar profile

Managed Iceberg: Optimizing a Modern Lakehouse

#data #dataengineering #devops #backend
Comments
16 min read
ClickHouse Duplicates: Clean Your Results vs. Clean Your Storage
mohhddhassan profile

ClickHouse Duplicates: Clean Your Results vs. Clean Your Storage

#clickhouse #database #dataengineering #sql
3
Comments
3 min read
Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms
hasanhaider profile

Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms

#aws #dataengineering #devops #infrastructure
Comments
9 min read
Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms
hasanhaider profile

Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms

#automation #aws #dataengineering #devops
Comments
9 min read
Streamlining ETL Pipelines with Docker and Docker Compose in Data Engineering
petermuriya profile

Streamlining ETL Pipelines with Docker and Docker Compose in Data Engineering

#automation #dataengineering #devops #docker
Comments
3 min read
Why PDF-Style RAG Fails on Structured Enterprise Data
zeeshan_ghazanfar_97 profile

Why PDF-Style RAG Fails on Structured Enterprise Data

#ai #database #dataengineering #rag
Comments 1
1 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.