DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
I Built a Market Intelligence Agent That Operates a Data Platform Autonomously via MCP

I Built a Market Intelligence Agent That Operates a Data Platform Autonomously via MCP

1
Comments
2 min read
Building a simple data pipeline with GCS and Databricks Autoloader

Building a simple data pipeline with GCS and Databricks Autoloader

Comments
1 min read
Implementing a Centralized Metrics Layer with dbt and a Semantic Layer

Implementing a Centralized Metrics Layer with dbt and a Semantic Layer

Comments
9 min read
Rebuilding the national narrative with AI and Docker

Rebuilding the national narrative with AI and Docker

1
Comments
3 min read
Columnar Databases (ClickHouse/Snowflake)

Columnar Databases (ClickHouse/Snowflake)

1
Comments
8 min read
ClickHouse Native JSON Support in 2026: A PR-by-PR Analysis

ClickHouse Native JSON Support in 2026: A PR-by-PR Analysis

6
Comments 1
24 min read
How Linux is Used in Real-World Data Engineering

How Linux is Used in Real-World Data Engineering

1
Comments
3 min read
Part 12 - Superset Seeding and Dashboards 🎛️

Part 12 - Superset Seeding and Dashboards 🎛️

Comments
2 min read
Part 14 - Cloud Deployment and Lessons Learned ☁️

Part 14 - Cloud Deployment and Lessons Learned ☁️

Comments
2 min read
Part 7 - Spark Transform Local vs Cloud ⚡

Part 7 - Spark Transform Local vs Cloud ⚡

Comments
2 min read
Part 2 - Data Sources and Domain Model 📡

Part 2 - Data Sources and Domain Model 📡

Comments
2 min read
Part 6 - API Client Design and Reliability 🔁

Part 6 - API Client Design and Reliability 🔁

Comments
2 min read
Part 9 - dbt Project Setup and Contracts 🧱

Part 9 - dbt Project Setup and Contracts 🧱

Comments
1 min read
Part 11 - Dimensions and Fact Table 📊

Part 11 - Dimensions and Fact Table 📊

Comments
2 min read
Part 5 - Ingestion DAG and Raw Storage 📥

Part 5 - Ingestion DAG and Raw Storage 📥

Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.