DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Four Iceberg Tools, Three Agent Frameworks: What Ports, and What Doesn't
xbill profile

Four Iceberg Tools, Three Agent Frameworks: What Ports, and What Doesn't

#iceberg #aiagents #lakehouse #dataengineering
Comments
18 min read
Medallion architecture on Databricks: what actually matters
zephico profile

Medallion architecture on Databricks: what actually matters

#databricks #dataengineering
Comments
2 min read
The Airbyte Column Nobody Queries: Find Every Silent Sync Failure in 15 Minutes
mukesh_13 profile

The Airbyte Column Nobody Queries: Find Every Silent Sync Failure in 15 Minutes

#airbyte #dataengineering #elt #dataquality
1
Comments
4 min read
Looker Pricing in 2026: What Google Publishes, What You Actually Pay
harshit_colrows profile

Looker Pricing in 2026: What Google Publishes, What You Actually Pay

#dataengineering #database #ai #datascience
2
Comments
2 min read
One Table, Many Engines: Running BigQuery, Spark, and Trino on a Single Iceberg Copy
carlosrgomes profile

One Table, Many Engines: Running BigQuery, Spark, and Trino on a Single Iceberg Copy

#googlecloud #apacheiceberg #bigquery #dataengineering
2
Comments
14 min read
Your Extraction Pipeline Doesn't Need a Smarter Model. It Needs a Schema Contract Test.
datacpp_8185 profile

Your Extraction Pipeline Doesn't Need a Smarter Model. It Needs a Schema Contract Test.

#ai #python #llm #dataengineering
Comments
6 min read
The report says verified. Is the change safe to release?
jerry_king_d0ee94a9bca82f profile

The report says verified. Is the change safe to release?

#dataengineering #database #testing #agents
Comments
5 min read
Reproducible Benchmarks for Web-Access APIs: A Five-Layer Design
nativeport profile

Reproducible Benchmarks for Web-Access APIs: A Five-Layer Design

#abotwrotethis #ai #testing #dataengineering
Comments
6 min read
AI-First vs AI-Native: The Architecture Decision Most Enterprises Get Wrong
laura_williams profile

AI-First vs AI-Native: The Architecture Decision Most Enterprises Get Wrong

#dataengineering #ai #aifirst
Comments
5 min read
Why Apache Airflow Instead of Cron? A Deep Dive Into How Airflow Actually Schedules Your DAGs
maithreyan11 profile

Why Apache Airflow Instead of Cron? A Deep Dive Into How Airflow Actually Schedules Your DAGs

#airflow #dataengineering #python #etl
Comments
4 min read
56 fault-injection tests passed. The one that injected nothing failed.

Negative controls reveal flaky HLL estimators
ashg2099 profile

56 fault-injection tests passed. The one that injected nothing failed.

#dataengineering #python #testing #dbt
3
Comments 7
3 min read
Build a Data Lake on S3-Compatible Storage
ethan-carter profile

Build a Data Lake on S3-Compatible Storage

#datalake #s3 #objectstorage #dataengineering
2
Comments
7 min read
97% of Data Engineers Are Burned Out. Here's the Data.
datadriven profile

97% of Data Engineers Are Burned Out. Here's the Data.

#dataengineering #career #interview #beginners
1
Comments
7 min read
Blocking Key Design for Entity Resolution: Why Name Normalization Fails East Asian Corporate Data
hannune profile

Blocking Key Design for Entity Resolution: Why Name Normalization Fails East Asian Corporate Data

#python #dataengineering #graphs #machinelearning
1
Comments
4 min read
Nobody Warns You the Data Engineering Interview Isn't About Data Engineering
rahmanfrr profile

Nobody Warns You the Data Engineering Interview Isn't About Data Engineering

#dataengineering #interview #career #sql
Comments 3
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.