DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Deploying Apache Flink on a Kubernetes Cluster as an Alternative to GCP Dataflow
sharmukh profile

Deploying Apache Flink on a Kubernetes Cluster as an Alternative to GCP Dataflow

#flink #kubernetes #dataengineering #gcp
6
Comments
48 min read
# Power BI Data Modelling: A Great Path to Great Analysis
makorinyachaki profile

# Power BI Data Modelling: A Great Path to Great Analysis

#powerfuldevs #datascience #dataengineering #database
Comments
7 min read
How to Solve a Month-over-Month Churn SQL Interview Question
rahmanfrr profile
Rahman

How to Solve a Month-over-Month Churn SQL Interview Question

#sql #dataengineering #interviewprep #amazon
Comments
4 min read
IBM Bought Confluent for $11B. Then Fired 800 Engineers.
datadriven profile

IBM Bought Confluent for $11B. Then Fired 800 Engineers.

#dataengineering #career #interview #beginners
Comments
6 min read
The First Answer Is a Starting Position, Not a Verdict
raghavsharma_ profile

The First Answer Is a Starting Position, Not a Verdict

#ai #productivity #dataengineering #learning
Comments
4 min read
QUERY_HISTORY has no PARENT_QUERY_ID. Here's how I traced which statement inside a Snowflake procedure regressed anyway.
tracepointdata profile

QUERY_HISTORY has no PARENT_QUERY_ID. Here's how I traced which statement inside a Snowflake procedure regressed anyway.

#snowflake #sql #dataengineering #database
2
Comments 2
4 min read
Unity Catalog Is Becoming the Operating Layer for Enterprise Data Governance
laura_williams profile

Unity Catalog Is Becoming the Operating Layer for Enterprise Data Governance

#databricks #unitycatalog #datagovernance #dataengineering
1
Comments
5 min read
The Invisible Cost of Context Windows: Why Vector Databases Are Reaching Their Limits
abhishekninja_writer profile

The Invisible Cost of Context Windows: Why Vector Databases Are Reaching Their Limits

#machinelearning #vectordatabase #dataengineering #artificialintelligen
Comments
5 min read
Batch vs Streaming en Data Engineering: cĂłmo decidir en producciĂłn sin romper nada
agusmazzeo profile

Batch vs Streaming en Data Engineering: cĂłmo decidir en producciĂłn sin romper nada

#dataengineering #architecture #distributedsystems
Comments
3 min read
Four Iceberg Tools, Three Agent Frameworks: What Ports, and What Doesn't
xbill profile

Four Iceberg Tools, Three Agent Frameworks: What Ports, and What Doesn't

#iceberg #aiagents #lakehouse #dataengineering
Comments
18 min read
Medallion architecture on Databricks: what actually matters
zephico profile

Medallion architecture on Databricks: what actually matters

#databricks #dataengineering
Comments
2 min read
The Airbyte Column Nobody Queries: Find Every Silent Sync Failure in 15 Minutes
mukesh_13 profile

The Airbyte Column Nobody Queries: Find Every Silent Sync Failure in 15 Minutes

#airbyte #dataengineering #elt #dataquality
1
Comments
4 min read
Looker Pricing in 2026: What Google Publishes, What You Actually Pay
harshit_colrows profile

Looker Pricing in 2026: What Google Publishes, What You Actually Pay

#dataengineering #database #ai #datascience
2
Comments
2 min read
One Table, Many Engines: Running BigQuery, Spark, and Trino on a Single Iceberg Copy
carlosrgomes profile

One Table, Many Engines: Running BigQuery, Spark, and Trino on a Single Iceberg Copy

#googlecloud #apacheiceberg #bigquery #dataengineering
3
Comments
14 min read
Your Extraction Pipeline Doesn't Need a Smarter Model. It Needs a Schema Contract Test.
datacpp_8185 profile

Your Extraction Pipeline Doesn't Need a Smarter Model. It Needs a Schema Contract Test.

#ai #python #llm #dataengineering
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.