DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Como aprendi Apache Spark: revisitando uma jornada pela Engenharia de Dados
renanpyd profile

Como aprendi Apache Spark: revisitando uma jornada pela Engenharia de Dados

#spark #bigdata #dataengineering #opensource
1
Comments
4 min read
Your data engineer job description is trying to hire a team
sudeephazra profile

Your data engineer job description is trying to hire a team

#dataengineering #recruitment #interview
Comments
6 min read
Change Data Capture is the modern default for keeping systems in sync — challenged
letusai15 profile

Change Data Capture is the modern default for keeping systems in sync — challenged

#dataengineering #systemdesign #kafka #webdev
Comments
1 min read
How AI can investigate a 12 GB export without reading it into a prompt
jerry_king_d0ee94a9bca82f profile

How AI can investigate a 12 GB export without reading it into a prompt

#dataengineering #sql #ai #parquet
Comments
6 min read
How I Built a Two-Tier Data Platform in 9 Phases (Spark, Kafka, dbt, Kubernetes)
adnanphp profile
Adnan

How I Built a Two-Tier Data Platform in 9 Phases (Spark, Kafka, dbt, Kubernetes)

#dataengineering #spark #kafka #kubernetes
Comments
6 min read
Data apps, defined: levels, principles, and a scorecard builders can actually use
sangaraju1988 profile

Data apps, defined: levels, principles, and a scorecard builders can actually use

#dataengineering #ai #analytics #architecture
5
Comments 4
8 min read
Airbyte Pricing vs Estuary Pricing for High-Volume CDC
jaume_bogu_c05b19569765 profile

Airbyte Pricing vs Estuary Pricing for High-Volume CDC

#dataengineering #etl #cloud #database
15
Comments 1
8 min read
Auto CDF Moved the CDC Tax From Writes to Reads: Delta CDF vs Auto CDF vs Spark 4.2 CHANGES
firfircelik profile

Auto CDF Moved the CDC Tax From Writes to Reads: Delta CDF vs Auto CDF vs Spark 4.2 CHANGES

#dataengineering #databricks #spark #deltalake
4
Comments 5
9 min read
I turned Brazil's 73M-establishment company registry into second-fast lookups, with no server and no database
jeffev profile

I turned Brazil's 73M-establishment company registry into second-fast lookups, with no server and no database

#duckdb #python #opendata #dataengineering
Comments
3 min read
How to Prepare for a System Design Interview
gowthampotureddi profile

How to Prepare for a System Design Interview

#walkin #interview #designsystem #dataengineering
Comments 1
10 min read
EU SaaS Metrics Dashboard: Privacy-Friendly Product KPIs and Backend Counter Reconstruction
fluxh91 profile

EU SaaS Metrics Dashboard: Privacy-Friendly Product KPIs and Backend Counter Reconstruction

#observability #privacy #dataengineering
Comments
7 min read
Opening a Parquet file in the browser without losing decimals, big integers or timestamps
vedaforge_eng profile

Opening a Parquet file in the browser without losing decimals, big integers or timestamps

#parquet #dataengineering #javascript #data
1
Comments
2 min read
Power BI on Databricks Metric Views: a live connection, with the measures kept in Databricks
sergeisemenkov profile

Power BI on Databricks Metric Views: a live connection, with the measures kept in Databricks

#powerbi #databricks #semanticlayer #dataengineering
Comments
15 min read
Context, Not Models: What Actually Made AI BI Reliable
datatechbridge profile

Context, Not Models: What Actually Made AI BI Reliable

#ai #dataengineering #llm #sql
Comments
25 min read
Building a Data Audit Workbench That Holds Up in an Assessment
maref profile

Building a Data Audit Workbench That Holds Up in an Assessment

#compliance #dataengineering #audit
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.