DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Designing a Layered YouTube Analytics Pipeline with AWS Bedrock (Architecture Overview)
geets_a1be902588b38e52740 profile

Designing a Layered YouTube Analytics Pipeline with AWS Bedrock (Architecture Overview)

#aws #llm #architecture #dataengineering
Comments
2 min read
Understanding schemas and data modelling in Power BI
grace_muthonimwangi_9281 profile

Understanding schemas and data modelling in Power BI

#analytics #beginners #dataengineering #microsoft
2
Comments
4 min read
Scaling Fuzzy Matching: From Local Scripts to Production Pipelines
siyana_hristova_900e581ee profile

Scaling Fuzzy Matching: From Local Scripts to Production Pipelines

#datascience #data #dataengineering #python
7
Comments
5 min read
Offloading Statistical Computations to BigQuery: Efficient EDA with Python and Seaborn
sekidaa profile

Offloading Statistical Computations to BigQuery: Efficient EDA with Python and Seaborn

#dataengineering #datascience #googlecloud #python
1
Comments
2 min read
Scaling Relationship Discovery Across 100,000+ Fields Without Breaking Compute
hello_arisyn_0dc948aa82b3 profile

Scaling Relationship Discovery Across 100,000+ Fields Without Breaking Compute

#scalablesystems #dataengineering #distributedsystems #bigdata
1
Comments 1
2 min read
AI Data Engineer Skills Deep-Dive: Entry-Level Reality + Senior Differentiators (Follow-up to Part 1)
panualaluusua profile

AI Data Engineer Skills Deep-Dive: Entry-Level Reality + Senior Differentiators (Follow-up to Part 1)

#dataengineering #finops #careerdevelopment
Comments
4 min read
Why Data Teams Still “Guess” Join Keys in 2026
hello_arisyn_0dc948aa82b3 profile

Why Data Teams Still “Guess” Join Keys in 2026

#dataengineering #dataarchitecture #dataintegration #technicaldebt
Comments 1
2 min read
How DiDi Scaled to Hundreds of Petabytes with Apache Ozone
wtrue profile

How DiDi Scaled to Hundreds of Petabytes with Apache Ozone

#architecture #dataengineering #opensource #performance
Comments
4 min read
Introduction to Linux for Data Engineers, Beginner Friendly Approach
kihoro_codes_c959f8c68a9c profile

Introduction to Linux for Data Engineers, Beginner Friendly Approach

#linux #dataengineering #datascience
Comments
2 min read
XLTable: Bringing the OLAP Experience Back to Excel on Modern Data Warehouses
xltable profile

XLTable: Bringing the OLAP Experience Back to Excel on Modern Data Warehouses

#excel #dataengineering #analytics #datawarehouse
Comments
4 min read
Stop Bad Data From Breaking Your Pipelines — A Python Data Quality Framework
kaviarasanmani profile

Stop Bad Data From Breaking Your Pipelines — A Python Data Quality Framework

#dataengineering #dataqualty #etl
Comments
3 min read
How to Implement Data Modelling in Power BI
gathurum profile

How to Implement Data Modelling in Power BI

#dataengineering #datascience #bigdata #beginners
2
Comments
2 min read
AI Data Engineer vs Data Engineer: What Actually Changed? (50+ Job Analysis)
panualaluusua profile

AI Data Engineer vs Data Engineer: What Actually Changed? (50+ Job Analysis)

#dataengineering #careerdevelopment #rag
Comments
4 min read
Mitigating 'Scraping Shock': Engineering Cost-Aware Data Pipelines
withatte profile

Mitigating 'Scraping Shock': Engineering Cost-Aware Data Pipelines

#webscraping #dataengineering #observability
Comments
5 min read
JSONPath Is In! The AI Assistant Will See You Now
david_kershaw_b6916404da6 profile

JSONPath Is In! The AI Assistant Will See You Now

#dataengineering #promptengineering #json #python
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.