DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Your Scraper Returns 200 OK and Lies. Here's How to Catch It.
ismail_haddou profile

Your Scraper Returns 200 OK and Lies. Here's How to Catch It.

#ai #cybersecurity #dataengineering #webscraping
Comments
5 min read
Meet Apache Ossie: The Open Semantic Interchange Finds Its Home at the ASF
alexmercedcoder profile

Meet Apache Ossie: The Open Semantic Interchange Finds Its Home at the ASF

#news #data #dataengineering #opensource
2
Comments
21 min read
The limiting factor in physical AI isn't compute or architecture - it's data
yks profile

The limiting factor in physical AI isn't compute or architecture - it's data

#ai #robotics #dataengineering
Comments
4 min read
T-SQL on Microsoft Fabric - Episode 2: Grouping and Summarizing Data with GROUP BY and Aggregate Functions
lamkhac profile

T-SQL on Microsoft Fabric - Episode 2: Grouping and Summarizing Data with GROUP BY and Aggregate Functions

#dataengineering #fabric #microsoft #sql
Comments
3 min read
41/60 Days System Design Questions
thejoud1997 profile

41/60 Days System Design Questions

#abotwrotethis #dataengineering #backend #systemdesign
3
Comments 4
1 min read
# Modernizing the Pitch: Building an Automated SQL Data Quality and Transformation Pipeline for Multi-Club Scouting Platforms
ishak_ahmed_1ea86b2efd2b9 profile

# Modernizing the Pitch: Building an Automated SQL Data Quality and Transformation Pipeline for Multi-Club Scouting Platforms

#automation #data #dataengineering #sql
Comments
5 min read
Someone Rebuilt Apache Spark from Scratch. I Went to Find Out How.
jakkie_koekemoer profile

Someone Rebuilt Apache Spark from Scratch. I Went to Find Out How.

#dataengineering #distributedsystems #performance #systemdesign
2
Comments 1
5 min read
Day 62: Writing Custom ClickHouse® User-Defined Functions (UDFs) for Cleaner, Reusable SQL
kanishga_subramani_49ad73 profile

Day 62: Writing Custom ClickHouse® User-Defined Functions (UDFs) for Cleaner, Reusable SQL

#clickhouse #devops #database #dataengineering
5
Comments
6 min read
Fabric Business Events Just Became an Architecture Pattern
shai_karmani_2521c2f8e837 profile

Fabric Business Events Just Became an Architecture Pattern

#microsoftfabric #realtime #dataengineering #architecture
Comments
7 min read
Integrated Biological Data Collection Platform: An Architecture for Automated Curation of Public Repositories
jeferson0993 profile

Integrated Biological Data Collection Platform: An Architecture for Automated Curation of Public Repositories

#architecture #automation #dataengineering #science
Comments 1
4 min read
What Is the Best Bigeye Alternative in 2026?
iblaine profile

What Is the Best Bigeye Alternative in 2026?

#dataengineering #dataquality
Comments
8 min read
Sync PostgreSQL to MotherDuck with Sling
flarco profile

Sync PostgreSQL to MotherDuck with Sling

#postgres #duckdb #dataengineering #etl
Comments
6 min read
Key Foundational Concepts in Data Engineering
peter_amoro_fccf1d029a084 profile

Key Foundational Concepts in Data Engineering

#beginners #data #dataengineering #tutorial
Comments
5 min read
Why We Open-Sourced 14 Autonomous Data Engineering Agents
dataworkersteam profile

Why We Open-Sourced 14 Autonomous Data Engineering Agents

#dataengineering #ai #opensource #mcp
Comments
5 min read
Building an Incident Debugging Agent: What We've Learned So Far
dataworkersteam profile

Building an Incident Debugging Agent: What We've Learned So Far

#dataengineering #ai #opensource #mcp
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.