DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Reproducible Benchmarks for Web-Access APIs: A Five-Layer Design
nativeport profile

Reproducible Benchmarks for Web-Access APIs: A Five-Layer Design

#abotwrotethis #ai #testing #dataengineering
Comments
6 min read
AI-First vs AI-Native: The Architecture Decision Most Enterprises Get Wrong
laura_williams profile

AI-First vs AI-Native: The Architecture Decision Most Enterprises Get Wrong

#dataengineering #ai #aifirst
Comments
5 min read
Why Apache Airflow Instead of Cron? A Deep Dive Into How Airflow Actually Schedules Your DAGs
maithreyan11 profile

Why Apache Airflow Instead of Cron? A Deep Dive Into How Airflow Actually Schedules Your DAGs

#airflow #dataengineering #python #etl
Comments
4 min read
Build a Data Lake on S3-Compatible Storage
ethan-carter profile

Build a Data Lake on S3-Compatible Storage

#datalake #s3 #objectstorage #dataengineering
2
Comments
7 min read
97% of Data Engineers Are Burned Out. Here's the Data.
datadriven profile

97% of Data Engineers Are Burned Out. Here's the Data.

#dataengineering #career #interview #beginners
1
Comments
7 min read
Blocking Key Design for Entity Resolution: Why Name Normalization Fails East Asian Corporate Data
hannune profile

Blocking Key Design for Entity Resolution: Why Name Normalization Fails East Asian Corporate Data

#python #dataengineering #graphs #machinelearning
1
Comments
4 min read
Two domains are 53% of the Databricks Data Engineer Associate exam
nicheelab profile

Two domains are 53% of the Databricks Data Engineer Associate exam

#databricks #dataengineering #certification #sql
Comments
4 min read
I built the "anti-Elementary" for dbt data quality and here's why
rbmuller profile

I built the "anti-Elementary" for dbt data quality and here's why

#python #dbt #opensource #dataengineering
Comments
5 min read
Why Spark Couldn't Read from Kafka: A Real Debugging Journey Across PySpark, Hadoop, Docker, and Kafka
lee_yao_cfeb14fb9b141b8c5 profile

Why Spark Couldn't Read from Kafka: A Real Debugging Journey Across PySpark, Hadoop, Docker, and Kafka

#dataengineering #apachekafka #apachespark #docker
Comments
10 min read
Agentic AI and big data: what your platform needs before agents are useful
zephico profile

Agentic AI and big data: what your platform needs before agents are useful

#ai #dataengineering #databricks
Comments
6 min read
AmaliTech Apprenticeship Program (AAP) (AAP)
rukundokevin profile

AmaliTech Apprenticeship Program (AAP) (AAP)

#bootcamp #devops #dataengineering #career
Comments
2 min read
My First GitHub Project: From a Local Folder to GitHub Using Git and SSH
muoks_102 profile

My First GitHub Project: From a Local Folder to GitHub Using Git and SSH

#github #dataengineering #git
Comments 1
2 min read
My First GitHub Project: From a Local Folder to GitHub Using Git and SSH
prudence_korir_ profile

My First GitHub Project: From a Local Folder to GitHub Using Git and SSH

#git #github #dataengineering
Comments 1
2 min read
Why I stopped guessing at Spark and dbt config values
dorfarber profile

Why I stopped guessing at Spark and dbt config values

#dataengineering #dbt #apachespark #sideprojects
Comments
3 min read
How to integrate Apache Airflow with OpenLineage for end-to-end traceability
laura_cristinachicovisd profile

How to integrate Apache Airflow with OpenLineage for end-to-end traceability

#airflow #dataengineering #openlineage #datalineage
1
Comments 2
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.