DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Two domains are 53% of the Databricks Data Engineer Associate exam
nicheelab profile

Two domains are 53% of the Databricks Data Engineer Associate exam

#databricks #dataengineering #certification #sql
Comments
4 min read
I built the "anti-Elementary" for dbt data quality and here's why
rbmuller profile

I built the "anti-Elementary" for dbt data quality and here's why

#python #dbt #opensource #dataengineering
Comments
5 min read
AI-Enhanced Data Pipelines: Integrating NVIDIA Triton Inference Server into Modern ETL Architectures
etloss profile

AI-Enhanced Data Pipelines: Integrating NVIDIA Triton Inference Server into Modern ETL Architectures

#ai #dataengineering #machinelearning #nvidia
1
Comments
4 min read
Why Spark Couldn't Read from Kafka: A Real Debugging Journey Across PySpark, Hadoop, Docker, and Kafka
lee_yao_cfeb14fb9b141b8c5 profile

Why Spark Couldn't Read from Kafka: A Real Debugging Journey Across PySpark, Hadoop, Docker, and Kafka

#dataengineering #apachekafka #apachespark #docker
Comments
10 min read
Agentic AI and big data: what your platform needs before agents are useful
zephico profile

Agentic AI and big data: what your platform needs before agents are useful

#ai #dataengineering #databricks
Comments
6 min read
My First GitHub Project: From a Local Folder to GitHub Using Git and SSH
muoks_102 profile

My First GitHub Project: From a Local Folder to GitHub Using Git and SSH

#github #dataengineering #git
Comments 1
2 min read
My First GitHub Project: From a Local Folder to GitHub Using Git and SSH
prudence_korir_ profile

My First GitHub Project: From a Local Folder to GitHub Using Git and SSH

#git #github #dataengineering
Comments 1
2 min read
Why I stopped guessing at Spark and dbt config values
dorfarber profile

Why I stopped guessing at Spark and dbt config values

#dataengineering #dbt #apachespark #sideprojects
Comments
3 min read
How to integrate Apache Airflow with OpenLineage for end-to-end traceability
laura_cristinachicovisd profile

How to integrate Apache Airflow with OpenLineage for end-to-end traceability

#airflow #dataengineering #openlineage #datalineage
1
Comments 2
6 min read
Why We Built MicroLeague Sports Vol. 3
esolar07 profile
Eddie

Why We Built MicroLeague Sports Vol. 3

#sportstech #web3 #dataengineering #architecture
Comments 1
9 min read
We tested "JSON-LD only" article extraction against 8 real news sites. It got 0.
fetchsmith profile

We tested "JSON-LD only" article extraction against 8 real news sites. It got 0.

#webscraping #api #javascript #dataengineering
Comments 1
7 min read
Model IoT Data Before You Store It: Device, Measurement, Timestamp
timecho profile

Model IoT Data Before You Store It: Device, Measurement, Timestamp

#iot #database #dataengineering #opensource
5
Comments
4 min read
Auditing FHIR Data Pipelines for Machine Learning Readiness with Python
eranyakula_yaswnth_b57142 profile

Auditing FHIR Data Pipelines for Machine Learning Readiness with Python

#cicd #dataengineering #machinelearning #python
Comments
1 min read
Ad Measurement Loses Events at Peak: Seams, Duplicate Keys, and the Bidder Join
ambrain profile

Ad Measurement Loses Events at Peak: Seams, Duplicate Keys, and the Bidder Join

#kafka #clickhouse #dataengineering #adtech
Comments 1
9 min read
Semantic Layer vs. Knowledge Graph: Choosing Your AI Data Foundation
nilesh_kumar profile

Semantic Layer vs. Knowledge Graph: Choosing Your AI Data Foundation

#dataengineering #database #ai #datascience
1
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.