DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
TDD for dbt: unit testing the way it should be
niclasolofsson profile

TDD for dbt: unit testing the way it should be

#codequality #dataengineering #softwareengineering #testing
2
Comments
12 min read
When code-gen suggests deprecated Pandas APIs: a case study in subtle breakage
gabrieal845 profile

When code-gen suggests deprecated Pandas APIs: a case study in subtle breakage

#codequality #dataengineering #llm #python
Comments
3 min read
Schema, COPY, MERGE, and Immutability — A First-Principles Guide for Data Engineers
shrinivasv73 profile

Schema, COPY, MERGE, and Immutability — A First-Principles Guide for Data Engineers

#dataengineering
Comments
5 min read
HackerRank 'The Pads' MySQL
carol_caillaud profile

HackerRank 'The Pads' MySQL

#dataengineering #beginners #sql #mysql
Comments
3 min read
🔥 Day 5: Introduction to DataFrames - The Most Importantce of Spark API
sandeepk27 profile

🔥 Day 5: Introduction to DataFrames - The Most Importantce of Spark API

#dataengineering #python #spark #bigdata
Comments
2 min read
Generating Table Schema from AWS Glue Table
dendihandian profile

Generating Table Schema from AWS Glue Table

#aws #athena #dataengineering #sql
2
Comments
1 min read
Comparing Great Expectations and CsvPath Framework
david_kershaw_b6916404da6 profile

Comparing Great Expectations and CsvPath Framework

#data #dataengineering #csv #database
Comments
8 min read
Financial Transaction Data Reconciler PayPal
elianalamhost profile

Financial Transaction Data Reconciler PayPal

#systemdesign #distributedsystems #dataengineering #aws
Comments
5 min read
Streamlit desde cero: cĂłmo crear una app para explorar y visualizar datos
mirinagonzales profile

Streamlit desde cero: cĂłmo crear una app para explorar y visualizar datos

#python #streamlit #datascience #dataengineering
3
Comments
4 min read
Introducing dremioframe - A Pythonic DataFrame Interface for Dremio
alexmercedcoder profile

Introducing dremioframe - A Pythonic DataFrame Interface for Dremio

#python #database #dataengineering #tooling
Comments
9 min read
Stifel Modern Data Platform
elianalamhost profile

Stifel Modern Data Platform

#architecture #aws #dataengineering
Comments
4 min read
Core Microsoft Fabric Concepts
sajjadrahman56 profile

Core Microsoft Fabric Concepts

#dp600 #microsoft #dataengineering #microsoftfabric
1
Comments
3 min read
Implementing a CDC pipeline with Debezium
eric_kahindi_cfbfda3bd0f7 profile

Implementing a CDC pipeline with Debezium

#python #postgres #dataengineering #architecture
Comments
8 min read
End-to-End Real-Time Data Engineering on Databricks Using Spark Structured Streaming and Delta Lake
ktnl profile

End-to-End Real-Time Data Engineering on Databricks Using Spark Structured Streaming and Delta Lake

#dataengineering #handson #realtimeproject #spark
1
Comments
1 min read
Building Bulletproof Data Pipelines: Orchestration, Testing, and Monitoring (Part 3 of 3)
karthikeyan_rajasekaran_c profile

Building Bulletproof Data Pipelines: Orchestration, Testing, and Monitoring (Part 3 of 3)

#dataengineering #dagster #dataquality #testing
1
Comments
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.