Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đ
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Metadata for win â Apache Parquet
Rahul Dubey
Rahul Dubey
Rahul Dubey
Follow
May 25 '24
Metadata for win â Apache Parquet
#
python
#
bigdata
#
datascience
#
dataengineering
Comments
Add Comment
5 min read
Remove unwanted partition data in Azure Synapse (SQL DW)
Ayush Kumar
Ayush Kumar
Ayush Kumar
Follow
Jun 24 '24
Remove unwanted partition data in Azure Synapse (SQL DW)
#
dataengineering
#
sqlserver
#
azure
1
 reaction
Comments
Add Comment
6 min read
Replacing Saas ETL with Python dlt: A painless experience for Yummy.eu
Aman Gupta
Aman Gupta
Aman Gupta
Follow
Jun 24 '24
Replacing Saas ETL with Python dlt: A painless experience for Yummy.eu
#
saasetl
#
dataengineering
#
python
2
 reactions
Comments
Add Comment
3 min read
Simplifying SDMX Data Integration with Python
Aman Gupta
Aman Gupta
Aman Gupta
Follow
Jun 24 '24
Simplifying SDMX Data Integration with Python
#
dataengineering
#
pipeline
#
etl
#
sdmx
2
 reactions
Comments
Add Comment
3 min read
Unlocking the Power of Large Language Models (LLMs): Your Ultimate Guide
FuturisticGeeks
FuturisticGeeks
FuturisticGeeks
Follow
Jun 24 '24
Unlocking the Power of Large Language Models (LLMs): Your Ultimate Guide
#
webdev
#
llm
#
python
#
dataengineering
6
 reactions
Comments
Add Comment
1 min read
Clustering vs Partitioning your Apache Iceberg Tables
Alex Merced
Alex Merced
Alex Merced
Follow
Jun 21 '24
Clustering vs Partitioning your Apache Iceberg Tables
#
database
#
datascience
#
dataengineering
#
data
7
 reactions
Comments
Add Comment
8 min read
From Messy Data to Super Mario Pipeline: My First Adventure in Data Engineering
Jampa Matos
Jampa Matos
Jampa Matos
Follow
Jun 20 '24
From Messy Data to Super Mario Pipeline: My First Adventure in Data Engineering
#
dataengineering
#
python
#
automation
#
sql
1
 reaction
Comments
Add Comment
12 min read
Database generated events: LiveSyncâs database connector vs CDC
Zak
Zak
Zak
Follow
for
Ably
Jun 20 '24
Database generated events: LiveSyncâs database connector vs CDC
#
database
#
dataengineering
#
architecture
4
 reactions
Comments
Add Comment
5 min read
The Data Professions
Mubarak Mohamed
Mubarak Mohamed
Mubarak Mohamed
Follow
Jun 20 '24
The Data Professions
#
data
#
datascience
#
dataengineering
#
datastructures
1
 reaction
Comments
Add Comment
3 min read
MySQL: Using and Enhancing `DATETIME` and `TIMESTAMP`
Salma
Salma
Salma
Follow
Jun 19 '24
MySQL: Using and Enhancing `DATETIME` and `TIMESTAMP`
#
mysql
#
database
#
data
#
dataengineering
1
 reaction
Comments
Add Comment
3 min read
Working with Parquet files in Java using Carpet
JerĂłnimo LĂłpez
JerĂłnimo LĂłpez
JerĂłnimo LĂłpez
Follow
Jun 19 '24
Working with Parquet files in Java using Carpet
#
parquet
#
java
#
bigdata
#
dataengineering
1
 reaction
Comments
1
 comment
6 min read
Analyzing Svenskalag Data using DBT and DuckDB
Carl Vander
Carl Vander
Carl Vander
Follow
Jun 17 '24
Analyzing Svenskalag Data using DBT and DuckDB
#
dataengineering
#
dbt
#
duckdb
#
football
1
 reaction
Comments
Add Comment
4 min read
How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop
Fady GA đ
Fady GA đ
Fady GA đ
Follow
Jun 17 '24
How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop
#
dataengineering
#
apachespark
#
data
#
opensource
12
 reactions
Comments
Add Comment
6 min read
Working with Dates and Times in SQL: Tips and Tricks
tinApyp
tinApyp
tinApyp
Follow
Jun 17 '24
Working with Dates and Times in SQL: Tips and Tricks
#
datascience
#
database
#
dataengineering
#
tutorial
Comments
Add Comment
3 min read
FastAPI for Data Applications: From Concept to Creation. Part I
Felipe de Godoy
Felipe de Godoy
Felipe de Godoy
Follow
Jun 14 '24
FastAPI for Data Applications: From Concept to Creation. Part I
#
fastapi
#
dataengineering
#
datascience
#
llmops
4
 reactions
Comments
Add Comment
5 min read
đ
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account