Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
4 best opensource projects about big data you should try out
DMetaSoul
DMetaSoul
DMetaSoul
Follow
Mar 24 '22
4 best opensource projects about big data you should try out
#
opensource
#
dataengineering
#
bigdata
#
spark
16
 reactions
Comments
3
 comments
3 min read
A new unified streaming and batch table storage solution similar to iceberg/hudi/delta lake but with several new functions
DMetaSoul
DMetaSoul
DMetaSoul
Follow
Mar 17 '22
A new unified streaming and batch table storage solution similar to iceberg/hudi/delta lake but with several new functions
#
dataengineering
#
opensource
#
bigdata
#
programming
8
 reactions
Comments
Add Comment
2 min read
Kestra, infinitely scalable open source orchestration and scheduling platform.
Ludovic DEHON
Ludovic DEHON
Ludovic DEHON
Follow
for
Kestra
Feb 2 '22
Kestra, infinitely scalable open source orchestration and scheduling platform.
#
dataengineering
#
data
#
etl
#
opensource
5
 reactions
Comments
Add Comment
6 min read
Modern data warehouse patterns: ELT with Snowflake variants
biellls
biellls
biellls
Follow
Jan 29 '22
Modern data warehouse patterns: ELT with Snowflake variants
#
snowflake
#
dataengineering
#
etl
#
elt
9
 reactions
Comments
Add Comment
6 min read
Standing on the shoulders of giants. Part one: Airflow
biellls
biellls
biellls
Follow
Jan 21 '22
Standing on the shoulders of giants. Part one: Airflow
#
airflow
#
dataengineering
#
python
#
data
7
 reactions
Comments
Add Comment
5 min read
Data Engineering in Julia
Logan Kilpatrick
Logan Kilpatrick
Logan Kilpatrick
Follow
Jan 29 '22
Data Engineering in Julia
#
machinelearning
#
julia
#
dataengineering
#
julialang
4
 reactions
Comments
1
 comment
1 min read
How Engineering Teams Use RudderStack to Support Marketing
Team RudderStack
Team RudderStack
Team RudderStack
Follow
for
RudderStack
Jan 3 '22
How Engineering Teams Use RudderStack to Support Marketing
#
dataengineering
#
marketing
#
dataanalytics
#
datawarehouse
6
 reactions
Comments
Add Comment
7 min read
Extract csv data and load it to PostgreSQL using Meltano ELT
Jorge PM
Jorge PM
Jorge PM
Follow
Dec 22 '21
Extract csv data and load it to PostgreSQL using Meltano ELT
#
python
#
meltano
#
dataengineering
#
elt
12
 reactions
Comments
Add Comment
6 min read
Data Engineering Pipeline with AWS Step Functions, CodeBuild and Dagster
Tomas
Tomas
Tomas
Follow
Dec 30 '21
Data Engineering Pipeline with AWS Step Functions, CodeBuild and Dagster
#
aws
#
dagster
#
dataengineering
#
python
5
 reactions
Comments
6
 comments
10 min read
What Is Event-Driven Machine Learning?
Team RudderStack
Team RudderStack
Team RudderStack
Follow
for
RudderStack
Dec 17 '21
What Is Event-Driven Machine Learning?
#
eventdriven
#
machinelearning
#
cdp
#
dataengineering
6
 reactions
Comments
Add Comment
4 min read
Implementing Graceful Shutdown in Go
Team RudderStack
Team RudderStack
Team RudderStack
Follow
for
RudderStack
Nov 26 '21
Implementing Graceful Shutdown in Go
#
go
#
dataengineering
#
sre
#
database
15
 reactions
Comments
5
 comments
14 min read
Web Scraping Sprott U Fund with BS4 in 10 Lines of Code
CincyBC
CincyBC
CincyBC
Follow
Nov 24 '21
Web Scraping Sprott U Fund with BS4 in 10 Lines of Code
#
python
#
beautifulsoup
#
dataengineering
30
 reactions
Comments
Add Comment
3 min read
Data Engineering:Extract, Transform,and Load Using Talend Open Studio.
WanjohiChristopher
WanjohiChristopher
WanjohiChristopher
Follow
Oct 29 '21
Data Engineering:Extract, Transform,and Load Using Talend Open Studio.
#
dataengineering
#
etl
#
python
#
talend
22
 reactions
Comments
2
 comments
3 min read
Want To Learn MLOps?
Swapnil Pawar
Swapnil Pawar
Swapnil Pawar
Follow
Aug 16 '21
Want To Learn MLOps?
#
machinelearning
#
operations
#
dataengineering
#
mlops
13
 reactions
Comments
Add Comment
4 min read
Stream Your Database Changes with Change Data Capture
Taron Foxworth
Taron Foxworth
Taron Foxworth
Follow
Aug 11 '21
Stream Your Database Changes with Change Data Capture
#
dataengineering
#
database
#
cdc
#
eventstreamprocessing
10
 reactions
Comments
Add Comment
9 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account