Skip to content
Navigation menu
Search
Powered by
Search
Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
A Comprehensive Dive into the New Time-Series Storage Engine - Mito
Greptime
Greptime
Greptime
Follow
Nov 1 '23
A Comprehensive Dive into the New Time-Series Storage Engine - Mito
#
rust
#
database
#
dataengineering
#
greptime
2
reactions
Comments
Add Comment
5 min read
Dummy Variable Trap in Machine Learning
Jagroop Singh
Jagroop Singh
Jagroop Singh
Follow
Oct 31 '23
Dummy Variable Trap in Machine Learning
#
machinelearning
#
deeplearning
#
dataengineering
#
datapreprocessing
19
reactions
Comments
Add Comment
2 min read
Data Engineering For Beginners.
Christopher Ambala
Christopher Ambala
Christopher Ambala
Follow
Oct 31 '23
Data Engineering For Beginners.
#
dataengineering
#
datascience
#
data
#
datanerd
Comments
Add Comment
3 min read
Data Engineering for Beginners: A Step-by-Step Guide
Vee
Vee
Vee
Follow
Oct 30 '23
Data Engineering for Beginners: A Step-by-Step Guide
#
dataengineering
#
beginners
#
python
#
learning
Comments
1
comment
3 min read
[Free E-Book] The World of Vector Databases & AI Applications!
Pavan Belagatti
Pavan Belagatti
Pavan Belagatti
Follow
Oct 30 '23
[Free E-Book] The World of Vector Databases & AI Applications!
#
database
#
datascience
#
dataengineering
#
ai
35
reactions
Comments
Add Comment
3 min read
Why Python is best tool for data processing
Ivan Karabadzhak
Ivan Karabadzhak
Ivan Karabadzhak
Follow
Sep 30 '23
Why Python is best tool for data processing
#
python
#
programming
#
dataengineering
Comments
Add Comment
5 min read
Amazon Kinesis Data Streams (What is?, Benefits, Terminologies)
عبدالله عياد | Abdullah Ayad
عبدالله عياد | Abdullah Ayad
عبدالله عياد | Abdullah Ayad
Follow
for
AWS Community Builders
Oct 29 '23
Amazon Kinesis Data Streams (What is?, Benefits, Terminologies)
#
dataengineering
#
aws
#
cloud
#
serverless
4
reactions
Comments
Add Comment
2 min read
Data teams can deliver 10x better to the rest of us
MoRoth
MoRoth
MoRoth
Follow
Oct 29 '23
Data teams can deliver 10x better to the rest of us
#
dataengineering
#
productivity
#
terminal
#
softwareengineering
5
reactions
Comments
Add Comment
3 min read
6 judgment mistakes companies make when refusing data freelancers
adrian
adrian
adrian
Follow
Oct 27 '23
6 judgment mistakes companies make when refusing data freelancers
#
freelance
#
dataengineering
#
data
#
consulting
1
reaction
Comments
Add Comment
10 min read
Transfer SQL-> analytics 30x faster with ConnectorX + arrow + dlt
adrian
adrian
adrian
Follow
Oct 27 '23
Transfer SQL-> analytics 30x faster with ConnectorX + arrow + dlt
#
dataengineering
#
python
#
arrow
#
opensource
3
reactions
Comments
Add Comment
1 min read
Time Series Models for beginners complete guide
John Mambo
John Mambo
John Mambo
Follow
Oct 26 '23
Time Series Models for beginners complete guide
#
dsea
#
newbie
#
dataengineering
#
python
1
reaction
Comments
Add Comment
3 min read
TIME SERIES ANALYSIS.
Christopher Ambala
Christopher Ambala
Christopher Ambala
Follow
Oct 25 '23
TIME SERIES ANALYSIS.
#
datascience
#
datanerd
#
dataengineering
Comments
Add Comment
4 min read
Meet Bob 🙂 and his Databases exploration journey 🗺️! [Relational Databases - Basics - Theory]
Fady GA 😎
Fady GA 😎
Fady GA 😎
Follow
Oct 24 '23
Meet Bob 🙂 and his Databases exploration journey 🗺️! [Relational Databases - Basics - Theory]
#
dataengineering
#
database
#
beginners
#
learning
1
reaction
Comments
Add Comment
9 min read
Data Science for Beginners: 2023 - 2024 Complete Roadmap
Tim Mainge
Tim Mainge
Tim Mainge
Follow
Oct 23 '23
Data Science for Beginners: 2023 - 2024 Complete Roadmap
#
python
#
dataengineering
#
datascience
#
dataanalysis
Comments
Add Comment
4 min read
Redefining ETL: Data Flows Powered by C# (Part III)
Andreas Lennartz
Andreas Lennartz
Andreas Lennartz
Follow
Oct 11 '23
Redefining ETL: Data Flows Powered by C# (Part III)
#
etl
#
dotnet
#
dataengineering
#
database
Comments
Add Comment
12 min read
AWS Bedrock on Snowflake (Talk to Claude, LLAMA)
Kaarthik Andavar
Kaarthik Andavar
Kaarthik Andavar
Follow
Oct 18 '23
AWS Bedrock on Snowflake (Talk to Claude, LLAMA)
#
snowflake
#
aws
#
serverless
#
dataengineering
2
reactions
Comments
1
comment
3 min read
How best to learn RDBMS Part 1
Elvis Kwabena Asare Nkrumah
Elvis Kwabena Asare Nkrumah
Elvis Kwabena Asare Nkrumah
Follow
Oct 17 '23
How best to learn RDBMS Part 1
#
database
#
rdbms
#
dataengineering
2
reactions
Comments
Add Comment
2 min read
Log Analysis: Elasticsearch VS Apache Doris
Apache Doris
Apache Doris
Apache Doris
Follow
Oct 16 '23
Log Analysis: Elasticsearch VS Apache Doris
#
beginners
#
database
#
dataengineering
#
bigdata
2
reactions
Comments
Add Comment
11 min read
Scraping AliExpress with Python
Crawlbase
Crawlbase
Crawlbase
Follow
Oct 16 '23
Scraping AliExpress with Python
#
python
#
webdev
#
dataengineering
#
data
2
reactions
Comments
Add Comment
21 min read
Basics of data modelling and data models
ByteHouse
ByteHouse
ByteHouse
Follow
Oct 16 '23
Basics of data modelling and data models
#
datamodelling
#
dataengineering
#
businessintelligence
#
databasemanagement
1
reaction
Comments
Add Comment
3 min read
Exploratory Data Analysis Using Data Visualization Techniques 📊.
Samuel Musyoki
Samuel Musyoki
Samuel Musyoki
Follow
Oct 15 '23
Exploratory Data Analysis Using Data Visualization Techniques 📊.
#
datascience
#
luxdev
#
beginners
#
dataengineering
6
reactions
Comments
Add Comment
5 min read
Data Engineering Lifecycle - Basics - Theory
Fady GA 😎
Fady GA 😎
Fady GA 😎
Follow
Oct 15 '23
Data Engineering Lifecycle - Basics - Theory
#
dataengineering
#
beginners
#
learning
2
reactions
Comments
Add Comment
5 min read
Avoiding the DBT Monolith
elliott cordo
elliott cordo
elliott cordo
Follow
Oct 15 '23
Avoiding the DBT Monolith
#
dbt
#
datamesh
#
dataengineering
Comments
1
comment
3 min read
Running Jobs on Athena Spark
elliott cordo
elliott cordo
elliott cordo
Follow
for
AWS Heroes
Oct 13 '23
Running Jobs on Athena Spark
#
aws
#
awsbigdata
#
spark
#
dataengineering
3
reactions
Comments
Add Comment
2 min read
Data Product Possibilities and Opportunities!
Josue Luzardo Gebrim
Josue Luzardo Gebrim
Josue Luzardo Gebrim
Follow
Oct 12 '23
Data Product Possibilities and Opportunities!
#
news
#
datascience
#
dataengineering
#
productivity
Comments
Add Comment
2 min read
Redefining ETL: Data Flows Powered by C# (Part I)
Andreas Lennartz
Andreas Lennartz
Andreas Lennartz
Follow
Oct 11 '23
Redefining ETL: Data Flows Powered by C# (Part I)
#
etl
#
dotnet
#
dataengineering
#
database
12
reactions
Comments
Add Comment
11 min read
Data Analysis of the Titanic with Python!
Pavan Belagatti
Pavan Belagatti
Pavan Belagatti
Follow
Oct 10 '23
Data Analysis of the Titanic with Python!
#
python
#
datascience
#
dataengineering
#
database
56
reactions
Comments
1
comment
6 min read
Your Free and Offline SQL console in a few steps
Brice Fotzo
Brice Fotzo
Brice Fotzo
Follow
for
Docker
Oct 10 '23
Your Free and Offline SQL console in a few steps
#
devops
#
sql
#
database
#
dataengineering
1
reaction
Comments
Add Comment
5 min read
Event-Driven Architecture with Serverless Functions – Part 1
avital trifsik
avital trifsik
avital trifsik
Follow
for
Memphis.dev
Oct 9 '23
Event-Driven Architecture with Serverless Functions – Part 1
#
eventdriven
#
dataengineering
#
datastructures
#
dataprocessing
2
reactions
Comments
1
comment
5 min read
Exploratory data Analysis using Visualization Techniques
John Mambo
John Mambo
John Mambo
Follow
Oct 8 '23
Exploratory data Analysis using Visualization Techniques
#
dsea
#
newbie
#
datascience
#
dataengineering
1
reaction
Comments
1
comment
3 min read
Data Science for Beginners: 2023 - 2024 Complete Road Map
Roy-Wanyoike
Roy-Wanyoike
Roy-Wanyoike
Follow
Oct 5 '23
Data Science for Beginners: 2023 - 2024 Complete Road Map
#
datascience
#
dataengineering
#
python
Comments
Add Comment
3 min read
Data Science for Beginners: 2023-2024 Edition
Ogombo Collins
Ogombo Collins
Ogombo Collins
Follow
Oct 4 '23
Data Science for Beginners: 2023-2024 Edition
#
datascience
#
dataengineering
#
analyst
#
machinelearning
Comments
Add Comment
7 min read
Deploying ByConity with Kubernetes: A Step-by-Step Guide
Josh Alphonse
Josh Alphonse
Josh Alphonse
Follow
Oct 3 '23
Deploying ByConity with Kubernetes: A Step-by-Step Guide
#
dataengineering
#
kubernetes
#
datascience
#
database
Comments
Add Comment
5 min read
Data Science for Beginners: 2023 Complete Road Map
MykeShale
MykeShale
MykeShale
Follow
Oct 1 '23
Data Science for Beginners: 2023 Complete Road Map
#
datascience
#
dataengineering
1
reaction
Comments
Add Comment
3 min read
Data Science for Beginners: 2023 - 2024 Complete Road Map
Kasyoki Thano
Kasyoki Thano
Kasyoki Thano
Follow
Oct 1 '23
Data Science for Beginners: 2023 - 2024 Complete Road Map
#
datascience
#
data
#
dataengineering
Comments
Add Comment
2 min read
The Data Engineering Docker-Compose Starter Kit
Olga Braginskaya
Olga Braginskaya
Olga Braginskaya
Follow
Sep 22 '23
The Data Engineering Docker-Compose Starter Kit
#
docker
#
tutorial
#
development
#
dataengineering
13
reactions
Comments
Add Comment
13 min read
Sentiment Analysis Using Python: A Beginner-Friendly Tutorial!
Pavan Belagatti
Pavan Belagatti
Pavan Belagatti
Follow
Sep 11 '23
Sentiment Analysis Using Python: A Beginner-Friendly Tutorial!
#
python
#
datascience
#
dataengineering
#
tutorial
23
reactions
Comments
Add Comment
4 min read
Let’s Create an End-to-End Web Scraping Pipeline With Scrapy!
nanellooo
nanellooo
nanellooo
Follow
Sep 11 '23
Let’s Create an End-to-End Web Scraping Pipeline With Scrapy!
#
python
#
webscraping
#
sql
#
dataengineering
8
reactions
Comments
Add Comment
10 min read
Data Science for beginners 2023 - 2024 Complete Roadmap
John Mambo
John Mambo
John Mambo
Follow
Oct 2 '23
Data Science for beginners 2023 - 2024 Complete Roadmap
#
lux
#
dsea
#
datascience
#
dataengineering
Comments
2
comments
3 min read
SQL + Docker: The combo for Quick and Safe Query Testing
Brice Fotzo
Brice Fotzo
Brice Fotzo
Follow
for
Docker
Sep 8 '23
SQL + Docker: The combo for Quick and Safe Query Testing
#
devops
#
sql
#
dataengineering
#
docker
4
reactions
Comments
Add Comment
5 min read
Ultimate Guide: Best Books for Data Science with Ratings for All Levels
Imad
Imad
Imad
Follow
Sep 8 '23
Ultimate Guide: Best Books for Data Science with Ratings for All Levels
#
datascience
#
books
#
beginners
#
dataengineering
8
reactions
Comments
Add Comment
8 min read
10 NoSQL databases available as alternatives to MongoDB
Suresh Pattu
Suresh Pattu
Suresh Pattu
Follow
Sep 8 '23
10 NoSQL databases available as alternatives to MongoDB
#
mongodb
#
database
#
datascience
#
dataengineering
2
reactions
Comments
Add Comment
4 min read
A Beginner’s Guide to Building LLM-Powered Applications with LangChain!
Pavan Belagatti
Pavan Belagatti
Pavan Belagatti
Follow
Aug 30 '23
A Beginner’s Guide to Building LLM-Powered Applications with LangChain!
#
datascience
#
dataengineering
#
llm
#
database
94
reactions
Comments
8
comments
7 min read
Transactions and the ACID principle, going a little deeper.
Pedro H Goncalves
Pedro H Goncalves
Pedro H Goncalves
Follow
Sep 4 '23
Transactions and the ACID principle, going a little deeper.
#
database
#
beginners
#
acid
#
dataengineering
3
reactions
Comments
Add Comment
11 min read
Python Cheat Sheet for Data Engineers and Data Scientists!
Pavan Belagatti
Pavan Belagatti
Pavan Belagatti
Follow
Aug 31 '23
Python Cheat Sheet for Data Engineers and Data Scientists!
#
python
#
datascience
#
dataengineering
#
developers
69
reactions
Comments
Add Comment
3 min read
A Step-by-Step Guide to Implementing Data Version Control
Supratip Banerjee
Supratip Banerjee
Supratip Banerjee
Follow
for
AWS Community Builders
Sep 4 '23
A Step-by-Step Guide to Implementing Data Version Control
#
data
#
aws
#
dataengineering
#
database
6
reactions
Comments
Add Comment
4 min read
What's new and noteworthy on AWS - Summer 2023 edition
pmalmirae
pmalmirae
pmalmirae
Follow
for
AWS Community Builders
Aug 23 '23
What's new and noteworthy on AWS - Summer 2023 edition
#
dataengineering
#
serverless
#
devops
#
security
5
reactions
Comments
Add Comment
24 min read
KNIME Analytics Platform for Data Science-1
Chamindu Perera
Chamindu Perera
Chamindu Perera
Follow
Sep 2 '23
KNIME Analytics Platform for Data Science-1
#
datascience
#
dataengineering
#
ai
#
machinelearning
4
reactions
Comments
Add Comment
4 min read
Unlearning what you know about relational databases to unlock the power of Redshift
nelyanne
nelyanne
nelyanne
Follow
Sep 2 '23
Unlearning what you know about relational databases to unlock the power of Redshift
#
redshift
#
aws
#
dataengineering
#
data
Comments
Add Comment
4 min read
The Wrath of Unicron - When Airflow Gets Scary
elliott cordo
elliott cordo
elliott cordo
Follow
for
AWS Heroes
Aug 30 '23
The Wrath of Unicron - When Airflow Gets Scary
#
airflow
#
aws
#
dataengineering
#
datamesh
4
reactions
Comments
Add Comment
4 min read
End to End Netflix data analytics and recommendation system project using Microsoft Azure tools
Aman Gupta
Aman Gupta
Aman Gupta
Follow
Aug 29 '23
End to End Netflix data analytics and recommendation system project using Microsoft Azure tools
#
azure
#
dataengineering
#
netflix
#
programming
8
reactions
Comments
Add Comment
5 min read
Navigating the Data Engineering Landscape: From Raw Data to Insights
Leo Chashnikov
Leo Chashnikov
Leo Chashnikov
Follow
Aug 28 '23
Navigating the Data Engineering Landscape: From Raw Data to Insights
#
dataengineering
#
programming
#
learning
#
career
5
reactions
Comments
1
comment
7 min read
Machine learning 101
Uliana
Uliana
Uliana
Follow
Aug 23 '23
Machine learning 101
#
machinelearning
#
datascience
#
dataengineering
85
reactions
Comments
Add Comment
8 min read
Building ETL/ELT Pipelines For Data Engineers.
WanjohiChristopher
WanjohiChristopher
WanjohiChristopher
Follow
Aug 22 '23
Building ETL/ELT Pipelines For Data Engineers.
#
snowflake
#
dbt
#
airflow
#
dataengineering
5
reactions
Comments
2
comments
2 min read
Automating Talend Jobs Using Apache Airflow .
WanjohiChristopher
WanjohiChristopher
WanjohiChristopher
Follow
Aug 3 '23
Automating Talend Jobs Using Apache Airflow .
#
airflow
#
dataengineering
#
automation
#
data
6
reactions
Comments
Add Comment
3 min read
Data-aware Scheduling in Airflow: A Practical Guide with DAG Factory
Cícero Joasyo Mateus de Moura
Cícero Joasyo Mateus de Moura
Cícero Joasyo Mateus de Moura
Follow
for
AWS Community Builders
Jul 31 '23
Data-aware Scheduling in Airflow: A Practical Guide with DAG Factory
#
airflow
#
dagfactory
#
aws
#
dataengineering
6
reactions
Comments
Add Comment
6 min read
Automating Data Pipeline Deployment on AWS with Terraform: Utilizing Lambda, Glue, Crawler, Redshift, and S3
Stefen
Stefen
Stefen
Follow
Jul 26 '23
Automating Data Pipeline Deployment on AWS with Terraform: Utilizing Lambda, Glue, Crawler, Redshift, and S3
#
softwareengineering
#
dataengineering
#
aws
#
terraform
Comments
1
comment
8 min read
Push dbt beyond boundaries: Exploring a Fresh Approach to dbt Integration
Alexander D
Alexander D
Alexander D
Follow
Jul 25 '23
Push dbt beyond boundaries: Exploring a Fresh Approach to dbt Integration
#
dataengineering
#
datazencommunity
#
aws
#
data
1
reaction
Comments
Add Comment
1 min read
There is no Data Engineering roadmap
Al Brown
Al Brown
Al Brown
Follow
Jul 17 '23
There is no Data Engineering roadmap
#
dataengineering
#
beginners
#
career
#
database
2
reactions
Comments
Add Comment
5 min read
A mage on the Hero’s Journey: a fantasy epic on how a startup rose from the ashes
Mage
Mage
Mage
Follow
Jun 12 '23
A mage on the Hero’s Journey: a fantasy epic on how a startup rose from the ashes
#
startup
#
dataengineering
#
datapipelines
#
etl
6
reactions
Comments
Add Comment
9 min read
loading...
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account