Skip to content
Navigation menu
Search
Powered by
Search
Algolia
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
10 Future Apache Iceberg Developments to Look forward to in 2025
Alex Merced
Alex Merced
Alex Merced
Follow
Nov 25 '24
10 Future Apache Iceberg Developments to Look forward to in 2025
#
database
#
datascience
#
dataengineering
#
dataanalytics
Comments
Add Comment
13 min read
Creating Stripe Test Data in Python
Quinton
Quinton
Quinton
Follow
for
Airbyte
Dec 26 '24
Creating Stripe Test Data in Python
#
stripe
#
python
#
dataengineering
#
airbyte
2
reactions
Comments
Add Comment
4 min read
📊 AI Dashboard Builder: Create Insightful Dashboards just Droppping your Data
Pablo
Pablo
Pablo
Follow
Dec 15 '24
📊 AI Dashboard Builder: Create Insightful Dashboards just Droppping your Data
#
dataengineering
#
datascience
#
llm
#
python
Comments
Add Comment
2 min read
Setting up memory for Flink - Configuration
kination
kination
kination
Follow
Nov 22 '24
Setting up memory for Flink - Configuration
#
dataengineering
#
flink
#
memory
#
tuning
Comments
Add Comment
3 min read
Are AWS Certifications Worth It in 2025?
SkillBoostTrainer
SkillBoostTrainer
SkillBoostTrainer
Follow
Dec 25 '24
Are AWS Certifications Worth It in 2025?
#
aws
#
awscertification
#
dataengineering
#
cloudservices
3
reactions
Comments
Add Comment
2 min read
Mastering Dynamic Allocation in Apache Spark: A Practical Guide with Real-World Insights
Vaibhav Shirpurkar
Vaibhav Shirpurkar
Vaibhav Shirpurkar
Follow
Nov 17 '24
Mastering Dynamic Allocation in Apache Spark: A Practical Guide with Real-World Insights
#
pyspark
#
spark
#
dataengineering
#
data
Comments
Add Comment
3 min read
Talend vs. Apache Kafka: Which Data Tool Drives Better Business Insights?
Hana Sato
Hana Sato
Hana Sato
Follow
Nov 13 '24
Talend vs. Apache Kafka: Which Data Tool Drives Better Business Insights?
#
datascience
#
devops
#
dataengineering
#
datastructures
Comments
Add Comment
6 min read
LightningChart Python 1.0
Omar Urbano | LightningChart
Omar Urbano | LightningChart
Omar Urbano | LightningChart
Follow
Nov 12 '24
LightningChart Python 1.0
#
python
#
datascience
#
dataengineering
#
datavisualization
Comments
Add Comment
1 min read
Introduction to Data lakes: The future of big data storage
Hiswill Thompson
Hiswill Thompson
Hiswill Thompson
Follow
Dec 14 '24
Introduction to Data lakes: The future of big data storage
#
bigdata
#
dataengineering
5
reactions
Comments
Add Comment
2 min read
Explorer l'API de 360Learning : de l'agilité de Power Query à la robustesse de la Modern Data Stack
Yann Barrault
Yann Barrault
Yann Barrault
Follow
for
Onepoint
Dec 14 '24
Explorer l'API de 360Learning : de l'agilité de Power Query à la robustesse de la Modern Data Stack
#
adventoftech2024
#
dataengineering
#
airbyte
#
dbt
7
reactions
Comments
Add Comment
12 min read
Data Pipeline Filters 101: Choosing Between Static and Dynamic Approaches
Muhammad Mahdi Ramadhan
Muhammad Mahdi Ramadhan
Muhammad Mahdi Ramadhan
Follow
Nov 9 '24
Data Pipeline Filters 101: Choosing Between Static and Dynamic Approaches
#
dataengineering
#
etl
#
dataanalyst
#
database
Comments
Add Comment
1 min read
The Apache Icebergâ„¢ Small File Problem
Danica Fine
Danica Fine
Danica Fine
Follow
Dec 11 '24
The Apache Icebergâ„¢ Small File Problem
#
bigdata
#
apacheiceberg
#
datalakehouse
#
dataengineering
6
reactions
Comments
Add Comment
3 min read
Ensuring Data Quality: Best Practices and Automation
BuzzGK
BuzzGK
BuzzGK
Follow
Nov 7 '24
Ensuring Data Quality: Best Practices and Automation
#
data
#
dataengineering
Comments
Add Comment
6 min read
Data Science Simplified: Tips for Aspiring Data Scientists in 2025
Vikas76
Vikas76
Vikas76
Follow
Nov 10 '24
Data Science Simplified: Tips for Aspiring Data Scientists in 2025
#
datascience
#
dataengineering
#
data
#
roadmap
1
reaction
Comments
Add Comment
4 min read
2025 Guide to Architecting an Iceberg Lakehouse
Alex Merced
Alex Merced
Alex Merced
Follow
Dec 9 '24
2025 Guide to Architecting an Iceberg Lakehouse
#
apacheiceberg
#
database
#
dataengineering
#
datascience
7
reactions
Comments
Add Comment
14 min read
Dremio, Apache Iceberg and their role in AI-Ready Data
Alex Merced
Alex Merced
Alex Merced
Follow
Nov 5 '24
Dremio, Apache Iceberg and their role in AI-Ready Data
#
database
#
dataengineering
#
datascience
#
dataanalytics
Comments
Add Comment
7 min read
Data Engineer as a Real-Time Algo Trader – Turning Pipelines into Profit (or at Least Trying)!
SNEHASISH DUTTA
SNEHASISH DUTTA
SNEHASISH DUTTA
Follow
Dec 9 '24
Data Engineer as a Real-Time Algo Trader – Turning Pipelines into Profit (or at Least Trying)!
#
sql
#
python
#
dataengineering
#
eventdriven
1
reaction
Comments
Add Comment
13 min read
Leveraging Python's Pattern Matching and Comprehensions for Data Analytics
Alex Merced
Alex Merced
Alex Merced
Follow
Nov 4 '24
Leveraging Python's Pattern Matching and Comprehensions for Data Analytics
#
python
#
datascience
#
dataengineering
#
database
Comments
Add Comment
12 min read
One Off to One Data Platform: Design with Intent [Part 2]
Lulu Cheng
Lulu Cheng
Lulu Cheng
Follow
for
jarrid.xyz
Dec 8 '24
One Off to One Data Platform: Design with Intent [Part 2]
#
data
#
architecture
#
dataengineering
#
startup
1
reaction
Comments
Add Comment
5 min read
Case Study: Creating an ETL Data Pipeline using AWS Services - Real-World Problem
M. Abdullah Bin Aftab
M. Abdullah Bin Aftab
M. Abdullah Bin Aftab
Follow
Dec 6 '24
Case Study: Creating an ETL Data Pipeline using AWS Services - Real-World Problem
#
aws
#
dataengineering
#
data
#
cloudcomputing
Comments
Add Comment
2 min read
Understanding Star Schema vs. Snowflake Schema
Puneet Verma
Puneet Verma
Puneet Verma
Follow
Nov 16 '24
Understanding Star Schema vs. Snowflake Schema
#
dataengineering
#
datascience
#
datamodeling
#
bigdata
Comments
Add Comment
1 min read
ChatGPT Launches Pro: What's it Mean for Data Professionals?
Anthony Clemons
Anthony Clemons
Anthony Clemons
Follow
Dec 5 '24
ChatGPT Launches Pro: What's it Mean for Data Professionals?
#
openai
#
chatgpt
#
datascience
#
dataengineering
2
reactions
Comments
Add Comment
4 min read
Introduction to Apache Kafka
Hiswill Thompson
Hiswill Thompson
Hiswill Thompson
Follow
Dec 5 '24
Introduction to Apache Kafka
#
datapipeline
#
dataengineering
#
realtimedat
3
reactions
Comments
1
comment
3 min read
Mastering Workflow Automation with Apache Airflow for Data Engineering
Aditya Pratap Bhuyan
Aditya Pratap Bhuyan
Aditya Pratap Bhuyan
Follow
Oct 31 '24
Mastering Workflow Automation with Apache Airflow for Data Engineering
#
dataengineering
#
apacheairflow
Comments
Add Comment
6 min read
Mastering Twitter Data Collection: A Comprehensive Guide to Efficient Scraping Solutions
kaito
kaito
kaito
Follow
Dec 3 '24
Mastering Twitter Data Collection: A Comprehensive Guide to Efficient Scraping Solutions
#
twitter
#
datascience
#
dataengineering
#
development
Comments
Add Comment
3 min read
loading...
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account