DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Building an Automated Weather Data Pipeline with Apache Kafka and Cassandra
katumo profile

Building an Automated Weather Data Pipeline with Apache Kafka and Cassandra

#dataengineering #data #apachekafka
12
Comments
10 min read
Understanding Data Pipelines: The Backbone of Modern Data Systems
rithesh_raj_dd0391f0ba889 profile

Understanding Data Pipelines: The Backbone of Modern Data Systems

#dataengineering #etl #python #gcp
1
Comments
3 min read
🚀 Building an ETL Pipeline with Python to Scrape Internship Jobs and Load into Excel
dkkinyua profile

🚀 Building an ETL Pipeline with Python to Scrape Internship Jobs and Load into Excel

#dataengineering #python #programming
2
Comments 2
4 min read
Stock Data Extraction Using Apache Kafka
milcah03 profile

Stock Data Extraction Using Apache Kafka

#apachekafka #python #cassandra #dataengineering
6
Comments
4 min read
Time of YAML/JSON for data engineer
kination profile

Time of YAML/JSON for data engineer

#dataengineering #programming #config
1
Comments
2 min read
Building Automated Data Reports from Supabase with GitHub Actions and R Markdown
akandee_ profile

Building Automated Data Reports from Supabase with GitHub Actions and R Markdown

#automation #analytics #dataengineering #tutorial
2
Comments
12 min read
"Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style
datasosneh profile

"Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style

#go #kafka #eventdriven #dataengineering
1
Comments
10 min read
How to Optimize SQL Queries for Speed and Efficiency
bikodes profile

How to Optimize SQL Queries for Speed and Efficiency

#sql #sqlserver #database #dataengineering
3
Comments 2
5 min read
Building an Automated Bitcoin Price ETL Pipeline with Airflow and PostgreSQL
katumo profile

Building an Automated Bitcoin Price ETL Pipeline with Airflow and PostgreSQL

#dataengineering #data #apacheairflow
3
Comments
3 min read
Apache Airflow for Data Engineering: Best Practices and Real-World Examples
katumo profile

Apache Airflow for Data Engineering: Best Practices and Real-World Examples

#dataengineering #data #apacheairflow
6
Comments 1
7 min read
Stop flattening your JSON just to export it to Excel
alexandretsumanuel profile

Stop flattening your JSON just to export it to Excel

#python #excel #programming #dataengineering
Comments
2 min read
Azure Data Factory
madgan95 profile

Azure Data Factory

#azure #dataengineering #beginners #basic
7
Comments
1 min read
SQLite Database GUI Tool | Design and Visualize with DbSchema
roxana_haidiner profile

SQLite Database GUI Tool | Design and Visualize with DbSchema

#database #sql #dataengineering #development
9
Comments 1
4 min read
Amazon Redshift Data Warehousing (Sample Project)
katumo profile

Amazon Redshift Data Warehousing (Sample Project)

#database #dataengineering #data
4
Comments
2 min read
Pair and Transpose Adjacent Records within the Group - From SQL to SPL #13
judith677 profile

Pair and Transpose Adjacent Records within the Group - From SQL to SPL #13

#database #dataengineering #sql #esprocspl
6
Comments 1
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.