DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to treat secure data on lakehouse
kination profile

How to treat secure data on lakehouse

#dataengineering #python #spark
1
Comments
3 min read
Building an Automated Weather Data Pipeline with Apache Kafka and Cassandra
katumo profile

Building an Automated Weather Data Pipeline with Apache Kafka and Cassandra

#dataengineering #data #apachekafka
12
Comments
10 min read
Understanding Data Pipelines: The Backbone of Modern Data Systems
rithesh_raj_dd0391f0ba889 profile

Understanding Data Pipelines: The Backbone of Modern Data Systems

#dataengineering #etl #python #gcp
1
Comments
3 min read
🚀 Building an ETL Pipeline with Python to Scrape Internship Jobs and Load into Excel
dkkinyua profile

🚀 Building an ETL Pipeline with Python to Scrape Internship Jobs and Load into Excel

#dataengineering #python #programming
2
Comments 2
4 min read
Stock Data Extraction Using Apache Kafka
milcah03 profile

Stock Data Extraction Using Apache Kafka

#apachekafka #python #cassandra #dataengineering
6
Comments
4 min read
Time of YAML/JSON for data engineer
kination profile

Time of YAML/JSON for data engineer

#dataengineering #programming #config
1
Comments
2 min read
Distributed Model Serving Patterns
iameminmammadov profile

Distributed Model Serving Patterns

#distributedsystems #mlops #machinelearning #dataengineering
1
Comments
4 min read
Building Automated Data Reports from Supabase with GitHub Actions and R Markdown
akandee_ profile

Building Automated Data Reports from Supabase with GitHub Actions and R Markdown

#automation #analytics #dataengineering #tutorial
1
Comments
12 min read
"Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style
datasosneh profile

"Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style

#go #kafka #eventdriven #dataengineering
1
Comments
10 min read
Apache SeaTunnel 2.3.8 JDBC Connector Development Guide
seatunnel profile

Apache SeaTunnel 2.3.8 JDBC Connector Development Guide

#softwaredevelopment #bigdata #dataengineering
Comments
12 min read
🐼 Pandas Too Slow? Try These Fast Python Libraries for Data Analysis
aleksei_aleinikov profile

🐼 Pandas Too Slow? Try These Fast Python Libraries for Data Analysis

#python #dataengineering #pandas #bigdata
Comments
1 min read
Architecting High-Performance Data Pipelines with Modern ETL | Spiral Mantra
karankumar profile

Architecting High-Performance Data Pipelines with Modern ETL | Spiral Mantra

#dataengineering #cloud #performance #bigdata
Comments
1 min read
How to Optimize SQL Queries for Speed and Efficiency
bikodes profile

How to Optimize SQL Queries for Speed and Efficiency

#sql #sqlserver #database #dataengineering
3
Comments 2
5 min read
Building an Automated Bitcoin Price ETL Pipeline with Airflow and PostgreSQL
katumo profile

Building an Automated Bitcoin Price ETL Pipeline with Airflow and PostgreSQL

#dataengineering #data #apacheairflow
3
Comments
3 min read
Apache Airflow for Data Engineering: Best Practices and Real-World Examples
katumo profile

Apache Airflow for Data Engineering: Best Practices and Real-World Examples

#dataengineering #data #apacheairflow
6
Comments 1
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.