DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Stock Data Extraction Using Apache Kafka

Stock Data Extraction Using Apache Kafka

6
Comments
4 min read
Time of YAML/JSON for data engineer

Time of YAML/JSON for data engineer

1
Comments
2 min read
Building Automated Data Reports from Supabase with GitHub Actions and R Markdown

Building Automated Data Reports from Supabase with GitHub Actions and R Markdown

2
Comments
12 min read
"Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style

"Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style

1
Comments
10 min read
🔬Public docker images Trivy scans as duckdb datas on Kaggle

🔬Public docker images Trivy scans as duckdb datas on Kaggle

Comments 7
1 min read
How to Optimize SQL Queries for Speed and Efficiency

How to Optimize SQL Queries for Speed and Efficiency

3
Comments 2
5 min read
Building an Automated Bitcoin Price ETL Pipeline with Airflow and PostgreSQL

Building an Automated Bitcoin Price ETL Pipeline with Airflow and PostgreSQL

3
Comments
3 min read
Apache Airflow for Data Engineering: Best Practices and Real-World Examples

Apache Airflow for Data Engineering: Best Practices and Real-World Examples

6
Comments 1
7 min read
Stop flattening your JSON just to export it to Excel

Stop flattening your JSON just to export it to Excel

Comments
2 min read
Azure Data Factory

Azure Data Factory

7
Comments
1 min read
SQLite Database GUI Tool | Design and Visualize with DbSchema

SQLite Database GUI Tool | Design and Visualize with DbSchema

9
Comments 1
4 min read
Amazon Redshift Data Warehousing (Sample Project)

Amazon Redshift Data Warehousing (Sample Project)

4
Comments
2 min read
Pair and Transpose Adjacent Records within the Group - From SQL to SPL #13

Pair and Transpose Adjacent Records within the Group - From SQL to SPL #13

6
Comments 1
2 min read
Calculate a Pair of Minimum Values that Meet the Criteria within the Group — From SQL to SPL #12

Calculate a Pair of Minimum Values that Meet the Criteria within the Group — From SQL to SPL #12

6
Comments 1
2 min read
[Snowflake's New Feature] Alert on New Data, and try with Monitoring Tasks and Dynamic Tables

[Snowflake's New Feature] Alert on New Data, and try with Monitoring Tasks and Dynamic Tables

3
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.