DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Introducing ReelTrust: What if data engineering could solve our AI deepfakes problem?
aaronsteers profile

Introducing ReelTrust: What if data engineering could solve our AI deepfakes problem?

#ai #dataengineering #opensource
Comments
5 min read
Building a Production-Ready Data Pipeline on AWS: A Hands-On Guide for Data Engineers
wanjohichristopher profile

Building a Production-Ready Data Pipeline on AWS: A Hands-On Guide for Data Engineers

#aws #dataengineering #tutorial #architecture
2
Comments
3 min read
Who Needs Real-Time Streaming? Use Cases & Architecture Across Industries
vijaya_bhaskarv_ba95adf9 profile

Who Needs Real-Time Streaming? Use Cases & Architecture Across Industries

#systemdesign #dataengineering #performance #architecture
Comments
8 min read
From “I want automation” to “It runs”: 15 decisions for lead enrichment that actually execute
maybe_ai profile

From “I want automation” to “It runs”: 15 decisions for lead enrichment that actually execute

#automation #sales #dataengineering #ai
Comments
3 min read
Daft vs Ray Data: A Comprehensive Comparison for Multimodal Data Processing
yks profile

Daft vs Ray Data: A Comprehensive Comparison for Multimodal Data Processing

#dataengineering #aiops #distributedsystems #machinelearning
10
Comments
6 min read
End-to-End Data Workflow: Kestra, Redshift, and dbt Integration
fredmunjogu profile

End-to-End Data Workflow: Kestra, Redshift, and dbt Integration

#dataengineering #automation #tutorial #aws
4
Comments
9 min read
What Does a Data Engineer Do? Understanding the Role and Career Path
directdata_education_83e6 profile

What Does a Data Engineer Do? Understanding the Role and Career Path

#beginners #career #dataengineering
1
Comments
6 min read
Smart Invoice Analyzer — How I Automated Invoice Processing & Predicted Sales Using Machine Learning
sanjaydot profile

Smart Invoice Analyzer — How I Automated Invoice Processing & Predicted Sales Using Machine Learning

#python #businessintelligence #machinelearning #dataengineering
3
Comments
2 min read
How I Streamed Live Binance L2 Order Book Data on AWS for ~$10/Month
goodiegoody profile

How I Streamed Live Binance L2 Order Book Data on AWS for ~$10/Month

#aws #fintech #infrastructure #dataengineering
5
Comments
14 min read
Stop Waiting for the Cloud: Building a Hybrid SQL+Python Data Pipeline Locally with DuckDB
markolekic profile

Stop Waiting for the Cloud: Building a Hybrid SQL+Python Data Pipeline Locally with DuckDB

#python #sql #dataengineering #tooling
Comments
5 min read
Decommissioning the Dinosaur: A 4-Phase Playbook for Migrating Your Legacy Data Warehouse to Databricks
shubhojeet2001 profile

Decommissioning the Dinosaur: A 4-Phase Playbook for Migrating Your Legacy Data Warehouse to Databricks

#datascience #databricks #devops #dataengineering
Comments
4 min read
The Data Analytics Lifecycle
hammoudi_wissem_2a55b8cc2 profile

The Data Analytics Lifecycle

#dataengineering #analytics
Comments
3 min read
Set up an open-source AI analyst for PostgreSQL in 2 minutes
bagofwords profile

Set up an open-source AI analyst for PostgreSQL in 2 minutes

#ai #dataengineering #data #opensource
1
Comments
5 min read
The Semantic Gap in Data Quality: Why Your Monitoring is Lying to You
vivekjami profile

The Semantic Gap in Data Quality: Why Your Monitoring is Lying to You

#googlecloud #fivetran #python #dataengineering
1
Comments 1
7 min read
Azure Data Solutions: Data Factory, Synapse, Data Lake & Databricks Integration
borisgigovic profile

Azure Data Solutions: Data Factory, Synapse, Data Lake & Databricks Integration

#azure #dataengineering #analytics #databricks
2
Comments 1
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.