Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker
Tanmay
Tanmay
Tanmay
Follow
Jun 13
Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker
#
dataengineering
#
googlecloud
#
etl
#
sql
Comments
Add Comment
2 min read
Day 16: ClickHouse Dictionaries – Eliminating Expensive JOINs with High-Speed In-Memory Lookups
Kanishga Subramani
Kanishga Subramani
Kanishga Subramani
Follow
Jun 13
Day 16: ClickHouse Dictionaries – Eliminating Expensive JOINs with High-Speed In-Memory Lookups
#
clickhouse
#
database
#
dataengineering
#
devops
1
 reaction
Comments
Add Comment
4 min read
AI-Native Data Engineering: From ETL Pipelines to Agentic Data Serving
Aditya Somani
Aditya Somani
Aditya Somani
Follow
Jun 13
AI-Native Data Engineering: From ETL Pipelines to Agentic Data Serving
#
dataengineering
#
duckdb
#
ai
#
sql
Comments
Add Comment
12 min read
AMLA Is Coming Online: What the EU's New Anti–Money Laundering Authority Means for Builders and Regulators
Thomas
Thomas
Thomas
Follow
Jun 13
AMLA Is Coming Online: What the EU's New Anti–Money Laundering Authority Means for Builders and Regulators
#
fintech
#
regtech
#
compliance
#
dataengineering
Comments
Add Comment
7 min read
this is scary (day 0 of learning data engineering)
nain
nain
nain
Follow
Jun 13
this is scary (day 0 of learning data engineering)
#
beginners
#
career
#
dataengineering
#
learning
1
 reaction
Comments
Add Comment
1 min read
Snowflake or Databricks? An Honest Comparison (From 200+ Migrations)
Vaibhav
Vaibhav
Vaibhav
Follow
Jul 17
Snowflake or Databricks? An Honest Comparison (From 200+ Migrations)
#
snowflake
#
databricks
#
dataengineering
#
architecture
1
 reaction
Comments
1
 comment
3 min read
Data Engineering Described
John Otienoh
John Otienoh
John Otienoh
Follow
Jun 13
Data Engineering Described
#
dataengineering
#
data
#
intoductiontodataengineering
Comments
Add Comment
5 min read
Day 15 of #100DaysOfClickHouse: Mastering the ClickHouse Client
Kanishga Subramani
Kanishga Subramani
Kanishga Subramani
Follow
Jun 13
Day 15 of #100DaysOfClickHouse: Mastering the ClickHouse Client
#
clickhouse
#
sql
#
database
#
dataengineering
2
 reactions
Comments
Add Comment
2 min read
Why Metadata-Driven ETL Frameworks Scale Better Than Hardcoded Pipelines — and Where They Don't
Jaldeep Patel
Jaldeep Patel
Jaldeep Patel
Follow
Jun 13
Why Metadata-Driven ETL Frameworks Scale Better Than Hardcoded Pipelines — and Where They Don't
#
dataengineering
#
etl
#
sqlserver
#
dataarchitecture
Comments
Add Comment
2 min read
Real-Time vs Batch: Which Insurance Data Actually Needs to Be Live
Vaibhav
Vaibhav
Vaibhav
Follow
Jul 17
Real-Time vs Batch: Which Insurance Data Actually Needs to Be Live
#
dataengineering
#
architecture
#
streaming
#
insurtech
Comments
Add Comment
3 min read
Why Your Insurance Chatbot Failed (And What AI Agents Do Differently)
Vaibhav
Vaibhav
Vaibhav
Follow
Jul 17
Why Your Insurance Chatbot Failed (And What AI Agents Do Differently)
#
ai
#
insurtech
#
chatbot
#
dataengineering
Comments
Add Comment
4 min read
ClickHouse® Projections and Skip Indexes - The Hidden Query Optimization Challenge
Kanishga Subramani
Kanishga Subramani
Kanishga Subramani
Follow
Jun 13
ClickHouse® Projections and Skip Indexes - The Hidden Query Optimization Challenge
#
clickhouse
#
database
#
dataengineering
#
analytics
1
 reaction
Comments
Add Comment
2 min read
I Built a Streaming Window Aggregator in Pure Python and Finally Understood How Flink Handles Late Data
Haji Rufai
Haji Rufai
Haji Rufai
Follow
Jun 12
I Built a Streaming Window Aggregator in Pure Python and Finally Understood How Flink Handles Late Data
#
dataengineering
#
python
#
streaming
#
tutorial
Comments
Add Comment
7 min read
Why Audit Trails Matter in ClickHouse®: Building Accountability, Compliance, and Security
Kanishga Subramani
Kanishga Subramani
Kanishga Subramani
Follow
Jun 16
Why Audit Trails Matter in ClickHouse®: Building Accountability, Compliance, and Security
#
clickhouse
#
devops
#
database
#
dataengineering
2
 reactions
Comments
2
 comments
4 min read
Deepfakes Broke Insurance Fraud Detection — And the Fix Isn't a Better Image Detector
Vaibhav
Vaibhav
Vaibhav
Follow
Jul 16
Deepfakes Broke Insurance Fraud Detection — And the Fix Isn't a Better Image Detector
#
insurtech
#
ai
#
security
#
dataengineering
Comments
Add Comment
3 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account