Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Vaibhav

Jul 14

Why 80% of Insurance AI Projects Stall — And It's Not the Model

#insurtech #ai #dataengineering #data

3 min read

Alex Merced

Jul 13

A Deep Dive Into File Compression: How Data Gets Smaller, Why Codecs Differ, and What to Actually Use in the Lakehouse

#data #dataengineering #infrastructure #performance

20 min read

Alex Merced

Jul 14

File Encryption for the Lakehouse: The Terminology, the Machinery, and the Hard Problem of Interoperable Encrypted Tables

#database #dataengineering #opensource #security

20 min read

Aki for AWS Community Builders

Jul 13

Verifying How IAM and Lake Formation Behave for the Glue REST Catalog and S3 Tables

#aws #dataengineering

8 min read

Alex Merced

Jul 13

A Reader's Guide to My Books: Which One to Pick Up, Depending on What You're Building

#ai #dataengineering #learning #softwaredevelopment

11 min read

Haji Rufai

Jun 9

I Built a Bloom Filter from Scratch in Pure Python and Finally Understood How Databases Skip Reading Data

#python #dataengineering #database #programming

6 min read

Firat Celik

Jun 9

# go-intake: Go-Native Streaming Data Ingestion Toolkit

#etl #dataengineering #go #opensource

3 min read

Paulet Wairagu

Jun 9

QN : Ingest Data with Dataflows Gen2 in Microsoft Fabric

#data #fabric #dataengineering

2 min read

Bob Oner

Jun 9

From Data Quality Checks to Analytics-Ready Parquet with Python

#python #etl #dataengineering #docker

8 min read

Alex Merced

Jul 13

Lakehouse Table Formats in 2026: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake, How They Work, Where They Stand, and Where They're Going

#architecture #database #dataengineering #opensource

22 min read

Alex Merced

Jul 13

The File Format Renaissance: Parquet, Lance, Vortex, Nimble, BtrBlocks, and the New Physics of Columnar Storage

#architecture #database #dataengineering #machinelearning

21 min read

Philip Hern

Jul 13

chapter 3 of ai-assisted data engineering is live

#ai #dataengineering #production #verification

2 min read

Debbie Shapiro

Jul 10

When LangGraph Succeeds but Silently Goes Wrong

#ai #machinelearning #dataengineering #llm

7 min read

Anthony Gicheru

Jun 9

Apache Kafka Explained: A Practical Beginner Guide for Data Engineers

#kafka #dataengineering #beginners #distributedsystems

9 min read

Paulet Wairagu

Jun 9

QN : Ingest and transform data in a lakehouse

#architecture #database #dataengineering #sql

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.