DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The 800 Million Weekly ChatGPT Users Who Are Just Getting Started
david_aronchick_ea415de50 profile

The 800 Million Weekly ChatGPT Users Who Are Just Getting Started

#aiadoption #datascience #machinelearning #dataengineering
Comments
5 min read
The Data Refinery: Why Apache Spark is the Engine Behind Real-World Big Data Use Cases
manishpodiyal profile

The Data Refinery: Why Apache Spark is the Engine Behind Real-World Big Data Use Cases

#bigdata #spark #pyspark #dataengineering
Comments
2 min read
Scaling data systems: How we process millions of records with Python
emotta profile

Scaling data systems: How we process millions of records with Python

#architecture #python #data #dataengineering
Comments
3 min read
Data Management Systems: Transactional to Analytical Architectures
edmund_eryuba profile

Data Management Systems: Transactional to Analytical Architectures

#database #dataengineering #datastructures #data
Comments
7 min read
OLAP vs OLTP: A Deep Dive into Database Processing Systems
karen_langat_299784e2c330 profile

OLAP vs OLTP: A Deep Dive into Database Processing Systems

#data #database #dataengineering #systemdesign
Comments
3 min read
Why ClickHouse Loves Append-Heavy Workloads
mohhddhassan profile

Why ClickHouse Loves Append-Heavy Workloads

#clickhouse #olap #databasearchitecture #dataengineering
3
Comments
4 min read
Apache Kafka: A Beginner's Guide to Key Concepts
robert_njuguna profile

Apache Kafka: A Beginner's Guide to Key Concepts

#database #dataengineering #ai #luxdev
5
Comments
5 min read
OLAP vs OLTP: Understanding the Backbone of Modern Data Systems
petermuriya profile

OLAP vs OLTP: Understanding the Backbone of Modern Data Systems

#data #database #dataengineering #systemdesign
1
Comments
2 min read
Apache Kafka and the Rise of Real-Time Data Streaming
peter_amoro_fccf1d029a084 profile

Apache Kafka and the Rise of Real-Time Data Streaming

#architecture #dataengineering #distributedsystems #systemdesign
1
Comments
4 min read
How Databricks Genie Turns Plain English Into SQL Code
lucy1 profile
Lucy

How Databricks Genie Turns Plain English Into SQL Code

#databricks #dataengineering #sql #ai
5
Comments
11 min read
I built a DuckDB extension to handle chemistry data without pandas or RDKit
nk_maker profile

I built a DuckDB extension to handle chemistry data without pandas or RDKit

#rust #duckdb #chemistry #dataengineering
Comments
5 min read
Training Data Provenance: The Manifest Diff That Explains the Hash
aicryptosystems profile

Training Data Provenance: The Manifest Diff That Explains the Hash

#ai #dataengineering #machinelearning #privacy
Comments
8 min read
I Analyzed 10 Million Records in 47 Seconds Using Python + DuckDB (No Spark, No Cloud)
dattasable profile

I Analyzed 10 Million Records in 47 Seconds Using Python + DuckDB (No Spark, No Cloud)

#sql #python #dataengineering #tutorial
2
Comments 1
3 min read
Performance and Apache Iceberg's Metadata
alexmercedcoder profile

Performance and Apache Iceberg's Metadata

#architecture #database #dataengineering #performance
Comments
7 min read
Stop Using Subqueries: 3 Advanced SQL CTE Patterns That Saved My Production Database
dattasable profile

Stop Using Subqueries: 3 Advanced SQL CTE Patterns That Saved My Production Database

#sql #database #dataengineering #programming
Comments 1
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.