DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Data Engineering Uncovered: What It Is and Why It Matters
qvfagundes profile

Data Engineering Uncovered: What It Is and Why It Matters

#dataengineering #beginners #data #career
2
Comments 1
3 min read
The Three Phases of Data Pipelines
thanh_truong_a99577c6b879 profile

The Three Phases of Data Pipelines

#technology #dataengineering #systemdesign
Comments
4 min read
Architecture of a 6TB Media Pipeline: Engineering Real-Time Content at Bharat Drone Shakti
pranjal_csmedia profile

Architecture of a 6TB Media Pipeline: Engineering Real-Time Content at Bharat Drone Shakti

#architecture #dataengineering #performance #systemdesign
Comments
6 min read
Why Columnar Storage Makes Analytics Faster
quame_jnr1 profile

Why Columnar Storage Makes Analytics Faster

#analytics #database #dataengineering #performance
1
Comments
1 min read
Are Wide Tables Fast or Slow?
esproc_spl profile
Judy

Are Wide Tables Fast or Slow?

#database #dataengineering #performance #sql
5
Comments
4 min read
HOW TO GIT IT
shabex profile

HOW TO GIT IT

#luxdev #git #onboarding #dataengineering
Comments
3 min read
Tableau + Databricks at Scale: A Technical Guide for Managing 10,000+ Databases
ridwan_sassman_3d07 profile

Tableau + Databricks at Scale: A Technical Guide for Managing 10,000+ Databases

#analytics #architecture #database #dataengineering
Comments
5 min read
How to Set Up GPG Keys for an Existing GitHub Account (Step-by-Step)
rose1845 profile

How to Set Up GPG Keys for an Existing GitHub Account (Step-by-Step)

#git #github #dataengineering #softwareengineering
Comments
2 min read
Making AI Data Flows Visible: Building an Open-Source Tool to Understand SaaS & LLM Data Risk
harris_bashir_ac60ba5fff3 profile

Making AI Data Flows Visible: Building an Open-Source Tool to Understand SaaS & LLM Data Risk

#ai #dataengineering #privacy #opensource
1
Comments
3 min read
An Introduction to Git: Concepts, Commands, and Workflows
edmund_eryuba profile

An Introduction to Git: Concepts, Commands, and Workflows

#github #git #dataengineering #githubactions
Comments
4 min read
Apache Iceberg & the Open Data Stack: Why the Lakehouse is Real in 2026
dataformathub profile

Apache Iceberg & the Open Data Stack: Why the Lakehouse is Real in 2026

#news #dataengineering #lakehouse #iceberg
Comments
8 min read
Learning Git & GitHub as a Data Engineering Student at LuxDevHQ
peter_amoro_fccf1d029a084 profile

Learning Git & GitHub as a Data Engineering Student at LuxDevHQ

#beginners #dataengineering #git #github
Comments
3 min read
Apache Gravitino Introduction
datastrato-yue profile

Apache Gravitino Introduction

#architecture #database #dataengineering #opensource
Comments
5 min read
Why Data Engineers Are Becoming Agent Engineers
sateesh2020 profile

Why Data Engineers Are Becoming Agent Engineers

#agents #dataengineering #ai
Comments
3 min read
Tired of ETL Bottlenecks? Build a Logical Data Warehouse with SPL
esproc_spl profile
Judy

Tired of ETL Bottlenecks? Build a Logical Data Warehouse with SPL

#architecture #database #dataengineering #sql
5
Comments
11 min read
Dev List Digest for Apache Iceberg, Parquet, Polaris and Arrow: January 6–14, 2026
alexmercedcoder profile

Dev List Digest for Apache Iceberg, Parquet, Polaris and Arrow: January 6–14, 2026

#news #dataengineering #opensource
Comments
4 min read
Building a Near Real-Time Analytics Pipeline with AWS Zero-ETL
kienly profile

Building a Near Real-Time Analytics Pipeline with AWS Zero-ETL

#analytics #aws #database #dataengineering
Comments
4 min read
Geospatial Data Orchestration: Why Modern GIS Pipelines Require an Asset-Based Approach
pslawacki profile

Geospatial Data Orchestration: Why Modern GIS Pipelines Require an Asset-Based Approach

#datascience #dagster #dataengineering #geospatial
Comments
7 min read
Exploring the Potential of AWS Glue Python Shell as a Long-Running Batch Execution Environment
datapenguin profile

Exploring the Potential of AWS Glue Python Shell as a Long-Running Batch Execution Environment

#aws #dataengineering
3
Comments
7 min read
We're Manufacturing Dashboards & Data Nobody Uses (And the Data Proves It)
analyticspitfalls profile

We're Manufacturing Dashboards & Data Nobody Uses (And the Data Proves It)

#data #ai #dataengineering #dataops
Comments
4 min read
Conference Notes: How ML Powers LINE Services
evanlin profile

Conference Notes: How ML Powers LINE Services

#ai #dataengineering #datascience #machinelearning
Comments
5 min read
Modern Data Integration at Scale with Microsoft Fabric Connectors
anujrawat profile

Modern Data Integration at Scale with Microsoft Fabric Connectors

#analytics #azure #dataengineering #microsoft
Comments
3 min read
LINE Developer Meetup 13 (Part 1): Conference Notes from 2020/09/18
evanlin profile

LINE Developer Meetup 13 (Part 1): Conference Notes from 2020/09/18

#career #community #dataengineering #machinelearning
Comments
7 min read
JSONL is a seriously weird format!
david_kershaw_b6916404da6 profile

JSONL is a seriously weird format!

#data #programming #datascience #dataengineering
Comments
2 min read
How to Build Presto from Source - OSS Contribution Guide (Step by Step Tutorial)
saurabhmahawar profile

How to Build Presto from Source - OSS Contribution Guide (Step by Step Tutorial)

#opensource #presto #dataengineering #dataanalytics
Comments
7 min read
loading...