Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DataDriven

Oct 22

SQL Ties Python at 58%: What It Means for Data Engineer Interviews

#dataengineering #sql #interview #career

8 min read

Koray Yalçın

Oct 22

HubSpot'tan Salesforce'a veri taşırken External ID, upsert ve ilişki sırası: Geliştirici notları

#crm #salesforce #dataengineering #api

8 min read

Firat Celik

Oct 22

DuckDB 2.0 vs Polars vs Spark on One Machine: 150M Rows Under a 4.5 GiB Cap

#duckdb #dataengineering #python #spark

13 min read

Prajakta Shende

Oct 22

What Breaks When You Migrate Petabytes: A Field Guide

#database #aws #googlecloud #dataengineering

4 min read

FetchSmith

Oct 22

PNG to JPEG saved 15-63% on a full-page screenshot, depending on the page. Cropping beat both.

#webscraping #api #javascript #dataengineering

4 min read

Daniel Ferraz

Oct 21

What AI Agents Taught Me About Building Databricks Apps

#ai #databricks #dataengineering #softwareengineering

7 min read

Japan Open Data Lab

Oct 22

Thought Experiment: If 100GB of structured/3D data could be losslessly compressed to 1GB, what would you build?

#discuss #architecture #dataengineering #database

3 min read

uzie

Oct 21

Six things that break when a data microservice goes to production

#python #fastapi #polars #dataengineering

4 min read

思源

Oct 22

Data Engineer Resume: How to Show Scale, Reliability, Cost

#career #dataengineering #resume #jobsearch

4 min read

Charan Reddy Rachumalla

Oct 21

Every Step Runs Inside poll(): The Kafka Consumer Flow, End to End

#kafka #java #distributedsystems #dataengineering

4 min read

Rupak Kulkarni

Oct 21

Testing PySpark Data Quality in CI: A Practical Retail Media Example

#pyspark #dataengineering #testing #githubactions

5 min read

Karan Pulyala

Oct 21

Auto Loader and Structured Streaming on Azure Databricks: Checkpoints, Schema Evolution, and Exactly-Once

#databricks #pyspark #dataengineering #azure

6 min read

Charan Reddy Rachumalla

Oct 21

Events In, Answers Out: One Pipeline From Kafka Stream to Iceberg Table

#kafka #flink #dataengineering #streamprocessing

3 min read

Hugo.H

Oct 21

I found a jean at 6 euros on a 46 euro market. The deal was the easy part. published: false

#webscraping #monitoring #dataengineering #automation

3 min read

Brian Mugo

Oct 21

Window Functions, Joins, CTEs and Subqueries in SQL: A Hospital Dataset Walkthrough.

#sql #postgres #dataengineering #database

9 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.