Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Daniel Ferraz

Oct 21

What AI Agents Taught Me About Building Databricks Apps

#ai #databricks #dataengineering #softwareengineering

7 min read

Japan Open Data Lab

Oct 22

Thought Experiment: If 100GB of structured/3D data could be losslessly compressed to 1GB, what would you build?

#discuss #architecture #dataengineering #database

3 min read

uzie

Oct 21

Six things that break when a data microservice goes to production

#python #fastapi #polars #dataengineering

4 min read

思源

Oct 22

Data Engineer Resume: How to Show Scale, Reliability, Cost

#career #dataengineering #resume #jobsearch

4 min read

Charan Reddy Rachumalla

Oct 21

Every Step Runs Inside poll(): The Kafka Consumer Flow, End to End

#kafka #java #distributedsystems #dataengineering

4 min read

Rupak Kulkarni

Oct 21

Testing PySpark Data Quality in CI: A Practical Retail Media Example

#pyspark #dataengineering #testing #githubactions

5 min read

Karan Pulyala

Oct 21

Auto Loader and Structured Streaming on Azure Databricks: Checkpoints, Schema Evolution, and Exactly-Once

#databricks #pyspark #dataengineering #azure

6 min read

Charan Reddy Rachumalla

Oct 21

Events In, Answers Out: One Pipeline From Kafka Stream to Iceberg Table

#kafka #flink #dataengineering #streamprocessing

3 min read

Hugo.H

Oct 21

I found a jean at 6 euros on a 46 euro market. The deal was the easy part. published: false

#webscraping #monitoring #dataengineering #automation

3 min read

Mazlum Tosun for Google Developer Experts

Oct 21

Don't mock BigQuery, test on BigQuery: the rewrite of BigTesty

#bigquery #googlecloud #dataengineering #testing

7 min read

Brian Mugo

Oct 21

Window Functions, Joins, CTEs and Subqueries in SQL: A Hospital Dataset Walkthrough.

#sql #postgres #dataengineering #database

9 min read

Mohammed Arshad Ansari

Oct 21

DuckDB vs Spark: which workloads actually need a cluster

#dataengineering #database #python #data

3 min read

Koray Yalçın

Oct 21

Pazarlama olaylarını sunucuda toplamak: Bir geliştiricinin kontrol listesi

#analytics #webdev #dataengineering #privacy

3 min read

Pangolinfo

Oct 21

I Registered Fresh Accounts on 5 Amazon Scraper APIs and Ran the Same Test on All of Them

#webscraping #dataengineering #api #python

8 min read

Seven Billion Analytics

Oct 21

Your BI Quote Is Really a Data Quote

#businessintelligence #dataengineering #analytics #budgeting

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.