Dataengineering - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Nov 11

How to get the full article text from an RSS feed (measured on 32 feeds: 13 need the web page)

#rss #webscraping #rag #dataengineering

9 min read

Nov 11

Why my dashboard tool checks its own numbers (and why I wrote it in Rust)

#opensource #rust #sql #dataengineering

2 min read

Shubham Baldava

Nov 11

Postgres to BigQuery CDC Tutorial: From the WAL to a Four-Part Table Name

#postgres #bigquery #dataengineering #tutorial

11 min read

Gio Rich

Nov 11

Finding EU organic coffee importers who can legally buy your green beans, with Python and the TRACES directory

#python #api #dataengineering #tutorial

5 min read

Nov 11

The Semantic Debt Trap: Why AI Cannot Query Your Raw Data Lakehouse

#dataengineering #ai #llm #dbt

2 min read

Aniket Abhishek Soni

Nov 11

GDPR is a Storage Problem: Implementing Hard Deletes in Apache Iceberg

#iceberg #dataengineering #aws #sql

4 min read

Eqvero

Nov 11

The SEC EDGAR Accession Number Trap: Disentangling Restatements and Comparative Reclassifications in Python

#python #dataengineering #finance

5 min read

Awiros

Nov 11

Ops analytics from an event stream: Kafka into ClickHouse without losing or double counting alerts

#kafka #clickhouse #go #dataengineering

11 min read

Rahul R

Nov 11

Liquid Clustering in Databricks on AWS: The Modern Alternative to Partitioning and Z-ORDER

#databricks #aws #bigdata #dataengineering

9 min read

Krishna Tangudu

Nov 11

The Replication Worked. The Cutover Didn’t. — Snowflake to Fabric, Part 4

#snowflake #microsoftfabric #iceberg #dataengineering

5 min read

BrowserAct

Nov 11

An accounting export should not close the invoice archive task

#python #architecture #testing #dataengineering

4 min read

BrowserAct

Nov 11

Store the date basis before joining merchant reports

#python #dataengineering #architecture #testing

4 min read

Arisyn

Nov 11

Stop Making Text-to-SQL Agents Rediscover Your Database Every Time

#ai #sql #dataengineering #architecture

6 min read

Nov 11

A Better Feedback Loop for PySpark ETL: Test It in a Container

#python #spark #dataengineering #tdd

5 min read

Nov 11

When AI Hallucinations Are Really Data Contract Failures

#ai #llm #dataengineering #architecture

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.