DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Knowledge Graphs Beyond Fraud: The Substrate Insurance AI Actually Needs
vaibhav7387 profile

Knowledge Graphs Beyond Fraud: The Substrate Insurance AI Actually Needs

#database #ai #dataengineering #insurtech
Comments
3 min read
Your scraper isn't broken. The site changed, and it didn't tell you.
votiakov profile

Your scraper isn't broken. The site changed, and it didn't tell you.

#webscraping #dataengineering #monitoring #javascript
Comments 1
4 min read
Comparing the Permission Models of the Iceberg REST APIs Provided by Glue Data Catalog and S3 Tables
datapenguin profile

Comparing the Permission Models of the Iceberg REST APIs Provided by Glue Data Catalog and S3 Tables

#aws #dataengineering
5
Comments 2
9 min read
Your BigQuery bill is a query-shape problem. We cut one 72% in three weeks.
votiakov profile

Your BigQuery bill is a query-shape problem. We cut one 72% in three weeks.

#bigquery #gcp #dataengineering #sql
Comments 1
3 min read
Building a School Database with PostgreSQL: My SQL Week 2 Journey
angellicah_2ed8aa8f01f176 profile

Building a School Database with PostgreSQL: My SQL Week 2 Journey

#sql #postgressql #database #dataengineering
1
Comments
4 min read
The pipeline passed. The data still needs proof.
jerry_king_d0ee94a9bca82f profile

The pipeline passed. The data still needs proof.

#dataengineering #database #bigdata #lakehouse
Comments 2
3 min read
Consent-First AI: Build Systems You Trust
labyrinthanalytics profile

Consent-First AI: Build Systems You Trust

#ai #dataengineering #programming #devtools
Comments
6 min read
Why SQL Is Still the Most Important Skill for Data Engineers
akonagalla28 profile

Why SQL Is Still the Most Important Skill for Data Engineers

#dataengineering #sql #python #programming
Comments
3 min read
AI Data Lake and Lakehouse
jonisar profile

AI Data Lake and Lakehouse

#data #dataengineering #programmers #lakehouae
Comments
18 min read
Writing a native Polars plugin in Rust: PII masking with no per-row Python
fcarvajalbrown profile

Writing a native Polars plugin in Rust: PII masking with no per-row Python

#rust #polars #python #dataengineering
Comments 1
6 min read
One Copy, Two Engines: Architecting a Governed Lakehouse Across Fabric and Azure Databricks
gabrielhca profile

One Copy, Two Engines: Architecting a Governed Lakehouse Across Fabric and Azure Databricks

#dataengineering #azure #databricks #architecture
Comments
6 min read
# AI-Generated SQL Has a Silent Failure Problem. Here's a Way to Catch It.
chetanchirag24 profile

# AI-Generated SQL Has a Silent Failure Problem. Here's a Way to Catch It.

#sql #ai #dataengineering #machinelearning
Comments
5 min read
🔐 Storage Credentials in Databricks Unity Catalog (AWS) — The Security Backbone You Can't Ignore
dinakar_s profile

🔐 Storage Credentials in Databricks Unity Catalog (AWS) — The Security Backbone You Can't Ignore

#databricks #aws #dataengineering #deltlake
Comments
3 min read
Building and Deploying a Data Observability Dashboard on Databricks Apps
luke2907 profile

Building and Deploying a Data Observability Dashboard on Databricks Apps

#databricks #kafka #dataengineering #python
Comments
2 min read
They Gave Me a 20-Hour Take-Home. I Did It. I Got Ghosted.
datadriven profile

They Gave Me a 20-Hour Take-Home. I Did It. I Got Ghosted.

#dataengineering #career #interview #beginners
Comments
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.