DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Building a Practical Ecommerce Price Intelligence Pipeline
anakin_writers profile

Building a Practical Ecommerce Price Intelligence Pipeline

#webscraping #ecommerce #python #dataengineering
Comments
4 min read
Contract Versioning in Production Pipelines: Registry, CLI, and Run History
bobby_ray_581732c715283b2 profile

Contract Versioning in Production Pipelines: Registry, CLI, and Run History

#dataengineering #python #dataquality #airflow
Comments
3 min read
What Are the Best Practices for Databricks Medallion Architecture?
vachkov profile

What Are the Best Practices for Databricks Medallion Architecture?

#databricks #dataengineering #tutorial #medallionarchitectur
Comments
11 min read
How long does a Google trend stay alive? Measuring trend duration with started_at and ended_at
orbotshq profile

How long does a Google trend stay alive? Measuring trend duration with started_at and ended_at

#googletrends #dataengineering #api #automation
Comments
4 min read
AI-Driven Dynamic Pricing in Hotels: A Data Engineer's Deep Dive
airtruffle profile

AI-Driven Dynamic Pricing in Hotels: A Data Engineer's Deep Dive

#dynamicpricing #hoteltechnology #dataengineering #revenuemanagement
Comments
8 min read
Shopify Data in Databricks: A First Look at the New Lakeflow Connect Shopify Connector
lucy1 profile
Lucy

Shopify Data in Databricks: A First Look at the New Lakeflow Connect Shopify Connector

#databricks #shopify #dataengineering #ecommerce
8
Comments
10 min read
Your dashboard is green and the number is wrong: the SQL checks I schedule next to every metric
refaeldakar profile

Your dashboard is green and the number is wrong: the SQL checks I schedule next to every metric

#dataengineering #sql #analytics #postgres
1
Comments 7
4 min read
Delta Lake ACID vs Apache Spark DataFrames: What the Databricks Data Engineer Exam Really Tests
palak_mazumdar_f5431445f6 profile

Delta Lake ACID vs Apache Spark DataFrames: What the Databricks Data Engineer Exam Really Tests

#databricks #dataengineering #spark #certification
Comments
5 min read
Data Engineering, Day 2: The Day the Terminal Stopped Feeling Like a Foreign Country
jontech profile

Data Engineering, Day 2: The Day the Terminal Stopped Feeling Like a Foreign Country

#beginners #cli #dataengineering #learning
Comments
6 min read
Power Query Error: We Couldn't Convert to Number (or Date)
pbidocs profile

Power Query Error: We Couldn't Convert to Number (or Date)

#powerquery #dataengineering #troubleshooting
Comments
3 min read
Sling as an MCP Connector: Query Databases and Move Data from Any AI Assistant
flarco profile

Sling as an MCP Connector: Query Databases and Move Data from Any AI Assistant

#mcp #ai #dataengineering #claude
2
Comments
5 min read
Declarative Automation Bundle: Bind an Existing Lakeflow Job
oieduardorabelo profile

Declarative Automation Bundle: Bind an Existing Lakeflow Job

#databricks #cloud #dataengineering #dab
Comments
8 min read
Your Take-Home Was Free Labor. The Data Proves It.
datadriven profile

Your Take-Home Was Free Labor. The Data Proves It.

#dataengineering #interview #career #beginners
Comments
7 min read
Building a Data Trust Score Engine on Google Cloud with BigQuery, Data Catalog & Vertex AI
shuvojit_kar_04070501sk12 profile

Building a Data Trust Score Engine on Google Cloud with BigQuery, Data Catalog & Vertex AI

#cloud #data #dataengineering #google
Comments
2 min read
Moving Your Local Airflow to GCP for under $150 a month
erfankashani profile

Moving Your Local Airflow to GCP for under $150 a month

#architecture #dataengineering #machinelearning #mlops
1
Comments 4
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.