DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
UTC is not a data contract. Period.
sudeephazra profile

UTC is not a data contract. Period.

#backend #database #dataengineering
Comments
7 min read
Retail pricing data is messier than a price field
anakin_writers profile

Retail pricing data is messier than a price field

#webscraping #python #dataengineering #ecommerce
Comments
4 min read
How Do You Approach a Brand New Web Scraping Project?
wisdomudo profile

How Do You Approach a Brand New Web Scraping Project?

#webscraping #proxy #dataengineering #development
Comments
5 min read
The Iceberg Table That Was Never Where We Wrote It
kotwal-itpro profile

The Iceberg Table That Was Never Where We Wrote It

#iceberg #dataengineering #opensource #java
Comments
8 min read
Postgres and Iceberg: pg_lake, pg_duckdb and the Postgres lakehouse
mohammed_arshadansari_f2 profile

Postgres and Iceberg: pg_lake, pg_duckdb and the Postgres lakehouse

#dataengineering #database #sql #opensource
Comments 1
3 min read
Apps run until you stop them
eudorajab1 profile

Apps run until you stop them

#snowflake #dataengineering #streamlit #finops
Comments
4 min read
dbt Macros & Jinja Explained (With Real Examples)
neha_christina_1ac8651819 profile

dbt Macros & Jinja Explained (With Real Examples)

#dbt #sql #dataengineering #snowflake
5
Comments 3
4 min read
Your Batch Job Said "Success." Here's How to Check the Data Actually Arrived
askkarenai profile
KAREN

Your Batch Job Said "Success." Here's How to Check the Data Actually Arrived

#dataengineering #database #devops #beginners
Comments 3
3 min read
openFDA's count= aggregation shows you the top 1,000 values and never tells you it stopped
fetchsmith profile

openFDA's count= aggregation shows you the top 1,000 values and never tells you it stopped

#webscraping #api #opendata #dataengineering
Comments 1
6 min read
Como aprendi Apache Spark — Parte 6: Spark SQL e DataFrames — do código ao plano de execução
renanpyd profile

Como aprendi Apache Spark — Parte 6: Spark SQL e DataFrames — do código ao plano de execução

#pyspark #dataengineering #bigdata #cluster
1
Comments
15 min read
Your scraper's filter did nothing, and the run looked perfect
fetchsmith profile

Your scraper's filter did nothing, and the run looked perfect

#webscraping #api #dataengineering #javascript
Comments 2
7 min read
Mapping Analytics Models to CRM: Data Modeling Best Practices
beefedai profile

Mapping Analytics Models to CRM: Data Modeling Best Practices

#dataengineering
Comments
8 min read
Your agent's worst query is read-only
mudit_builds profile

Your agent's worst query is read-only

#ai #mcp #dataengineering #trino
Comments 1
4 min read
Real-time market data is mostly a freshness problem
anakin_writers profile
Anakin

Real-time market data is mostly a freshness problem

#webscraping #dataengineering #python #monitoring
Comments
4 min read
Vector-Native Analytics: Embeddings as a First-Class Warehouse Column
vaishnavprabhu profile

Vector-Native Analytics: Embeddings as a First-Class Warehouse Column

#dataengineering #ai #sql #database
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.