DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The Economics of Web Scraping: How to Price Projects and Prevent Scope Creep
muhammad_affan_02dee74709 profile

The Economics of Web Scraping: How to Price Projects and Prevent Scope Creep

#webscraping #dataengineering #python #programming
3
Comments
4 min read
BigQuery Global Queries: Join Data Across Regions Without ETL
toyama0919 profile

BigQuery Global Queries: Join Data Across Regions Without ETL

#bigquery #gcp #dataengineering #sql
1
Comments
6 min read
DBMerge: A database-agnostic Python UPSERT module to simplify ETL pipelines
pavel-v-sobolev profile

DBMerge: A database-agnostic Python UPSERT module to simplify ETL pipelines

#dataengineering #python #sqlalchemy #postgres
Comments
3 min read
How I Quickly Turn CSV Files Into Charts (Without Excel or Coding)
adhibot profile

How I Quickly Turn CSV Files Into Charts (Without Excel or Coding)

#webdev #programming #beginners #dataengineering
2
Comments
2 min read
The Vinted Arbitrage War: Building a Scraper That Doesn't Get IP-Banned
datakaz profile

The Vinted Arbitrage War: Building a Scraper That Doesn't Get IP-Banned

#webdev #python #dataengineering #tutorial
1
Comments
8 min read
AI Citation Registries and Timestamp Signal Failure in AI Interpretation
aigistry profile

AI Citation Registries and Timestamp Signal Failure in AI Interpretation

#ai #machinelearning #dataengineering #governmenttech
1
Comments
2 min read
50,000 Cells. One Network. How Do You Know Which One Is Quietly Breaking?
sesha16 profile

50,000 Cells. One Network. How Do You Know Which One Is Quietly Breaking?

#python #snowflake #dataengineering #telecom
1
Comments
5 min read
Snowflake vs Redshift vs BigQuery: Which One Should You Use?
neha_christina_1ac8651819 profile

Snowflake vs Redshift vs BigQuery: Which One Should You Use?

#sql #beginners #snowflake #dataengineering
1
Comments
4 min read
Getting Data from Different Sources in Power BI
aabdulganeey profile

Getting Data from Different Sources in Power BI

#analytics #dataengineering #microsoft #tutorial
Comments
13 min read
Apache Arrow File Anatomy: Buffers, Record Batches, Schemas, and IPC Metadata Explained 🏹📦
databro profile

Apache Arrow File Anatomy: Buffers, Record Batches, Schemas, and IPC Metadata Explained 🏹📦

#dataengineering #apachearrow #analytics #opensource
Comments
9 min read
5 Data Engineering Techniques That Increased Our LLM Efficiency by 70%
aiwithmohit profile

5 Data Engineering Techniques That Increased Our LLM Efficiency by 70%

#dataengineering #machinelearning #llm #ai
Comments
1 min read
A Day in the Life of a Data Engineer (Real Talk, No Filter)
neha_christina_1ac8651819 profile

A Day in the Life of a Data Engineer (Real Talk, No Filter)

#dataengineering #career #beginners #sql
Comments
5 min read
Stop Losing Your Health Data! Build a Lifelong Electronic Health Record (EHR) System with Neo4j and GraphRAG 🏥💻
wellallytech profile

Stop Losing Your Health Data! Build a Lifelong Electronic Health Record (EHR) System with Neo4j and GraphRAG 🏥💻

#ai #python #rag #dataengineering
1
Comments
3 min read
Monitoring and Observability for Real-Time Streaming Pipelines
beefedai profile

Monitoring and Observability for Real-Time Streaming Pipelines

#dataengineering
Comments
10 min read
Mastering Commonly Used SQL Joins: With Relatable Examples
alex_coder profile

Mastering Commonly Used SQL Joins: With Relatable Examples

#sql #datanalysis #dataengineering #database
1
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.