DEV Community

# bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Using Apache Parquet to Optimize Data Handling in a Real-Time Ad Exchange Platform
mshidlov profile

Using Apache Parquet to Optimize Data Handling in a Real-Time Ad Exchange Platform

#bigdata #dataengineering #datascience #machinelearning
2
Comments
3 min read
Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices
bobokech profile

Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

#dataengineering #bigdata #aws #azure
Comments
4 min read
MapReduce Simplified: Understand Distributed Processing with the Same Logic as SQL
coderpena profile

MapReduce Simplified: Understand Distributed Processing with the Same Logic as SQL

#bigdata #mapreduce #distributedsystems #hadoop
2
Comments
4 min read
How to Calculate the Return on Investment for Data Analytics
sanjeetsingh profile

How to Calculate the Return on Investment for Data Analytics

#dataanalytics #bigdata #itcourse
1
Comments
5 min read
5 Game-Changing Habits to Master Your Data Science Journey
justdetermined profile

5 Game-Changing Habits to Master Your Data Science Journey

#datascience #data #bigdata #dataengineering
6
Comments
4 min read
Object Storage as Primary Storage: The MinIO Story
ashokan profile

Object Storage as Primary Storage: The MinIO Story

#storage #bigdata #cloudnative
3
Comments
7 min read
Rethinking distributed systems: Composability, scalability
midnattsol profile

Rethinking distributed systems: Composability, scalability

#composablearchitecture #distributedsystems #ai #bigdata
Comments
5 min read
Essential Skills Every Aspiring Data Scientist Should Acquire for Career Success (2025)
argha_sarkar profile

Essential Skills Every Aspiring Data Scientist Should Acquire for Career Success (2025)

#datascience #bigdata #cloud #webdev
Comments
3 min read
Run PySpark Local Python Windows Notebook
chuongmep profile

Run PySpark Local Python Windows Notebook

#bigdata #python #spark #dataengineering
1
Comments
3 min read
Compression algorithms in Parquet Java
jerolba profile

Compression algorithms in Parquet Java

#parquet #java #compression #bigdata
3
Comments 2
7 min read
Top 10 Web Scraping Tools in 2025 (Free & Paid Options)
wisdomudo profile

Top 10 Web Scraping Tools in 2025 (Free & Paid Options)

#webscraping #datascience #automation #bigdata
8
Comments 4
5 min read
When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability
alexmercedcoder profile

When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability

#dataengineering #dataanalytics #datascience #bigdata
Comments
5 min read
Goodbye Kafka: Build a Low-Cost User Analysis System
ksanaka profile

Goodbye Kafka: Build a Low-Cost User Analysis System

#database #kafka #bigdata
Comments
5 min read
The Columnar Approach: A Deep Dive into Efficient Data Storage for Analytics 🚀
madhav_baby_giraffe profile
Madhav

The Columnar Approach: A Deep Dive into Efficient Data Storage for Analytics 🚀

#database #bigdata #dataengineering #analytics
1
Comments
4 min read
Introduction to Hadoop:)
madgan95 profile

Introduction to Hadoop:)

#hadoop #bigdata #nlp #llm
6
Comments
10 min read
Big Data Trends That Will Impact Your Business In 2025
td_inc profile

Big Data Trends That Will Impact Your Business In 2025

#bigdata #trends #2025 #technology
5
Comments
6 min read
The Heart of DolphinScheduler: In-Depth Analysis of the Quartz Scheduling Framework
chen_debra_3060b21d12b1b0 profile

The Heart of DolphinScheduler: In-Depth Analysis of the Quartz Scheduling Framework

#apachedolphinscheduler #quartz #opensource #bigdata
8
Comments
3 min read
SQL Filtering and Sorting with Real-life Examples
milliemolotov profile

SQL Filtering and Sorting with Real-life Examples

#database #sql #mysql #bigdata
1
Comments
4 min read
Query 1B Rows in PostgreSQL >25x Faster with Squirrels!
tim_huang profile

Query 1B Rows in PostgreSQL >25x Faster with Squirrels!

#postgres #dataengineering #analytics #bigdata
1
Comments 8
5 min read
Big Data
williamxlr profile

Big Data

#bigdata #hadoop #spark
Comments
1 min read
Introduction to Data lakes: The future of big data storage
hiswill_thompson_e33923d1 profile

Introduction to Data lakes: The future of big data storage

#bigdata #dataengineering
5
Comments
2 min read
Construyendo una aplicación con Change Data Capture (CDC) utilizando Debezium, Kafka y NiFi
draylexter profile

Construyendo una aplicación con Change Data Capture (CDC) utilizando Debezium, Kafka y NiFi

#cdc #bigdata
1
Comments
3 min read
The Apache Iceberg™ Small File Problem
thedanicafine profile

The Apache Iceberg™ Small File Problem

#bigdata #apacheiceberg #datalakehouse #dataengineering
13
Comments
3 min read
System Design 09 - Data Partitioning: Dividing to Conquer Big Data
sarvabharan profile

System Design 09 - Data Partitioning: Dividing to Conquer Big Data

#systemdesign #bigdata #datapartition
Comments
2 min read
How AWS Handles the 5 Vs of Big Data: Updated for 2025.
faisal_the1st profile

How AWS Handles the 5 Vs of Big Data: Updated for 2025.

#datascience #aws #bigdata #ai
11
Comments
3 min read
loading...