Dataengineering

Alex Merced

Oct 21 '24

All About Parquet Part 06 - Encoding in Parquet | Optimizing for Storage

#database #datascience #dataengineering

3

6 min read

Alex Merced

Oct 21 '24

All About Parquet Part 08 - Reading and Writing Parquet Files in Python

#database #datascience #dataengineering #data

18

5 min read

Alex Merced

Oct 21 '24

All About Parquet Part 04 - Schema Evolution in Parquet

#database #datascience #dataengineering

4

1

5 min read

Alex Merced

Oct 21 '24

All About Parquet Part 03 - Parquet File Structure | Pages, Row Groups, and Columns

#database #datascience #dataengineering

3

5 min read

prakhyatkarri

Oct 20 '24

From a Unified Bronze Layer to Multiple Silver Layers: Streamlining Data Transformation in Databricks Unity Catalog

#databricks #unitycatalog #medallionarchitecture #dataengineering

2

5 min read

Rodolfo Mendivil

Oct 18 '24

Mastering Informatica Intelligent Cloud Services (IICS) for Cloud Data Integration

#iics #data #etl #dataengineering

1

3 min read

Geazi Anc

Oct 18 '24

Data Engineering with Scala: Mastering Real-Time Data Processing with Apache Flink and Google Pub/Sub

#dataengineering #scala #datascience #flink

7

15 min read

Regnard Raquedan

Sep 13 '24

Clear Link Between DevSecOps and Data Engineering

#dataengineering #devops #devsecops #cloud

1 min read

Farah Kim

Oct 17 '24

Still Using SQL, Python, & Excel for Data Deduplication? Here's Why You Need Better Tools.

#algorithms #ai #dataengineering

5

4 min read

Abdullah Haggag

Oct 17 '24

Building a Big Data Playground Sandbox for Learning

#dataengineering #bigdata #opensource

6

5 min read

Dendi Handian

Sep 12 '24

Capture Browser XHR/Fetch API Response Automatically into JSON Files

#help #dataengineering #chrome #javascript

1 min read

Mark Yu

Oct 16 '24

The True Cost of Poor Data Quality: Why It Matters and How to Improve It

#database #datascience #dataengineering #management

3

6 min read

luminousmen

Oct 15 '24

From ETL and ELT to Reverse ETL

#dataengineering #bigdata #data

1

4 min read

Pavol Z. Kutaj

Oct 14 '24

Explaining the History of Data Lakehouse

#lakehouse #dataengineering #warehouse

2 min read

Marco Porracin

Sep 8 '24

Building a User-Friendly, Budget-Friendly Alternative to dbt Cloud

#dbt #dataengineering #opensource #datascience

1 min read

Norton Augusto Herrero dos Santos

Oct 12 '24

O que é Engenharia de Dados?

#dataengineering #datascience

3

1 min read

Nuthan Kishore

Sep 7 '24

How SQL Spatial Data Solves Real-World Problems

#firstpost #spatialdata #dataengineering

6 min read

Pavol Z. Kutaj

Oct 11 '24

Explaining CDC (Change Data Capture)

#databricks #dataengineering

1 min read

allan-pg

Oct 10 '24

Handling Outliers 101: Why the IQR Method is Your Go-To Tool

#python #datascience #dataengineering #data

2

3 min read

Nico Bistolfi

Oct 9 '24

Go vs Python for File Processing: A Performance and Architecture Perspective

#python #go #performance #dataengineering

2

5 min read

Alex Merced

Oct 7 '24

Exploring Data Operations with PySpark, Pandas, DuckDB, Polars, and DataFusion in a Python Notebook

#python #database #datascience #dataengineering

4

13 min read

Lulu Cheng for jarrid.xyz

Sep 3 '24

Secure Data Stack: Navigating Adoption Challenges of Data Encryption

#security #dataengineering #encryption #infosec

1

5 min read

Milcah03

Oct 7 '24

Data Analysis: The Unsung Hero of Modern Business

#datascience #dataengineering #writing #datastructures

2 min read

Raj Tiwari

Oct 7 '24

Analyzing Airbnb Listings in Chicago: A Power BI Dashboard Project

#datascience #dataengineering #data

1

4 min read

Gichuki Edwin

Oct 7 '24

Python 101: Introduction to Python as a Data Analytics Tool

#python #analytics #datascience #dataengineering

3 min read

DEV Community

# dataengineering

All About Parquet Part 06 - Encoding in Parquet | Optimizing for Storage

All About Parquet Part 08 - Reading and Writing Parquet Files in Python

All About Parquet Part 04 - Schema Evolution in Parquet

All About Parquet Part 03 - Parquet File Structure | Pages, Row Groups, and Columns

From a Unified Bronze Layer to Multiple Silver Layers: Streamlining Data Transformation in Databricks Unity Catalog

Mastering Informatica Intelligent Cloud Services (IICS) for Cloud Data Integration

Data Engineering with Scala: Mastering Real-Time Data Processing with Apache Flink and Google Pub/Sub

Clear Link Between DevSecOps and Data Engineering

Still Using SQL, Python, & Excel for Data Deduplication? Here's Why You Need Better Tools.

Building a Big Data Playground Sandbox for Learning

Capture Browser XHR/Fetch API Response Automatically into JSON Files

The True Cost of Poor Data Quality: Why It Matters and How to Improve It

From ETL and ELT to Reverse ETL

Explaining the History of Data Lakehouse

Building a User-Friendly, Budget-Friendly Alternative to dbt Cloud

O que é Engenharia de Dados?

How SQL Spatial Data Solves Real-World Problems

Explaining CDC (Change Data Capture)

Handling Outliers 101: Why the IQR Method is Your Go-To Tool

Go vs Python for File Processing: A Performance and Architecture Perspective

Exploring Data Operations with PySpark, Pandas, DuckDB, Polars, and DataFusion in a Python Notebook

Secure Data Stack: Navigating Adoption Challenges of Data Encryption

Data Analysis: The Unsung Hero of Modern Business

Analyzing Airbnb Listings in Chicago: A Power BI Dashboard Project

Python 101: Introduction to Python as a Data Analytics Tool