DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Streamline data transfer: The ultimate data integration guide SFTP to BigQuery
mage_ai profile

Streamline data transfer: The ultimate data integration guide SFTP to BigQuery

#dataengineering #dataintegration #bigquery #mageai
2
Comments
6 min read
Pipeline de Dados
sthefanyspina profile

Pipeline de Dados

#datascience #dataengineering
Comments
3 min read
Modelagem de Dados
sthefanyspina profile

Modelagem de Dados

#datascience #dataengineering
Comments
5 min read
Uncertain Number but Regular Column to Row Conversion — From SQL to SPL #7
judith677 profile

Uncertain Number but Regular Column to Row Conversion — From SQL to SPL #7

#sql #dataengineering #opensource #esprocspl
7
Comments 1
2 min read
Study Notes 5.1.1-2 Introduction to Batch Processing & spark
pizofreude profile

Study Notes 5.1.1-2 Introduction to Batch Processing & spark

#dataengineering #dezoomcamp #batchprocessing #spark
1
Comments
6 min read
Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark
pizofreude profile

Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark

#dataengineering #dezoomcamp #sql #spark
Comments
11 min read
Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition
pizofreude profile

Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition

#dataengineering #dezoomcamp #spark #rdd
Comments
9 min read
Study Notes 5.6.1-2 Spark on cloud & local
pizofreude profile

Study Notes 5.6.1-2 Spark on cloud & local

#dataengineering #dezoomcamp #spark #cloud
1
Comments
7 min read
Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query
pizofreude profile

Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query

#dataengineering #dezoomcamp #spark #bigquery
Comments
8 min read
Study Notes 5.3.3-4 Data Processing & SQL with Spark
pizofreude profile

Study Notes 5.3.3-4 Data Processing & SQL with Spark

#dataengineering #dezoomcamp #sql #spark
1
Comments
9 min read
Study Notes 5.3.1-2 First Look at Spark/PySpark & Spark Dataframes
pizofreude profile

Study Notes 5.3.1-2 First Look at Spark/PySpark & Spark Dataframes

#dataengineering #dezoomcamp #pyspark #sparkdataframe
Comments
9 min read
Amazon EMR (Elastic MapReduce) Cheat Sheet
datatechbridge profile

Amazon EMR (Elastic MapReduce) Cheat Sheet

#aws #cloudcomputing #dataengineering
Comments 1
11 min read
How We Built OpenETL: A Simple, Scalable Data Migration Tool for Everyone 🚀
rusab_khan profile

How We Built OpenETL: A Simple, Scalable Data Migration Tool for Everyone 🚀

#python #programming #beginners #dataengineering
Comments
3 min read
Unified Data Analytics via a Semantic Layer
johnai profile

Unified Data Analytics via a Semantic Layer

#analytics #dataengineering
Comments
3 min read
An Introduction to Data Engineering in Google Cloud Platform
prishav profile

An Introduction to Data Engineering in Google Cloud Platform

#googlecloud #dataengineering #softwareengineering #computerscience
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.