DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Streamline data transfer: The ultimate data integration guide SFTP to BigQuery

Streamline data transfer: The ultimate data integration guide SFTP to BigQuery

1
Comments
6 min read
We're back and better than ever!

We're back and better than ever!

1
Comments
1 min read
Pipeline de Dados

Pipeline de Dados

Comments
3 min read
Modelagem de Dados

Modelagem de Dados

Comments
3 min read
Is Your Data a Mess? Transform It with Expert Data Lake Consulting Services!

Is Your Data a Mess? Transform It with Expert Data Lake Consulting Services!

Comments
3 min read
Diving into bigdata

Diving into bigdata

Comments
1 min read
Bring Oracle Data to Elasticsearch for Real-Time Search

Bring Oracle Data to Elasticsearch for Real-Time Search

Comments
4 min read
Uncertain Number but Regular Column to Row Conversion — From SQL to SPL #7

Uncertain Number but Regular Column to Row Conversion — From SQL to SPL #7

6
Comments 1
2 min read
Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition

Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition

Comments
9 min read
Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query

Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query

Comments
8 min read
Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark

Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark

Comments
11 min read
Study Notes 5.6.1-2 Spark on cloud & local

Study Notes 5.6.1-2 Spark on cloud & local

Comments
7 min read
Study Notes 5.3.1-2 First Look at Spark/PySpark & Spark Dataframes

Study Notes 5.3.1-2 First Look at Spark/PySpark & Spark Dataframes

Comments
9 min read
Study Notes 5.1.1-2 Introduction to Batch Processing & spark

Study Notes 5.1.1-2 Introduction to Batch Processing & spark

Comments
6 min read
Study Notes 5.3.3-4 Data Processing & SQL with Spark

Study Notes 5.3.3-4 Data Processing & SQL with Spark

Comments
9 min read
Unified Data Analytics via a Semantic Layer

Unified Data Analytics via a Semantic Layer

Comments
3 min read
Data Transformation

Data Transformation

Comments
1 min read
Thinking about becoming a Data Engineer?

Thinking about becoming a Data Engineer?

Comments
2 min read
Apache SeaTunnel 2.3.8 JDBC Connector Development Guide

Apache SeaTunnel 2.3.8 JDBC Connector Development Guide

Comments
12 min read
Study Notes 4.5.2: Visualizing Data with Metabase (Alternative B)

Study Notes 4.5.2: Visualizing Data with Metabase (Alternative B)

Comments
4 min read
Study Notes 4.3.1 - Build the First dbt Models

Study Notes 4.3.1 - Build the First dbt Models

Comments
4 min read
Study Notes 4.4.1 | 4.4.2  : Deployment Using dbt Cloud and Locally

Study Notes 4.4.1 | 4.4.2  : Deployment Using dbt Cloud and Locally

Comments
3 min read
Study Notes 4.3.2 - Testing and Documenting the Project

Study Notes 4.3.2 - Testing and Documenting the Project

Comments
3 min read
Study Notes 4.1.2: What is dbt?

Study Notes 4.1.2: What is dbt?

Comments
3 min read
Study Notes 4.2.1 | 4.2.2: DBT Project Setup

Study Notes 4.2.1 | 4.2.2: DBT Project Setup

Comments
2 min read
loading...