Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Nithyalakshmi Kamalakkannan

Jan 2

Part 8: Databricks Pipeline & Dashboard

#analytics #dataengineering #tutorial #sql

2 min read

Nithyalakshmi Kamalakkannan

Jan 2

Part 1: Creating Databricks Workspace and Enabling Unity Catalog

#beginners #azure #dataengineering #tutorial

2 min read

Nithyalakshmi Kamalakkannan

Jan 2

Part 2: Project Architecture

#systemdesign #data #architecture #dataengineering

2 min read

Nithyalakshmi Kamalakkannan

Jan 2

Part 5: Building a ZIP Code Dimension Table

#analytics #database #dataengineering #tutorial

2 min read

Nithyalakshmi Kamalakkannan

Jan 2

Part 4: Building the Bronze Layer with Auto Loader and Delta Lake

#architecture #dataengineering #tutorial #sql

2 min read

Rose1845

Jan 17

Git for Beginners: What It Is, Why It Matters, and How to Use It with GitHub

#softwareengineering #dataengineering #git #github

2 min read

Nithyalakshmi Kamalakkannan

Jan 2

Part 3: Simulating Real-Time Streaming Data Using Databricks Sample Datasets

#dataengineering #python #tutorial

1 min read

Amine Laatfa

Jan 1

Automating Serverless Data Ingestion: How to Connect External APIs to BigQuery using Python and Cloud Functions

#googlecloud #bigquery #marketing #dataengineering

12 min read

Neo

Jan 1

The Data Liberation: Amazon Athena and the Architecting of a Serverless Future

#aws #dataengineering #serverless #cloudcomputing

3 min read

Tayfun Yalcinkaya

Jan 5

Why Apache Ozone is the Preferred Object Store for Big Data

#dataengineering #bigdata #datalakehouse #apacheozone

3 min read

Aris Georgatos

Jan 5

Be Essential or Be Optional: A Reality Check for Data Teams

#leadership #growth #dataengineering #datateams

1 min read

Yash Dubey

Feb 5

Markdown Is Not The Future of LLM Data Infrastructure

#ai #llm #webscraping #dataengineering

7 min read

Andrew Kalik

Jan 3

Event-Driven Data Pipelines - Real-Time Orchestration on AWS

#dataengineering #aws #eventdriven

4 min read

Nithyalakshmi Kamalakkannan

Jan 2

Part 6: Silver Layer – Cleansing, Enrichment, and Dimensions

#analytics #architecture #dataengineering

2 min read

Nithyalakshmi Kamalakkannan

Jan 2

Part 7: Gold Layer – Metrics, Watermarks, and Aggregations

#analytics #dataengineering #tutorial #python

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# dataengineering

Part 8: Databricks Pipeline & Dashboard

Part 1: Creating Databricks Workspace and Enabling Unity Catalog

Part 2: Project Architecture

Part 5: Building a ZIP Code Dimension Table

Part 4: Building the Bronze Layer with Auto Loader and Delta Lake

Git for Beginners: What It Is, Why It Matters, and How to Use It with GitHub

Part 3: Simulating Real-Time Streaming Data Using Databricks Sample Datasets

Automating Serverless Data Ingestion: How to Connect External APIs to BigQuery using Python and Cloud Functions

The Data Liberation: Amazon Athena and the Architecting of a Serverless Future

Why Apache Ozone is the Preferred Object Store for Big Data

Be Essential or Be Optional: A Reality Check for Data Teams

Markdown Is Not The Future of LLM Data Infrastructure

Event-Driven Data Pipelines - Real-Time Orchestration on AWS

Part 6: Silver Layer – Cleansing, Enrichment, and Dimensions

Part 7: Gold Layer – Metrics, Watermarks, and Aggregations