DEV Community

# bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Predicting machine failures with distributed computing (Spark, AWS EMR, and DL)

Predicting machine failures with distributed computing (Spark, AWS EMR, and DL)

9
Comments
10 min read
Introduction to Data Pipelines

Introduction to Data Pipelines

2
Comments 1
4 min read
Enterprise Digital Transformation Guide in the Post Covid World

Enterprise Digital Transformation Guide in the Post Covid World

2
Comments 1
4 min read
Dark Data and why it matters in Big Data

Dark Data and why it matters in Big Data

2
Comments
3 min read
Please ELI5 big data and privacy concerns, and possible black hacks

Please ELI5 big data and privacy concerns, and possible black hacks

2
Comments 3
1 min read
Demystify Apache Spark with Azure Synapse Analytics

Demystify Apache Spark with Azure Synapse Analytics

6
Comments
1 min read
MLOps

MLOps

6
Comments
2 min read
Spark Journey begins...

Spark Journey begins...

8
Comments
3 min read
Data Ingestion into Azure Data Explorer using Kafka Connect on Kubernetes

Data Ingestion into Azure Data Explorer using Kafka Connect on Kubernetes

7
Comments 1
12 min read
Data Scraping and Data Crawling, what are they for?

Data Scraping and Data Crawling, what are they for?

6
Comments 1
5 min read
Transform AWS CloudTrail data using AWS Data Wrangler

Transform AWS CloudTrail data using AWS Data Wrangler

3
Comments
8 min read
Working with nested structures in Spark

Working with nested structures in Spark

7
Comments 1
3 min read
Guide - AWS Glue and PySpark

Guide - AWS Glue and PySpark

28
Comments
14 min read
Intoduction to Apache Spark

Intoduction to Apache Spark

10
Comments
6 min read
Kafka Connect in 60 seconds 01:00

Kafka Connect in 60 seconds

4
Comments
2 min read
Data Governance 101

Data Governance 101

7
Comments
4 min read
Big Data - Testing Strategy

Big Data - Testing Strategy

2
Comments
1 min read
Supply Chain Risk Management with Data Analytics

Supply Chain Risk Management with Data Analytics

2
Comments
2 min read
Tutorial: How to Ingest data from Kafka into Azure Data Explorer

Tutorial: How to Ingest data from Kafka into Azure Data Explorer

12
Comments
10 min read
Streaming data into Kafka S01/E02 - Loading XML file

Streaming data into Kafka S01/E02 - Loading XML file

3
Comments 2
10 min read
Unit Testing Apache Spark Structured Streaming using MemoryStream

Unit Testing Apache Spark Structured Streaming using MemoryStream

7
Comments
4 min read
Exploiting Schema Inference in Apache Spark

Exploiting Schema Inference in Apache Spark

2
Comments
3 min read
Apache Kafka WebSocket data ingestion using Spring Cloud Stream

Apache Kafka WebSocket data ingestion using Spring Cloud Stream

2
Comments
6 min read
Dados & Informações

Dados & Informações

5
Comments
4 min read
How to use Azure Go SDK to manage Azure Data Explorer clusters

How to use Azure Go SDK to manage Azure Data Explorer clusters

6
Comments
9 min read
loading...