DEV Community

Cover image for DP-900 Part 13
Sakshi
Sakshi

Posted on • Edited on

3

DP-900 Part 13

Real time analytics

Data Processing : Converting of raw data to meaningful information.

  1. Batch Processing :

Group of stored data, processed as batch, data records are stored before processing.

Example : Credit card billing

  1. Stream Processing :

Data is processed in real time as it occurs. For dynamic data generation, and critical operations.

Example : Stock market change

Batch vs Stream

  1. Batch handles large dataset while stream handles individual record

  2. Batch has access to all datasets, while stream has access to recent data

  3. Batch returns result in few hours, while stream in few second

Architecture of stream processing

  • Event generates some data
  • Data is captured in streaming source for processing
  • Event data is processed, query operators on event data
  • result are stored on output

Real time analytics in Azure

  • Azure stream analytics
  • Spark structured analytics
  • Azure data explorer

Thanks for reading...

Billboard image

Deploy and scale your apps on AWS and GCP with a world class developer experience

Coherence makes it easy to set up and maintain cloud infrastructure. Harness the extensibility, compliance and cost efficiency of the cloud.

Learn more

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

👋 Kindness is contagious

Immerse yourself in a wealth of knowledge with this piece, supported by the inclusive DEV Community—every developer, no matter where they are in their journey, is invited to contribute to our collective wisdom.

A simple “thank you” goes a long way—express your gratitude below in the comments!

Gathering insights enriches our journey on DEV and fortifies our community ties. Did you find this article valuable? Taking a moment to thank the author can have a significant impact.

Okay