DEV Community

Asanka Boteju
Asanka Boteju

Posted on

Amazon Kinesis for Near Realtime Streaming

Amazon Kinesis Data Streams

Collect and store streaming data such as clickstream data, IoT, metrics, and logs in real time with Amazon Kinesis Data Streams.

AWS fully manages the infrastructure required to run Kinesis
Pay-as-you-go pricing model where you are billed based on your usage.
Write your own producer and consumer codes using KPL and KCL libraries.
✅Shards to improve throughput.
✅Optionally, enable output data format conversions to Parquet or ORC with the support of Glue Catalogs.
✅Support for dynamic partitions.
✅Supports custom transformations with the use of lambda functions


Streaming
Image description

Destination
Image description

Output
Image description

Do your career a big favor. Join DEV. (The website you're on right now)

It takes one minute, it's free, and is worth it for your career.

Get started

Community matters

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

👋 Kindness is contagious

Discover a treasure trove of wisdom within this insightful piece, highly respected in the nurturing DEV Community enviroment. Developers, whether novice or expert, are encouraged to participate and add to our shared knowledge basin.

A simple "thank you" can illuminate someone's day. Express your appreciation in the comments section!

On DEV, sharing ideas smoothens our journey and strengthens our community ties. Learn something useful? Offering a quick thanks to the author is deeply appreciated.

Okay