Amazon Kinesis for Near Realtime Streaming

Amazon Kinesis Data Streams

Collect and store streaming data such as clickstream data, IoT, metrics, and logs in real time with Amazon Kinesis Data Streams.

✅AWS fully manages the infrastructure required to run Kinesis
✅Pay-as-you-go pricing model where you are billed based on your usage.
✅Write your own producer and consumer codes using KPL and KCL libraries.
✅Shards to improve throughput.
✅Optionally, enable output data format conversions to Parquet or ORC with the support of Glue Catalogs.
✅Support for dynamic partitions.
✅Supports custom transformations with the use of lambda functions

---

Streaming

Destination

Output