Amazon Kinesis is a set of services designed for real-time data streaming, processing, and analytics. It enables users to collect, process, and analyze streaming data in real-time, such as logs, IoT data, social media feeds, or clickstream data.
Key Components of Amazon Kinesis
Amazon Kinesis has four main services, each serving different use cases for real-time streaming:
Amazon Kinesis Data Streams:
A highly scalable, real-time data streaming service.
Enables you to ingest large streams of data for real-time analytics or processing.
Data is divided into “shards” for parallel processing.
Data can be retained for up to 7 days (longer with extended retention).
Amazon Kinesis Data Firehose:
A fully managed service for data delivery.
Automatically captures and loads streaming data into destinations like Amazon S3, Redshift, Elasticsearch, or third-party tools.
Supports data transformation using AWS Lambda before delivery.
Amazon Kinesis Data Analytics:
A service for real-time stream analytics using SQL.
Process streaming data from Kinesis Data Streams or Firehose without writing custom code.
Provides built-in functions for windowing, aggregations, and filtering.
Amazon Kinesis Video Streams:
A service for ingesting and storing video streams for machine learning, media analytics, and real-time processing.
Supports video, audio, and metadata streams.
