{"id":16550,"date":"2025-10-31T17:37:02","date_gmt":"2025-10-31T12:07:02","guid":{"rendered":"https:\/\/www.skynats.com\/?p=16550"},"modified":"2025-10-31T17:37:04","modified_gmt":"2025-10-31T12:07:04","slug":"how-to-use-amazon-kinesis-data-streams","status":"publish","type":"post","link":"https:\/\/www.skynats.com\/blog\/how-to-use-amazon-kinesis-data-streams\/","title":{"rendered":"How to use Amazon Kinesis Data Streams"},"content":{"rendered":"\n<ul class=\"wp-block-list\">\n<li>Amazon Kinesis enables you to capture and process large streams of data records in real time. It has several components:<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Kinesis Data Streams (KDS): Capture and store streaming data.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Kinesis Data Firehose: Load data into destinations like S3, Redshift, or OpenSearch.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Kinesis Data Analytics: Analyze data in real time using SQL or Apache Flink.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">In this blog, we will focus on Kinesis Data Streams (KDS).<\/p>\n\n\n\n<h2 class=\"wp-block-heading has-small-font-size\" id=\"h-open-the-kinesis-console\"><strong>Open the Kinesis Console<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">1. Go to the Amazon Kinesis <a href=\"https:\/\/aws.amazon.com\/console\/\" target=\"_blank\" rel=\"noopener\">Console<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">2. In the left-hand menu, choose Data Streams.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">3. Click Create data stream.<\/p>\n\n\n\n<h2 class=\"wp-block-heading has-small-font-size\" id=\"h-create-a-data-stream\"><strong>Create a Data Stream<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">1. Enter a name for your stream.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">2. Choose Provisioned capacity.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">3. Set the number of shards (1 is fine for testing).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Each shard can handle up to 1 MB\/s write and 2 MB\/s read throughput.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">4. Click Create data stream.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Wait until the stream status changes to Active.<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-small-font-size\" id=\"h-put-data-into-the-stream\"><strong>Put Data into the Stream<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">1. Once your stream is active, click on it to open its details page.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">2. Go to the Put record tab.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">3. Enter a partition key\u00a0 and some sample data ( {&#8220;message&#8221;: &#8220;Test stream&#8221;}).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">4. Click Put record.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Your data record has now been added to the Kinesis stream!<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-small-font-size\" id=\"h-read-data-from-the-stream\"><strong>Read Data from the Stream<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">To verify your data:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">1. Still in the stream details, choose Data viewer.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">2. Select the shard and click Get records.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">You\u2019ll see the record you just added displayed in the console.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Clean Up<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To avoid charges, delete your stream after testing:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">1. Go back to Data Streams in the console.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">2. Select your stream and click Delete.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">3. Confirm deletion.<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-small-font-size\" id=\"h-conclusion\"><strong>Conclusion<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>You have just created your first Amazon Kinesis Data Stream using the AWS Management Console.<\/li>\n\n\n\n<li>With Kinesis, you can easily integrate data producers and consumers to build real-time analytics pipelines, whether you\u2019re streaming IoT data, clickstreams, or application logs.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Need help setting up Amazon Kinesis Data Streams? Skynats offers expert <a href=\"https:\/\/www.skynats.com\/aws-management\/\">AWS Management Services<\/a> to help you deploy, monitor, and optimize your AWS infrastructure seamlessly.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this blog, we will focus on Kinesis Data Streams (KDS). Open the Kinesis Console 1. Go to the Amazon Kinesis Console 2. In the left-hand menu, choose Data Streams. 3. Click Create data stream. Create a Data Stream 1. Enter a name for your stream. 2. Choose Provisioned capacity. 3. Set the number of [&hellip;]<\/p>\n","protected":false},"author":12,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[1149,1006],"class_list":["post-16550","post","type-post","status-publish","format-standard","hentry","category-blog","tag-amazon-kinesis-data-streams","tag-aws-management-services"],"_links":{"self":[{"href":"https:\/\/www.skynats.com\/blog\/wp-json\/wp\/v2\/posts\/16550","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.skynats.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.skynats.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.skynats.com\/blog\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.skynats.com\/blog\/wp-json\/wp\/v2\/comments?post=16550"}],"version-history":[{"count":2,"href":"https:\/\/www.skynats.com\/blog\/wp-json\/wp\/v2\/posts\/16550\/revisions"}],"predecessor-version":[{"id":16554,"href":"https:\/\/www.skynats.com\/blog\/wp-json\/wp\/v2\/posts\/16550\/revisions\/16554"}],"wp:attachment":[{"href":"https:\/\/www.skynats.com\/blog\/wp-json\/wp\/v2\/media?parent=16550"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.skynats.com\/blog\/wp-json\/wp\/v2\/categories?post=16550"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.skynats.com\/blog\/wp-json\/wp\/v2\/tags?post=16550"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}