{"id":1000,"date":"2022-06-08T12:30:11","date_gmt":"2022-06-08T12:30:11","guid":{"rendered":"https:\/\/www.checkmateq.com\/blog\/?p=1000"},"modified":"2023-08-07T08:44:28","modified_gmt":"2023-08-07T08:44:28","slug":"redshift-cluster","status":"publish","type":"post","link":"https:\/\/www.checkmateq.com\/blog\/redshift-cluster","title":{"rendered":"How to set up a redshift cluster"},"content":{"rendered":"<p><strong>Amazon Redshift cluster is a fully managed, AWS cloud-based petabyte-scale data warehousing service<\/strong>. Using it you can scale up from a few hundred gigabytes of data to a petabyte or more.<\/p>\n<p>The <strong>nodes<\/strong>, or computer resources, that make up an Amazon Redshift data warehouse are clustered together to form a <strong>cluster<\/strong>. Each <strong>cluster contains one or more databases<\/strong> and is powered by the Amazon Redshift engine.<\/p>\n<p>A leader node and one or more computing nodes are present in each cluster. Client applications send queries to the leader node, which parses them and generates execution plans for the queries.\u00a0The leader node then coordinates the parallel execution of these plans with the compute nodes and combines the nodes&#8217; intermediate results. Finally, the findings are returned to the client apps.<\/p>\n<h3>Steps to create a cluster:<\/h3>\n<ul>\n<li>Login to your <a href=\"https:\/\/www.checkmateq.com\/devops-engineering\">AWS cloud<\/a> account and then go to the amazon redshift dashboard.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1195\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-013835-300x107.png\" alt=\"redshift \" width=\"718\" height=\"256\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-013835-300x107.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-013835-1024x364.png 1024w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-013835-768x273.png 768w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-013835-1536x546.png 1536w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-013835-1200x427.png 1200w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-013835.png 1696w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>Scroll down and click on <strong>create cluster<\/strong>.<\/li>\n<li>After that select cluster type according to the use-case. We will be creating a free-tier cluster.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1197\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-021041-300x125.png\" alt=\"\" width=\"718\" height=\"299\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-021041-300x125.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-021041-1024x427.png 1024w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-021041-768x320.png 768w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-021041.png 1182w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>Configure the database admin username and password and then click on create cluster.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1198\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-021109-300x155.png\" alt=\"\" width=\"732\" height=\"378\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-021109-300x155.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-021109-1024x530.png 1024w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-021109-768x397.png 768w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-021109-1200x621.png 1200w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-021109.png 1218w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>After the cluster is created go to <strong>properties-&gt;Associated IAM Roles<\/strong>.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1200\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-025206-300x69.png\" alt=\"\" width=\"731\" height=\"168\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-025206-300x69.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-025206-1024x234.png 1024w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-025206-768x176.png 768w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-025206-1536x351.png 1536w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-025206-1200x274.png 1200w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-025206.png 1749w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>Click on <strong>Associate IAM roles<\/strong>.<\/li>\n<li>Select <strong>AWS Service Role for Redshift<\/strong>.<\/li>\n<\/ul>\n<p><strong>Loading data in the cluster from the s3 bucket:<\/strong><\/p>\n<ul>\n<li>To upload data from s3 to redshift we need to assign an IAM role to redshift.<\/li>\n<li>First, Click on <strong>Manage IAM roles-&gt; Create IAM role<\/strong>.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1241\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-153522-300x52.png\" alt=\"\" width=\"744\" height=\"129\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-153522-300x52.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-153522-1024x179.png 1024w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-153522-768x134.png 768w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-153522-1536x268.png 1536w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-153522-1200x210.png 1200w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-153522.png 1785w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>Select your bucket name and then click on <strong>create IAM role as default<\/strong>.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1242\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-153612-300x253.png\" alt=\"redshift \" width=\"732\" height=\"617\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-153612-300x253.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-153612-768x647.png 768w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-153612.png 880w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>Click on <strong>Query data\u00a0<\/strong>and then select editor v2.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1243\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154112-300x52.png\" alt=\"\" width=\"744\" height=\"129\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154112-300x52.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154112-1024x179.png 1024w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154112-768x134.png 768w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154112-1536x269.png 1536w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154112-1200x210.png 1200w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154112.png 1836w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>Select your cluster and connect to the database.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1244\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154444-300x74.png\" alt=\"\" width=\"746\" height=\"184\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154444-300x74.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154444-1024x254.png 1024w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154444-768x190.png 768w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154444-1536x381.png 1536w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154444-1200x297.png 1200w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-154444.png 1917w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>Now create a table for your data.<\/li>\n<li>After that Click on <strong>Create<\/strong>.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1248\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-155750-300x133.png\" alt=\"redshift \" width=\"747\" height=\"331\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-155750-300x133.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-155750.png 631w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>Write table name and create columns.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1250\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-170137-300x132.png\" alt=\"\" width=\"741\" height=\"326\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-170137-300x132.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-170137-1024x451.png 1024w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-170137-768x338.png 768w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-170137-1200x529.png 1200w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-170137.png 1350w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>Click on<strong> Create table<\/strong>.<\/li>\n<li>Now click on <strong>Load Data<\/strong>.<\/li>\n<li>Select your data file from the s3 bucket using browse s3, the IAM role that we created for accessing s3, and the target table that we just created, and then click on<strong> Load Data<\/strong>.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1252\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-170753-300x262.png\" alt=\"redshift \" width=\"739\" height=\"645\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-170753-300x262.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-08-170753.png 958w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>Now click on<strong> run<\/strong>.<\/li>\n<li>You can now perform queries on your data.<\/li>\n<\/ul>\n<p><strong>Steps to create a manual snapshot of the cluster:<\/strong><\/p>\n<ul>\n<li>From the console, go to<strong> actions<\/strong> and then select <strong>create snapshot<\/strong>.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1313\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-09-172511-300x152.png\" alt=\"redshift \" width=\"709\" height=\"359\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-09-172511-300x152.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-09-172511-768x390.png 768w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-09-172511.png 940w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>Select a unique identifier for the snapshot as well as<strong> the retention period<\/strong>.<\/li>\n<li>After that click on<strong> Create Snapshot<\/strong>.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" class=\"alignnone wp-image-1314\" src=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-09-172755-300x208.png\" alt=\"redshift \" width=\"737\" height=\"511\" srcset=\"https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-09-172755-300x208.png 300w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-09-172755-768x532.png 768w, https:\/\/www.checkmateq.com\/blog\/wp-content\/uploads\/2022\/06\/Screenshot-2022-06-09-172755.png 855w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<ul>\n<li>After 15 days snapshot will be deleted automatically.<\/li>\n<\/ul>\n<p><a href=\"https:\/\/www.checkmateq.com\/contact-us\">Please contact<\/a> our DevOps consultants to know more DevOps pipeline automation and monitoring services. Connect him to hire Remote <a href=\"https:\/\/www.checkmateq.com\/azure-cloud\">DevOps Engineer<\/a> for project basis.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Amazon Redshift cluster is a fully managed, AWS cloud-based petabyte-scale data warehousing service. Using it you can scale up from a few hundred gigabytes of data to a petabyte or more. The nodes, or computer resources, that make up an Amazon Redshift data warehouse are clustered together to form a cluster. Each cluster contains one &hellip; <a href=\"https:\/\/www.checkmateq.com\/blog\/redshift-cluster\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;How to set up a redshift cluster&#8221;<\/span><\/a><\/p>\n","protected":false},"author":3,"featured_media":1240,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[4,3,2,7,8,14,6],"_links":{"self":[{"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/posts\/1000"}],"collection":[{"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/comments?post=1000"}],"version-history":[{"count":12,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/posts\/1000\/revisions"}],"predecessor-version":[{"id":4318,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/posts\/1000\/revisions\/4318"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/media\/1240"}],"wp:attachment":[{"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/media?parent=1000"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/categories?post=1000"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.checkmateq.com\/blog\/wp-json\/wp\/v2\/tags?post=1000"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}