{"id":11101,"date":"2018-07-10T08:42:30","date_gmt":"2018-07-10T06:42:30","guid":{"rendered":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/"},"modified":"2018-07-10T08:42:30","modified_gmt":"2018-07-10T06:42:30","slug":"deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3","status":"publish","type":"post","link":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/","title":{"rendered":"Deploy a Cloudera cluster with Terraform and Ansible in Azure – part 3"},"content":{"rendered":"

After the deployment step with Terraform and the configuration\/installation with Ansible, we will continue the installation of our Cloudera cluster with Cloudera Manager.<\/p>\n

By following the below steps you will see how to install CDH on our hosts using Cloudera Manager.<\/p>\n

Connection<\/h3>\n

First, Login to Cloudera manager URL.<\/p>\n

\"Cloudera-Manager\"<\/a><\/p>\n

When you connect to C.M for the first time, you need to accept the Cloudera Terms and Conditions.<\/p>\n

\"Cloudera-Manager-Conditions\"<\/a><\/p>\n

Then choose your desired edition of Cloudera. For this blog post, we will use the Data Hub trial edition (60 days trial).<\/p>\n

\"C.M-Edition\"<\/a><\/p>\n

 <\/p>\n

Hosts discovery<\/h3>\n

In this step, provide the IP or hostname of all cluster machines you want to use. To complete this steps check if your \/etc\/hosts file of each cluster hosts is properly defined.<\/p>\n

\"Cloudera-Manager-Hosts\"<\/a><\/p>\n

When all hosts are reachable by Cloudera Manager server,<\/p>\n

CDH Installation<\/h3>\n

This step is about the version of CDH to install in your cluster.<\/p>\n

\"C.M-Installation_Methods\"<\/a><\/p>\n

Use parcels installation.<\/p>\n

By default, the parcel directory is \/opt\/cloudera\/parcels. A best practice is to have a separate filesystem for \/opt (at least 15GB), in order to separate the Cloudera installation to the \/root filesystem.<\/p>\n

If you don’t have a specific filesystem for \/opt, you will have some performance impact on your server.<\/p>\n

Java automatic installation<\/h4>\n

Since we install Java JDK automatically and properly with Ansible, we don’t need to check the box for java installation. Please skip this step.<\/p>\n

\"CM-Java_install\"<\/a><\/p>\n

Account details<\/h4>\n

In this step, we will provide the user account information to Cloudera Manager in order to install all components needed in all cluster hosts.<\/p>\n

It’s not recommended to give the root access to Cloudera Manager but a dedicated user with sudo access. For our example we will use the user created during the installation part: dbi, with it associated password.<\/p>\n

\"CM-Users1\"<\/a><\/p>\n

Cloudera Installation – Install Agents<\/h4>\n

In this steps, Cloudera Manager will install and configure cloudera-scm-agent in all cluster hosts.<\/p>\n

\"CM-Install-Agents\"<\/a><\/p>\n

 <\/p>\n

Cloudera Installation – Parcels installation<\/h4>\n

After cloudera-scm-agent installation and configuration, Cloudera Manager will install the CDH Parcel and additional parcels on all cluster hosts.<\/p>\n

\"CM-Parcels2\"<\/a><\/p>\n

Cloudera Installation – Hosts Inspector<\/h4>\n

In this step, the host’s inspector will check all cluster hosts requirement and notify you if you have any problem.<\/p>\n

Note that, you can go through all validation section to understand all pre-requisites for Cloudera installation. You will get to know the complete checklists items Cloudera use to validate your host’s cluster.<\/p>\n

\"CM-Hosts-Inspector\"<\/a><\/p>\n

You can ignore the warning for now and resolve them after the installation. Click on Finish button and go to the next step.<\/p>\n

Cluster Setup – Select Services<\/h4>\n

In this step, choose your services to install. For our sandbox environment we will only install Core Hadoop first.<\/p>\n

\"CM-Services\"<\/a><\/p>\n

 <\/p>\n

Cluster Setup – Customize Role Assignments<\/h4>\n

Assign roles by hosts and click on continue.<\/p>\n

\"CM-Roles\"<\/a><\/p>\n

 <\/p>\n

Cluster Setup – Setup databases<\/h4>\n

In this step, setup the remote databases for hive metastore, hue, Cloudera reports manager and oozie server.<\/p>\n

\"CM-Databases\"<\/a><\/p>\n

Test the connection and click on Continue .<\/p>\n

Cluster Setup – Review changes<\/h4>\n

Ensure that you use the \/data directory previously created with Terraform and Ansible.<\/p>\n

\"CM-ReviewsUsers\"<\/a><\/p>\n

 <\/p>\n

Cluster Setup – Start services<\/h4>\n

\"CM-StartServices\"<\/a><\/p>\n

 <\/p>\n

Congratulations your Cloudera cluster is now installed and configured!<\/p>\n

\"CM-End\"<\/a><\/p>\n

\"CM-Dashboard\"<\/a><\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

After the deployment step with Terraform and the configuration\/installation with Ansible, we will continue the installation of our Cloudera cluster with Cloudera Manager. By following the below steps you will see how to install CDH on our hosts using Cloudera Manager. Connection First, Login to Cloudera manager URL. When you connect to C.M for the […]<\/p>\n","protected":false},"author":109,"featured_media":11102,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1183,955],"tags":[150,1338,678,135,1339],"type_dbi":[],"class_list":["post-11101","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-big-data","category-cloud","tag-ansible","tag-azure","tag-bigdata","tag-cloud","tag-cloudera"],"acf":[],"yoast_head":"\nDeploy a Cloudera cluster with Terraform and Ansible in Azure - part 3 - dbi Blog<\/title>\n<meta name=\"description\" content=\"Install a CDH with Cloudera Manager\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Deploy a Cloudera cluster with Terraform and Ansible in Azure - part 3\" \/>\n<meta property=\"og:description\" content=\"Install a CDH with Cloudera Manager\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2018-07-10T06:42:30+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Screen-Shot-2018-04-20-at-15.26.08.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1919\" \/>\n\t<meta property=\"og:image:height\" content=\"1057\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"DevOps\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"DevOps\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/\"},\"author\":{\"name\":\"DevOps\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/4cd1b5f8a3de93f05a16ab8d7d2b7735\"},\"headline\":\"Deploy a Cloudera cluster with Terraform and Ansible in Azure – part 3\",\"datePublished\":\"2018-07-10T06:42:30+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/\"},\"wordCount\":538,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Screen-Shot-2018-04-20-at-15.26.08.png\",\"keywords\":[\"Ansible\",\"Azure\",\"BigData\",\"Cloud\",\"Cloudera\"],\"articleSection\":[\"Big Data\",\"Cloud\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/\",\"name\":\"Deploy a Cloudera cluster with Terraform and Ansible in Azure - part 3 - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Screen-Shot-2018-04-20-at-15.26.08.png\",\"datePublished\":\"2018-07-10T06:42:30+00:00\",\"author\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/4cd1b5f8a3de93f05a16ab8d7d2b7735\"},\"description\":\"Install a CDH with Cloudera Manager\",\"breadcrumb\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#primaryimage\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Screen-Shot-2018-04-20-at-15.26.08.png\",\"contentUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Screen-Shot-2018-04-20-at-15.26.08.png\",\"width\":1919,\"height\":1057},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.dbi-services.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Deploy a Cloudera cluster with Terraform and Ansible in Azure – part 3\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/4cd1b5f8a3de93f05a16ab8d7d2b7735\",\"name\":\"DevOps\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/cdd2dd7441774355062c0f0f68612296b059cd1e2ff6c7af0b15dba0ed64a85f?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/cdd2dd7441774355062c0f0f68612296b059cd1e2ff6c7af0b15dba0ed64a85f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/cdd2dd7441774355062c0f0f68612296b059cd1e2ff6c7af0b15dba0ed64a85f?s=96&d=mm&r=g\",\"caption\":\"DevOps\"},\"url\":\"https:\/\/www.dbi-services.com\/blog\/author\/devops\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Deploy a Cloudera cluster with Terraform and Ansible in Azure - part 3 - dbi Blog","description":"Install a CDH with Cloudera Manager","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/","og_locale":"en_US","og_type":"article","og_title":"Deploy a Cloudera cluster with Terraform and Ansible in Azure - part 3","og_description":"Install a CDH with Cloudera Manager","og_url":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/","og_site_name":"dbi Blog","article_published_time":"2018-07-10T06:42:30+00:00","og_image":[{"width":1919,"height":1057,"url":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Screen-Shot-2018-04-20-at-15.26.08.png","type":"image\/png"}],"author":"DevOps","twitter_card":"summary_large_image","twitter_misc":{"Written by":"DevOps","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/"},"author":{"name":"DevOps","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/4cd1b5f8a3de93f05a16ab8d7d2b7735"},"headline":"Deploy a Cloudera cluster with Terraform and Ansible in Azure – part 3","datePublished":"2018-07-10T06:42:30+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/"},"wordCount":538,"commentCount":0,"image":{"@id":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#primaryimage"},"thumbnailUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Screen-Shot-2018-04-20-at-15.26.08.png","keywords":["Ansible","Azure","BigData","Cloud","Cloudera"],"articleSection":["Big Data","Cloud"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/","url":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/","name":"Deploy a Cloudera cluster with Terraform and Ansible in Azure - part 3 - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#primaryimage"},"image":{"@id":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#primaryimage"},"thumbnailUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Screen-Shot-2018-04-20-at-15.26.08.png","datePublished":"2018-07-10T06:42:30+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/4cd1b5f8a3de93f05a16ab8d7d2b7735"},"description":"Install a CDH with Cloudera Manager","breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#primaryimage","url":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Screen-Shot-2018-04-20-at-15.26.08.png","contentUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Screen-Shot-2018-04-20-at-15.26.08.png","width":1919,"height":1057},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/deploy-a-cloudera-cluster-with-terraform-and-ansible-in-azure-part-3\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Deploy a Cloudera cluster with Terraform and Ansible in Azure – part 3"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/4cd1b5f8a3de93f05a16ab8d7d2b7735","name":"DevOps","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/cdd2dd7441774355062c0f0f68612296b059cd1e2ff6c7af0b15dba0ed64a85f?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/cdd2dd7441774355062c0f0f68612296b059cd1e2ff6c7af0b15dba0ed64a85f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/cdd2dd7441774355062c0f0f68612296b059cd1e2ff6c7af0b15dba0ed64a85f?s=96&d=mm&r=g","caption":"DevOps"},"url":"https:\/\/www.dbi-services.com\/blog\/author\/devops\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/11101","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/109"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=11101"}],"version-history":[{"count":0,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/11101\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media\/11102"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=11101"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=11101"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=11101"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=11101"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}