{"id":10057,"date":"2017-06-09T11:37:27","date_gmt":"2017-06-09T09:37:27","guid":{"rendered":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/"},"modified":"2017-06-09T11:37:27","modified_gmt":"2017-06-09T09:37:27","slug":"install-apache-kafka-on-linux","status":"publish","type":"post","link":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/","title":{"rendered":"Install Apache Kafka on Linux"},"content":{"rendered":"<p><a href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/download.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-17030 aligncenter\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/download.png\" alt=\"download\" width=\"688\" height=\"172\" \/><\/a><\/p>\n<p>What is Apache Kafka ?<\/p>\n<p>No, Kafka is not only the famous author (en.wikipedia.org\/wiki\/Franz_Kafka), it&#8217;s an open-source distributed pub-sub messaging system with powerful skills like scalability and fault tolerance. It&#8217;s also a stream processing platform (near real-time) for the streaming datasources. The design of Apache Kafka is strongly influenced by the commit logs.\u00a0Apache Kafka was originally developed by Linkedin\u00a0and was subsequently open sourced in early 2011.<\/p>\n<p>The installation is pretty simple but need to be rigorous .<\/p>\n<p><strong>Binaries installation<\/strong><\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Prerequisites<br \/>\nGet a Linux server (I have chosen Centos\u00a07.3.1611), it could run on a small config. (memory 1G min.)<br \/>\nConnect as a sudo user or root<\/li>\n<li>Update your system and reboot\n<pre class=\"brush: bash; gutter: true; first-line: 1\">[root@osboxes ~]# yum update\nLoaded plugins: fastestmirror, langpacks\nLoading mirror speeds from cached hostfile\n * base: mirror.switch.ch\n * epel: mirror.uni-trier.de\n * extras: mirror.switch.ch\n * updates: mirror.switch.ch\nNo packages marked for update<\/pre>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<ul>\n<li>Install the latest openjdk and set your environment\n<pre class=\"brush: bash; gutter: true; first-line: 1\">[root@osboxes ~]# yum install java-1.8.0-openjdk\nLoaded plugins: fastestmirror, langpacks\nLoading mirror speeds from cached hostfile\n * base: mirror.switch.ch\n * epel: mirror.imt-systems.com\n * extras: mirror.switch.ch\n * updates: mirror.switch.ch\nPackage 1:java-1.8.0-openjdk-1.8.0.131-3.b12.el7_3.x86_64 already installed and latest version\nNothing to do\n<\/pre>\n<pre class=\"brush: bash; gutter: true; first-line: 1\">#Check it:\n[root@osboxes ~]# java -version\nopenjdk version \"1.8.0_131\"\nOpenJDK Runtime Environment (build 1.8.0_131-b12)\nOpenJDK 64-Bit Server VM (build 25.131-b12, mixed mode)\n\n<\/pre>\n<pre class=\"brush: bash; gutter: true; first-line: 1\">#Update your bash_profile:\nexport JAVA_HOME=\/usr\/lib\/jvm\/jre-1.8.0-openjdk\nexport JRE_HOME=\/usr\/lib\/jvm\/jre\n# and source your profile:\n[root@osboxes ~]# . .\/.bash_profile\n[root@osboxes ~]# echo $JAVA_HOME\n\/usr\/lib\/jvm\/jre-1.8.0-openjdk\n[root@osboxes ~]# echo $JRE_HOME\n\/usr\/lib\/jvm\/jre\n<\/pre>\n<\/li>\n<li>The Confluent Platform is an open source platform that contains all the components you need<br \/>\nto create a scalable data platform built around Apache Kafka.<br \/>\nConfluent Open Source is freely downloadable.<br \/>\nInstall the public key from Confluent<\/p>\n<pre class=\"brush: bash; gutter: false; first-line: 1\">rpm --import http:\/\/packages.confluent.io\/rpm\/3.2\/archive.key<\/pre>\n<\/li>\n<\/ul>\n<ul>\n<li>Add the confluent.repo to your \/etc\/yum.repos.d with this content\n<pre class=\"brush: bash; gutter: true; first-line: 1\">[Confluent.dist]\nname=Confluent repository (dist)\nbaseurl=http:\/\/packages.confluent.io\/rpm\/3.2\/7\ngpgcheck=1\ngpgkey=http:\/\/packages.confluent.io\/rpm\/3.2\/archive.key\nenabled=1\n\n[Confluent]\nname=Confluent repository\nbaseurl=http:\/\/packages.confluent.io\/rpm\/3.2\ngpgcheck=1\ngpgkey=http:\/\/packages.confluent.io\/rpm\/3.2\/archive.key\nenabled=1<\/pre>\n<\/li>\n<li>Clean your yum caches\n<pre class=\"brush: bash; gutter: true; first-line: 1\">yum clean all<\/pre>\n<\/li>\n<li>And finally install the open source version of Confluent\n<pre class=\"brush: bash; gutter: true; first-line: 1\">yum install confluent-platform-oss-2.11<\/pre>\n<pre class=\"brush: bash; gutter: true; first-line: 1\">Transaction Summary\n============================================================================================================================================================================\nInstall  1 Package (+11 Dependent packages)\n\nTotal download size: 391 M\nInstalled size: 446 M\nIs this ok [y\/d\/N]: y\nDownloading packages:\n(1\/12): confluent-common-3.2.1-1.noarch.rpm                                                                                                          | 2.0 MB  00:00:06\n(2\/12): confluent-camus-3.2.1-1.noarch.rpm                                                                                                           |  20 MB  00:00:28\n(3\/12): confluent-kafka-connect-elasticsearch-3.2.1-1.noarch.rpm                                                                                     | 4.3 MB  00:00:06\n(4\/12): confluent-kafka-2.11-0.10.2.1-1.noarch.rpm                                                                                                   |  38 MB  00:00:28\n(5\/12): confluent-kafka-connect-jdbc-3.2.1-1.noarch.rpm                                                                                              | 6.0 MB  00:00:07\n(6\/12): confluent-kafka-connect-hdfs-3.2.1-1.noarch.rpm                                                                                              |  91 MB  00:01:17\n(7\/12): confluent-kafka-connect-s3-3.2.1-1.noarch.rpm                                                                                                |  92 MB  00:01:18\n(8\/12): confluent-kafka-rest-3.2.1-1.noarch.rpm                                                                                                      |  16 MB  00:00:16\n(9\/12): confluent-platform-oss-2.11-3.2.1-1.noarch.rpm                                                                                               | 6.7 kB  00:00:00\n(10\/12): confluent-rest-utils-3.2.1-1.noarch.rpm                                                                                                     | 7.1 MB  00:00:06\n(11\/12): confluent-schema-registry-3.2.1-1.noarch.rpm                                                                                                |  27 MB  00:00:23\n(12\/12): confluent-kafka-connect-storage-common-3.2.1-1.noarch.rpm                                                                                   |  89 MB  00:01:08\n----------------------------------------------------------------------------------------------------------------------------------------------------------------------------\nTotal                                                                                                                                       2.2 MB\/s | 391 MB  00:03:00\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n  Installing : confluent-common-3.2.1-1.noarch                                                                                                                         1\/12\n  Installing : confluent-kafka-connect-storage-common-3.2.1-1.noarch                                                                                                   2\/12\n  Installing : confluent-rest-utils-3.2.1-1.noarch                                                                                                                     3\/12\n  Installing : confluent-kafka-rest-3.2.1-1.noarch                                                                                                                     4\/12\n  Installing : confluent-schema-registry-3.2.1-1.noarch                                                                                                                5\/12\n  Installing : confluent-kafka-connect-s3-3.2.1-1.noarch                                                                                                               6\/12\n  Installing : confluent-kafka-connect-elasticsearch-3.2.1-1.noarch                                                                                                    7\/12\n  Installing : confluent-kafka-connect-jdbc-3.2.1-1.noarch                                                                                                             8\/12\n  Installing : confluent-kafka-connect-hdfs-3.2.1-1.noarch                                                                                                             9\/12\n  Installing : confluent-kafka-2.11-0.10.2.1-1.noarch                                                                                                                 10\/12\n  Installing : confluent-camus-3.2.1-1.noarch                                                                                                                         11\/12\n  Installing : confluent-platform-oss-2.11-3.2.1-1.noarch                                                                                                             12\/12\n  Verifying  : confluent-kafka-connect-storage-common-3.2.1-1.noarch                                                                                                   1\/12\n  Verifying  : confluent-platform-oss-2.11-3.2.1-1.noarch                                                                                                              2\/12\n  Verifying  : confluent-rest-utils-3.2.1-1.noarch                                                                                                                     3\/12\n  Verifying  : confluent-kafka-connect-elasticsearch-3.2.1-1.noarch                                                                                                    4\/12\n  Verifying  : confluent-kafka-connect-s3-3.2.1-1.noarch                                                                                                               5\/12\n  Verifying  : confluent-kafka-rest-3.2.1-1.noarch                                                                                                                     6\/12\n  Verifying  : confluent-camus-3.2.1-1.noarch                                                                                                                          7\/12\n  Verifying  : confluent-kafka-connect-jdbc-3.2.1-1.noarch                                                                                                             8\/12\n  Verifying  : confluent-schema-registry-3.2.1-1.noarch                                                                                                                9\/12\n  Verifying  : confluent-kafka-2.11-0.10.2.1-1.noarch                                                                                                                 10\/12\n  Verifying  : confluent-kafka-connect-hdfs-3.2.1-1.noarch                                                                                                            11\/12\n  Verifying  : confluent-common-3.2.1-1.noarch                                                                                                                        12\/12\n\nInstalled:\n  confluent-platform-oss-2.11.noarch 0:3.2.1-1\n\nDependency Installed:\n  confluent-camus.noarch 0:3.2.1-1                           confluent-common.noarch 0:3.2.1-1                           confluent-kafka-2.11.noarch 0:0.10.2.1-1\n  confluent-kafka-connect-elasticsearch.noarch 0:3.2.1-1     confluent-kafka-connect-hdfs.noarch 0:3.2.1-1               confluent-kafka-connect-jdbc.noarch 0:3.2.1-1\n  confluent-kafka-connect-s3.noarch 0:3.2.1-1                confluent-kafka-connect-storage-common.noarch 0:3.2.1-1     confluent-kafka-rest.noarch 0:3.2.1-1\n  confluent-rest-utils.noarch 0:3.2.1-1                      confluent-schema-registry.noarch 0:3.2.1-1\n\nComplete!<\/pre>\n<\/li>\n<\/ul>\n<p>Ok , the binaries are installed now. The next operation will be to configure and launch Zookeeper and Kafka itself !<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"text-align: left;\">First , take a look at the Zookeeper configuration :\n<pre class=\"brush: bash; gutter: true; first-line: 1\">[root@osboxes kafka]# cat \/etc\/kafka\/zookeeper.properties\n# Licensed to the Apache Software Foundation (ASF) under one or more\n# contributor license agreements.  See the NOTICE file distributed with\n# this work for additional information regarding copyright ownership.\n# The ASF licenses this file to You under the Apache License, Version 2.0\n# (the \"License\"); you may not use this file except in compliance with\n# the License.  You may obtain a copy of the License at\n#\n#    http:\/\/www.apache.org\/licenses\/LICENSE-2.0\n#\n# Unless required by applicable law or agreed to in writing, software\n# distributed under the License is distributed on an \"AS IS\" BASIS,\n# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n# See the License for the specific language governing permissions and\n# limitations under the License.\n# the directory where the snapshot is stored.\ndataDir=\/var\/lib\/zookeeper\n# the port at which the clients will connect\nclientPort=2181\n# disable the per-ip limit on the number of connections since this is a non-production config\nmaxClientCnxns=0<\/pre>\n<\/li>\n<li style=\"text-align: left;\">Don&#8217;t change the configuration file (the default values are okay to start with) \u00a0and launch Zookeeper\n<pre class=\"brush: bash; gutter: true; first-line: 1\">\/usr\/bin\/zookeeper-server-start \/etc\/kafka\/zookeeper.properties\n...\n[2017-06-08 14:05:02,051] INFO binding to port 0.0.0.0\/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxnFactory)<\/pre>\n<\/li>\n<li style=\"text-align: left;\">Keep the session with Zookeeper\u00a0and open a new terminal for the Kafka part\n<pre class=\"brush: bash; gutter: true; first-line: 1\">\/usr\/bin\/kafka-server-start \/etc\/kafka\/server.properties\n...\n[2017-06-08 14:11:31,333] INFO Kafka version : 0.10.2.1-cp1 (org.apache.kafka.common.utils.AppInfoParser)\n[2017-06-08 14:11:31,334] INFO Kafka commitId : 80ff5014b9e74a45 (org.apache.kafka.common.utils.AppInfoParser)\n[2017-06-08 14:11:31,335] INFO [Kafka Server 0], started (kafka.server.KafkaServer)\n[2017-06-08 14:11:31,350] INFO Waiting 10062 ms for the monitored broker to finish starting up... (io.confluent.support.\nmetrics.MetricsReporter)\n[2017-06-08 14:11:41,413] INFO Monitored broker is now ready (io.confluent.support.metrics.MetricsReporter)\n[2017-06-08 14:11:41,413] INFO Starting metrics collection from monitored broker... (io.confluent.support.metrics.Metric\nsReporter)<\/pre>\n<\/li>\n<li style=\"text-align: left;\">Like Zookeeper , let the Kafka Terminal open and launch a new session for the topic creation.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>\u00a0Topic creation<\/strong><\/p>\n<ul>\n<li>Messages in Kafka are categorized into Topics, it&#8217;s like a db table or a directory in a file system.<br \/>\nAt first , we are going to create a new topic.<\/p>\n<pre class=\"brush: bash; gutter: true; first-line: 1\">[root@osboxes ~]# \/usr\/bin\/kafka-topics --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic dbi\nCreated topic \"dbi\".<\/pre>\n<\/li>\n<li>Check if the topic has been effectively created\n<pre class=\"brush: bash; gutter: true; first-line: 1\">[root@osboxes ~]# \/usr\/bin\/kafka-topics --list --zookeeper localhost:2181\ndbi<\/pre>\n<\/li>\n<li>\n<pre class=\"brush: bash; gutter: true; first-line: 1\"><\/pre>\n<p>Nice , we can now produce some messages using the topic &#8220;dbi&#8221;<\/p>\n<pre class=\"brush: bash; gutter: true; first-line: 1\">[root@osboxes ~]# kafka-console-producer --broker-list localhost:9092 --topic dbi\nbe passionate\nbe successful\nbe responsible\nbe sharing<\/pre>\n<\/li>\n<li>Open a new terminal and act like a consumer with the console\n<pre class=\"brush: actionscript3; gutter: true; first-line: 1\">\/usr\/bin\/kafka-console-consumer --zookeeper localhost:2181 --topic dbi --from-beginning<\/pre>\n<pre class=\"brush: bash; gutter: true; first-line: 1\">be passionate\nbe successful\nbe responsible\nbe sharing<\/pre>\n<\/li>\n<li>Et voil\u00e0 ! the messages produced with the producer appeared now in the consumer windows. You can type a new message in the producer console , it will display immediately in the other terminal.If you want to stop all the consoles , you can press Ctrl-C.<\/li>\n<\/ul>\n<p>Now the most difficult thing is still to be done, configure Kafka with multiple producers \/ consumers within a complex broker topology.<\/p>\n<p><a href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/cluster_architecture.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-17062 alignleft\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/cluster_architecture.png\" alt=\"cluster_architecture\" width=\"384\" height=\"215\" \/><\/a><\/p>\n<p style=\"text-align: left;\">\n","protected":false},"excerpt":{"rendered":"<p>What is Apache Kafka ? No, Kafka is not only the famous author (en.wikipedia.org\/wiki\/Franz_Kafka), it&#8217;s an open-source distributed pub-sub messaging system with powerful skills like scalability and fault tolerance. It&#8217;s also a stream processing platform (near real-time) for the streaming datasources. The design of Apache Kafka is strongly influenced by the commit logs.\u00a0Apache Kafka was [&hellip;]<\/p>\n","protected":false},"author":28,"featured_media":10060,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[229,198],"tags":[399,1103,1104,1105],"type_dbi":[],"class_list":["post-10057","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-database-administration-monitoring","category-database-management","tag-big-data","tag-kafka","tag-message-broker","tag-streaming"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.2 (Yoast SEO v27.2) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Install Apache Kafka on Linux - dbi Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Install Apache Kafka on Linux\" \/>\n<meta property=\"og:description\" content=\"What is Apache Kafka ? No, Kafka is not only the famous author (en.wikipedia.org\/wiki\/Franz_Kafka), it&#8217;s an open-source distributed pub-sub messaging system with powerful skills like scalability and fault tolerance. It&#8217;s also a stream processing platform (near real-time) for the streaming datasources. The design of Apache Kafka is strongly influenced by the commit logs.\u00a0Apache Kafka was [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2017-06-09T09:37:27+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/hadoop-hdfs-post-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"575\" \/>\n\t<meta property=\"og:image:height\" content=\"270\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Open source Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Open source Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/\"},\"author\":{\"name\":\"Open source Team\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/59554f0d99383431eb6ed427e338952b\"},\"headline\":\"Install Apache Kafka on Linux\",\"datePublished\":\"2017-06-09T09:37:27+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/\"},\"wordCount\":394,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/hadoop-hdfs-post-1.jpg\",\"keywords\":[\"Big Data\",\"kafka\",\"message broker\",\"streaming\"],\"articleSection\":[\"Database Administration &amp; Monitoring\",\"Database management\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/\",\"name\":\"Install Apache Kafka on Linux - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/hadoop-hdfs-post-1.jpg\",\"datePublished\":\"2017-06-09T09:37:27+00:00\",\"author\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/59554f0d99383431eb6ed427e338952b\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#primaryimage\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/hadoop-hdfs-post-1.jpg\",\"contentUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/hadoop-hdfs-post-1.jpg\",\"width\":575,\"height\":270},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.dbi-services.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Install Apache Kafka on Linux\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/59554f0d99383431eb6ed427e338952b\",\"name\":\"Open source Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g\",\"caption\":\"Open source Team\"},\"url\":\"https:\/\/www.dbi-services.com\/blog\/author\/open-source-team\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Install Apache Kafka on Linux - dbi Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/","og_locale":"en_US","og_type":"article","og_title":"Install Apache Kafka on Linux","og_description":"What is Apache Kafka ? No, Kafka is not only the famous author (en.wikipedia.org\/wiki\/Franz_Kafka), it&#8217;s an open-source distributed pub-sub messaging system with powerful skills like scalability and fault tolerance. It&#8217;s also a stream processing platform (near real-time) for the streaming datasources. The design of Apache Kafka is strongly influenced by the commit logs.\u00a0Apache Kafka was [&hellip;]","og_url":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/","og_site_name":"dbi Blog","article_published_time":"2017-06-09T09:37:27+00:00","og_image":[{"width":575,"height":270,"url":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/hadoop-hdfs-post-1.jpg","type":"image\/jpeg"}],"author":"Open source Team","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Open source Team","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/"},"author":{"name":"Open source Team","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/59554f0d99383431eb6ed427e338952b"},"headline":"Install Apache Kafka on Linux","datePublished":"2017-06-09T09:37:27+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/"},"wordCount":394,"commentCount":0,"image":{"@id":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#primaryimage"},"thumbnailUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/hadoop-hdfs-post-1.jpg","keywords":["Big Data","kafka","message broker","streaming"],"articleSection":["Database Administration &amp; Monitoring","Database management"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/","url":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/","name":"Install Apache Kafka on Linux - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#primaryimage"},"image":{"@id":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#primaryimage"},"thumbnailUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/hadoop-hdfs-post-1.jpg","datePublished":"2017-06-09T09:37:27+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/59554f0d99383431eb6ed427e338952b"},"breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#primaryimage","url":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/hadoop-hdfs-post-1.jpg","contentUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/hadoop-hdfs-post-1.jpg","width":575,"height":270},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/install-apache-kafka-on-linux\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Install Apache Kafka on Linux"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/59554f0d99383431eb6ed427e338952b","name":"Open source Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g","caption":"Open source Team"},"url":"https:\/\/www.dbi-services.com\/blog\/author\/open-source-team\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/10057","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/28"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=10057"}],"version-history":[{"count":0,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/10057\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media\/10060"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=10057"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=10057"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=10057"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=10057"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}