{"id":4307,"date":"2021-05-11T04:14:55","date_gmt":"2021-05-11T04:14:55","guid":{"rendered":"https:\/\/studysection.com\/blog\/?p=4307"},"modified":"2021-05-11T05:23:56","modified_gmt":"2021-05-11T05:23:56","slug":"components-of-hadoop-architecture","status":"publish","type":"post","link":"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/","title":{"rendered":"Components of Hadoop Architecture"},"content":{"rendered":"<h2>Hadoop<\/h2>\n<p>Hadoop is a batch processing system for a cluster of nodes that gives the bases of the biggest Data analytic activities because it bundles two sets of functionality, most wanted to deal with huge unstructured datasets i.e Distributed file systems and MapReduce processing.<\/p>\n<ol>\n<li>It is a project from the Apache Software Foundation written in <a href=\"https:\/\/studysection.com\/blog\/brief-history-of-java-language\/\">Java<\/a> to assist data-intensive distributed applications.<\/li>\n<li>Hadoop allows applications to operate with thousands of nodes and petabytes of data.<\/li>\n<li>The incentive originates from Google&#8217;s MapReduce and Google File System papers. <\/li>\n<li>Hadoop&#8217;s biggest contributor has been the search giant Yahoo, where it is widely utilized across the business platform.<\/li>\n<\/ol>\n<h3>Map Reduce<\/h3>\n<p>Hadoop MapReduce is a programming model and software structure for writing applications that quickly make large amounts of data in parallel on big clusters of computer nodes. MapReduce uses the HDFS to access file parts and to save reduced results.<\/p>\n<h3>HDFS<\/h3>\n<p>Hadoop Distributed File System (HDFS) is the initial storage system handled by Hadoop applications. HDFS is, as its name implies, a distributed file system that gives high throughput access to application data creating multiple copies of data blocks and sharing them on computer nodes during a cluster to enable reliable and fast computations.<\/p>\n<h3><em>Architecture of Hadoop<\/em><\/h3>\n<ul>\n<li>Hadoop is a Map\/Reduce framework that works on HDFS or HBase.<\/li>\n<li>The central idea is to decompose a task into many identical tasks that can be executed closer to the data.<\/li>\n<li>Also, all tasks are parallelized: the Map phase. Then all these intermediate results are joined into one result: the Reduce phase. <\/li>\n<li>In Hadoop, The JobTracker is responsible for regulating the job, maintaining the Map\/Reduce phase, retrying in case of failures.<\/li>\n<li>The TaskTrackers (Java process) are running on different DataNodes. Each Task Tracker performs the tasks of the job on the locally saved data.<\/li>\n<\/ul>\n<p><img decoding=\"async\" src=\"https:\/\/studysection.com\/blog\/wp-content\/uploads\/2021\/05\/hdfs.png\" alt=\"hdfs\"\/><\/p>\n<p><small><em>If you have skills in PHP programming and you want to enhance your career in this field, a PHP certification from StudySection can help you reach your desired goals. Both beginner level and expert level <a href=\"https:\/\/www.studysection.com\/php-web-developer-foundation-diploma\">PHP Certification Exams<\/a> are offered by StudySection along with other programming certification exams. <\/em><\/small><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hadoop Hadoop is a batch processing system for a cluster of nodes that gives the bases of the biggest Data<\/p>\n","protected":false},"author":1,"featured_media":4308,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[657,581],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Components of Hadoop Architecture - StudySection Blog<\/title>\n<meta name=\"description\" content=\"Hadoop is a batch processing system for nodes that gives bases of the biggest Data analytic activities as it has two sets of functionality.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Components of Hadoop Architecture - StudySection Blog\" \/>\n<meta property=\"og:description\" content=\"Hadoop is a batch processing system for nodes that gives bases of the biggest Data analytic activities as it has two sets of functionality.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog Posts on famous people, innovations and educational topics\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/studysection\" \/>\n<meta property=\"article:published_time\" content=\"2021-05-11T04:14:55+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-05-11T05:23:56+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/studysection.com\/blog\/wp-content\/uploads\/2021\/05\/hadoop.png\" \/>\n\t<meta property=\"og:image:width\" content=\"300\" \/>\n\t<meta property=\"og:image:height\" content=\"200\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"admin-studysection-blog\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@studysection\" \/>\n<meta name=\"twitter:site\" content=\"@studysection\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin-studysection-blog\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/\"},\"author\":{\"name\":\"admin-studysection-blog\",\"@id\":\"https:\/\/studysection.com\/blog\/#\/schema\/person\/db367e2c29a12d1808fb1979edb3d402\"},\"headline\":\"Components of Hadoop Architecture\",\"datePublished\":\"2021-05-11T04:14:55+00:00\",\"dateModified\":\"2021-05-11T05:23:56+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/\"},\"wordCount\":351,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/studysection.com\/blog\/#organization\"},\"keywords\":[\"Architecture\",\"Hadoop\"],\"articleSection\":[\"Learn and Grow\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/\",\"url\":\"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/\",\"name\":\"Components of Hadoop Architecture - StudySection Blog\",\"isPartOf\":{\"@id\":\"https:\/\/studysection.com\/blog\/#website\"},\"datePublished\":\"2021-05-11T04:14:55+00:00\",\"dateModified\":\"2021-05-11T05:23:56+00:00\",\"description\":\"Hadoop is a batch processing system for nodes that gives bases of the biggest Data analytic activities as it has two sets of functionality.\",\"breadcrumb\":{\"@id\":\"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/studysection.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Components of Hadoop Architecture\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/studysection.com\/blog\/#website\",\"url\":\"https:\/\/studysection.com\/blog\/\",\"name\":\"Blog Posts on famous people, innovations and educational topics\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/studysection.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/studysection.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/studysection.com\/blog\/#organization\",\"name\":\"StudySection\",\"url\":\"https:\/\/studysection.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/studysection.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/studysection.com\/blog\/wp-content\/uploads\/2021\/10\/studySection-logo.png\",\"contentUrl\":\"https:\/\/studysection.com\/blog\/wp-content\/uploads\/2021\/10\/studySection-logo.png\",\"width\":920,\"height\":440,\"caption\":\"StudySection\"},\"image\":{\"@id\":\"https:\/\/studysection.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/studysection\",\"https:\/\/twitter.com\/studysection\",\"https:\/\/www.instagram.com\/study.section\/\",\"https:\/\/www.linkedin.com\/company\/studysection\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/studysection.com\/blog\/#\/schema\/person\/db367e2c29a12d1808fb1979edb3d402\",\"name\":\"admin-studysection-blog\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/studysection.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/054ac87a6874df1932004239cd8eab36?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/054ac87a6874df1932004239cd8eab36?s=96&d=mm&r=g\",\"caption\":\"admin-studysection-blog\"},\"url\":\"https:\/\/studysection.com\/blog\/author\/admin-studysection-blog\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Components of Hadoop Architecture - StudySection Blog","description":"Hadoop is a batch processing system for nodes that gives bases of the biggest Data analytic activities as it has two sets of functionality.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/","og_locale":"en_US","og_type":"article","og_title":"Components of Hadoop Architecture - StudySection Blog","og_description":"Hadoop is a batch processing system for nodes that gives bases of the biggest Data analytic activities as it has two sets of functionality.","og_url":"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/","og_site_name":"Blog Posts on famous people, innovations and educational topics","article_publisher":"https:\/\/www.facebook.com\/studysection","article_published_time":"2021-05-11T04:14:55+00:00","article_modified_time":"2021-05-11T05:23:56+00:00","og_image":[{"width":300,"height":200,"url":"https:\/\/studysection.com\/blog\/wp-content\/uploads\/2021\/05\/hadoop.png","type":"image\/png"}],"author":"admin-studysection-blog","twitter_card":"summary_large_image","twitter_creator":"@studysection","twitter_site":"@studysection","twitter_misc":{"Written by":"admin-studysection-blog","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/#article","isPartOf":{"@id":"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/"},"author":{"name":"admin-studysection-blog","@id":"https:\/\/studysection.com\/blog\/#\/schema\/person\/db367e2c29a12d1808fb1979edb3d402"},"headline":"Components of Hadoop Architecture","datePublished":"2021-05-11T04:14:55+00:00","dateModified":"2021-05-11T05:23:56+00:00","mainEntityOfPage":{"@id":"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/"},"wordCount":351,"commentCount":0,"publisher":{"@id":"https:\/\/studysection.com\/blog\/#organization"},"keywords":["Architecture","Hadoop"],"articleSection":["Learn and Grow"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/","url":"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/","name":"Components of Hadoop Architecture - StudySection Blog","isPartOf":{"@id":"https:\/\/studysection.com\/blog\/#website"},"datePublished":"2021-05-11T04:14:55+00:00","dateModified":"2021-05-11T05:23:56+00:00","description":"Hadoop is a batch processing system for nodes that gives bases of the biggest Data analytic activities as it has two sets of functionality.","breadcrumb":{"@id":"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/studysection.com\/blog\/components-of-hadoop-architecture\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/studysection.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Components of Hadoop Architecture"}]},{"@type":"WebSite","@id":"https:\/\/studysection.com\/blog\/#website","url":"https:\/\/studysection.com\/blog\/","name":"Blog Posts on famous people, innovations and educational topics","description":"","publisher":{"@id":"https:\/\/studysection.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/studysection.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/studysection.com\/blog\/#organization","name":"StudySection","url":"https:\/\/studysection.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/studysection.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/studysection.com\/blog\/wp-content\/uploads\/2021\/10\/studySection-logo.png","contentUrl":"https:\/\/studysection.com\/blog\/wp-content\/uploads\/2021\/10\/studySection-logo.png","width":920,"height":440,"caption":"StudySection"},"image":{"@id":"https:\/\/studysection.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/studysection","https:\/\/twitter.com\/studysection","https:\/\/www.instagram.com\/study.section\/","https:\/\/www.linkedin.com\/company\/studysection"]},{"@type":"Person","@id":"https:\/\/studysection.com\/blog\/#\/schema\/person\/db367e2c29a12d1808fb1979edb3d402","name":"admin-studysection-blog","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/studysection.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/054ac87a6874df1932004239cd8eab36?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/054ac87a6874df1932004239cd8eab36?s=96&d=mm&r=g","caption":"admin-studysection-blog"},"url":"https:\/\/studysection.com\/blog\/author\/admin-studysection-blog\/"}]}},"views":465,"_links":{"self":[{"href":"https:\/\/studysection.com\/blog\/wp-json\/wp\/v2\/posts\/4307"}],"collection":[{"href":"https:\/\/studysection.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/studysection.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/studysection.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/studysection.com\/blog\/wp-json\/wp\/v2\/comments?post=4307"}],"version-history":[{"count":2,"href":"https:\/\/studysection.com\/blog\/wp-json\/wp\/v2\/posts\/4307\/revisions"}],"predecessor-version":[{"id":4312,"href":"https:\/\/studysection.com\/blog\/wp-json\/wp\/v2\/posts\/4307\/revisions\/4312"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/studysection.com\/blog\/wp-json\/wp\/v2\/media\/4308"}],"wp:attachment":[{"href":"https:\/\/studysection.com\/blog\/wp-json\/wp\/v2\/media?parent=4307"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/studysection.com\/blog\/wp-json\/wp\/v2\/categories?post=4307"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/studysection.com\/blog\/wp-json\/wp\/v2\/tags?post=4307"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}