{"id":2024,"date":"2024-05-10T07:06:46","date_gmt":"2024-05-10T07:06:46","guid":{"rendered":"https:\/\/www.skillvertex.com\/blog\/?p=2024"},"modified":"2024-05-10T07:06:46","modified_gmt":"2024-05-10T07:06:46","slug":"who-has-the-worlds-largest-hadoop-cluster","status":"publish","type":"post","link":"https:\/\/www.skillvertex.com\/blog\/who-has-the-worlds-largest-hadoop-cluster\/","title":{"rendered":"Who Has The World&#8217;s Largest Hadoop Cluster"},"content":{"rendered":"\n<p>Facebook has the distinction of having one of the world&#8217;s most massive Hadoop clusters. The social media giant utilizes Hadoop for its data warehousing needs, and their HDFS (Hadoop Distributed File System) cluster is notably extensive with the following key attributes:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A colossal 21 petabytes (PB) of storage capacity.<\/li>\n\n\n\n<li>A total of 2,000 machines, comprising 1,200 machines equipped with 8 cores each, and an additional 800 machines featuring 16 cores each.<\/li>\n\n\n\n<li>Each machine possesses a substantial 12 terabytes (TB) of storage and is backed by 32 gigabytes (GB) of RAM.<\/li>\n\n\n\n<li>Remarkably, these machines support up to 15 map-reduce tasks concurrently.<\/li>\n<\/ul>\n\n\n\n<p>These specifications underscore the immense scale at which Facebook manages and processes its data resources. It&#8217;s worth noting that such figures may evolve over time as companies continually expand their infrastructure to meet escalating data demands.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Facebook has the distinction of having one of the world&#8217;s most massive Hadoop clusters. The social media giant utilizes Hadoop for its data warehousing needs, and their HDFS (Hadoop Distributed File System) cluster is notably extensive with the following key attributes: These specifications underscore the immense scale at which Facebook manages and processes its data &#8230; <a title=\"Who Has The World&#8217;s Largest Hadoop Cluster\" class=\"read-more\" href=\"https:\/\/www.skillvertex.com\/blog\/who-has-the-worlds-largest-hadoop-cluster\/\" aria-label=\"More on Who Has The World&#8217;s Largest Hadoop Cluster\">Read more<\/a><\/p>\n","protected":false},"author":4,"featured_media":2026,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[224],"tags":[343],"class_list":["post-2024","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-question-answer","tag-who-has-the-worlds-largest-hadoop-cluster","generate-columns","tablet-grid-50","mobile-grid-100","grid-parent","grid-33"],"_links":{"self":[{"href":"https:\/\/www.skillvertex.com\/blog\/wp-json\/wp\/v2\/posts\/2024","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.skillvertex.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.skillvertex.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.skillvertex.com\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.skillvertex.com\/blog\/wp-json\/wp\/v2\/comments?post=2024"}],"version-history":[{"count":2,"href":"https:\/\/www.skillvertex.com\/blog\/wp-json\/wp\/v2\/posts\/2024\/revisions"}],"predecessor-version":[{"id":2027,"href":"https:\/\/www.skillvertex.com\/blog\/wp-json\/wp\/v2\/posts\/2024\/revisions\/2027"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.skillvertex.com\/blog\/wp-json\/wp\/v2\/media\/2026"}],"wp:attachment":[{"href":"https:\/\/www.skillvertex.com\/blog\/wp-json\/wp\/v2\/media?parent=2024"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.skillvertex.com\/blog\/wp-json\/wp\/v2\/categories?post=2024"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.skillvertex.com\/blog\/wp-json\/wp\/v2\/tags?post=2024"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}