{"id":10464,"date":"2017-09-21T12:09:25","date_gmt":"2017-09-21T10:09:25","guid":{"rendered":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/"},"modified":"2017-09-21T12:09:25","modified_gmt":"2017-09-21T10:09:25","slug":"be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives","status":"publish","type":"post","link":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/","title":{"rendered":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives"},"content":{"rendered":"<p>Today, after we did a fresh setup of a Grid Infrastructure cluster (12.1.0.2.170814) we faced two issues reported in the alert.log of the ASM instances (in fact you would see the same for the alert logs of any instance in that configuration but we did not had any other instance up and running at that time):<\/p>\n<p>This:<\/p>\n<pre class=\"brush: sql; gutter: true; first-line: 1\">\nORA-00700: soft internal error, arguments: [dbgrfrbf_1], [\/disk00\/app\/grid\/diag\/asm\/+asm\/+ASM2\/metadata\/INC_METER_SUMMARY.ams], [0], [4], [], [], [], [], [], [], [], []\nORA-27072: File I\/O error\nLinux-x86_64 Error: 22: Invalid argument\nAdditional information: 4\nAdditional information: 1\nAdditional information: 4294967295\n<\/pre>\n<p>&#8230; and this:<\/p>\n<pre class=\"brush: text; gutter: true; first-line: 1\">\nERROR: create the ADR schema in the specified ADR Base directory [\/disk00\/app\/grid]\nERROR: The ORA-48178 error is caused by the ORA-48101 error. \nORA-48101: error encountered when attempting to read a file [block] [\/disk00\/app\/grid\/diag\/asm\/+asm\/+ASM1\/metadata\/ADR_INTERNAL.mif] [0]\nORA-27072: File I\/O error\nLinux-x86_64 Error: 22: Invalid argument\nAdditional information: 4\nAdditional information: 1\nAdditional information: 4294967295\n<\/pre>\n<p><!--more--><\/p>\n<p>As it turned out this was an issue with the <a href=\"http:\/\/xfs.org\/index.php\/Main_Page\" target=\"_blank\" rel=\"noopener\">xfs<\/a> block size. In the configuration we had the block size was set to 4096 (this was chosen by default when the file system got created):<\/p>\n<pre class=\"brush: sql; gutter: true; first-line: 1; highlight: [5]\">\n$:\/disk00\/app\/grid\/diag\/asm\/+asm\/+ASM1\/metadata\/ [+ASM1] xfs_info \/disk00\nmeta-data=\/dev\/mapper\/vg_root-lv_disk00 isize=512    agcount=4, agsize=13107200 blks\n         =                       sectsz=4096  attr=2, projid32bit=1\n         =                       crc=1        finobt=0 spinodes=0\ndata     =                       bsize=4096   blocks=52428800, imaxpct=25\n         =                       sunit=0      swidth=0 blks\nnaming   =version 2              bsize=4096   ascii-ci=0 ftype=1\nlog      =internal               bsize=4096   blocks=25600, version=2\n         =                       sectsz=4096  sunit=1 blks, lazy-count=1\nrealtime =none                   extsz=4096   blocks=0, rtextents=0\n$:\/disk00\/app\/grid\/diag\/asm\/+asm\/+ASM1\/metadata\/ [+ASM1] \n<\/pre>\n<p>After changing that to 512 all was fine again:<\/p>\n<pre class=\"brush: sql; gutter: true; first-line: 1; highlight: [5]\">\n$:\/home\/ [+ASM1] xfs_info \/disk00\/\nmeta-data=\/dev\/mapper\/disk00     isize=256    agcount=4, agsize=104857600 blks\n         =                       sectsz=512   attr=2, projid32bit=1\n         =                       crc=0        finobt=0 spinodes=0\ndata     =                       bsize=512    blocks=419430400, imaxpct=25\n         =                       sunit=0      swidth=0 blks\nnaming   =version 2              bsize=4096   ascii-ci=0 ftype=1\nlog      =internal               bsize=512    blocks=204800, version=2\n         =                       sectsz=512   sunit=0 blks, lazy-count=1\nrealtime =none                   extsz=4096   blocks=0, rtextents=0\n$:\/home\/ [+ASM1] \n<\/pre>\n<p>Indeed this was not so easy because the <a href=\"https:\/\/www.cisco.com\/c\/dam\/en\/us\/products\/collateral\/servers-unified-computing\/ucs-b-series-blade-servers\/b200m4-specsheet.pdf\" target=\"_blank\" rel=\"noopener\">Cisco UCS systems<\/a> we used for that came with internal disks that had a 4k sector size so we couldn&#8217;t even create a new xfs file system on that with the settings required.<\/p>\n<pre class=\"brush: sql; gutter: true; first-line: 1; highlight: [4]\">\n[root@xxxx ~]# mkfs.xfs -s size=512 -m crc=0 -b size=512\n        \/dev\/mapper\/vg_root-lv_disk00_test \n\n      illegal sector size 512; hwsector is 4096\n<\/pre>\n<p>The solution was to get a LUN from the storage and use that instead. Another important note from the above linked data sheet:<\/p>\n<p><b>NOTE:  4K format drives are supported and qualified as bootable with Cisco UCS Manager Release 3.1(2b)and later versions. However, 4K sector format drives do not support VMware and require UEFI boot.<\/b><\/p>\n<p>Be careful &#8230;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today, after we did a fresh setup of a Grid Infrastructure cluster (12.1.0.2.170814) we faced two issues reported in the alert.log of the ASM instances (in fact you would see the same for the alert logs of any instance in that configuration but we did not had any other instance up and running at that [&hellip;]<\/p>\n","protected":false},"author":29,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[229],"tags":[1174,96,1031],"type_dbi":[],"class_list":["post-10464","post","type-post","status-publish","format-standard","hentry","category-database-administration-monitoring","tag-adr","tag-oracle","tag-xfs"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.2 (Yoast SEO v27.2) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives - dbi Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives\" \/>\n<meta property=\"og:description\" content=\"Today, after we did a fresh setup of a Grid Infrastructure cluster (12.1.0.2.170814) we faced two issues reported in the alert.log of the ASM instances (in fact you would see the same for the alert logs of any instance in that configuration but we did not had any other instance up and running at that [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2017-09-21T10:09:25+00:00\" \/>\n<meta name=\"author\" content=\"Daniel Westermann\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@westermanndanie\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Daniel Westermann\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/\"},\"author\":{\"name\":\"Daniel Westermann\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/8d08e9bd996a89bd75c0286cbabf3c66\"},\"headline\":\"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives\",\"datePublished\":\"2017-09-21T10:09:25+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/\"},\"wordCount\":216,\"commentCount\":0,\"keywords\":[\"ADR\",\"Oracle\",\"XFS\"],\"articleSection\":[\"Database Administration &amp; Monitoring\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/\",\"name\":\"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\"},\"datePublished\":\"2017-09-21T10:09:25+00:00\",\"author\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/8d08e9bd996a89bd75c0286cbabf3c66\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.dbi-services.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/8d08e9bd996a89bd75c0286cbabf3c66\",\"name\":\"Daniel Westermann\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/31350ceeecb1dd8986339a29bf040d4cd3cd087d410deccd8f55234466d6c317?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/31350ceeecb1dd8986339a29bf040d4cd3cd087d410deccd8f55234466d6c317?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/31350ceeecb1dd8986339a29bf040d4cd3cd087d410deccd8f55234466d6c317?s=96&d=mm&r=g\",\"caption\":\"Daniel Westermann\"},\"description\":\"Daniel Westermann is Principal Consultant and Technology Leader Open Infrastructure at dbi services. He has more than 15 years of experience in management, engineering and optimization of databases and infrastructures, especially on Oracle and PostgreSQL. Since the beginning of his career, he has specialized in Oracle Technologies and is Oracle Certified Professional 12c and Oracle Certified Expert RAC\/GridInfra. Over time, Daniel has become increasingly interested in open source technologies, becoming \u201cTechnology Leader Open Infrastructure\u201d and PostgreSQL expert. \u00a0Based on community or EnterpriseDB tools, he develops and installs complex high available solutions with PostgreSQL. He is also a certified PostgreSQL Plus 9.0 Professional and a Postgres Advanced Server 9.4 Professional. He is a regular speaker at PostgreSQL conferences in Switzerland and Europe. Today Daniel is also supporting our customers on AWS services such as AWS RDS, database migrations into the cloud, EC2 and automated infrastructure management with AWS SSM (System Manager). He is a certified AWS Solutions Architect Professional. Prior to dbi services, Daniel was Management System Engineer at LC SYSTEMS-Engineering AG in Basel. Before that, he worked as Oracle Developper &amp;\u00a0Project Manager at Delta Energy Solutions AG in Basel (today Powel AG). Daniel holds a diploma in Business Informatics (DHBW, Germany). His branch-related experience mainly covers the pharma industry, the financial sector, energy, lottery and telecommunications.\",\"sameAs\":[\"https:\/\/x.com\/westermanndanie\"],\"url\":\"https:\/\/www.dbi-services.com\/blog\/author\/daniel-westermann\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives - dbi Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/","og_locale":"en_US","og_type":"article","og_title":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives","og_description":"Today, after we did a fresh setup of a Grid Infrastructure cluster (12.1.0.2.170814) we faced two issues reported in the alert.log of the ASM instances (in fact you would see the same for the alert logs of any instance in that configuration but we did not had any other instance up and running at that [&hellip;]","og_url":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/","og_site_name":"dbi Blog","article_published_time":"2017-09-21T10:09:25+00:00","author":"Daniel Westermann","twitter_card":"summary_large_image","twitter_creator":"@westermanndanie","twitter_misc":{"Written by":"Daniel Westermann","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/"},"author":{"name":"Daniel Westermann","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/8d08e9bd996a89bd75c0286cbabf3c66"},"headline":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives","datePublished":"2017-09-21T10:09:25+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/"},"wordCount":216,"commentCount":0,"keywords":["ADR","Oracle","XFS"],"articleSection":["Database Administration &amp; Monitoring"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/","url":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/","name":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"datePublished":"2017-09-21T10:09:25+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/8d08e9bd996a89bd75c0286cbabf3c66"},"breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/8d08e9bd996a89bd75c0286cbabf3c66","name":"Daniel Westermann","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/31350ceeecb1dd8986339a29bf040d4cd3cd087d410deccd8f55234466d6c317?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/31350ceeecb1dd8986339a29bf040d4cd3cd087d410deccd8f55234466d6c317?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/31350ceeecb1dd8986339a29bf040d4cd3cd087d410deccd8f55234466d6c317?s=96&d=mm&r=g","caption":"Daniel Westermann"},"description":"Daniel Westermann is Principal Consultant and Technology Leader Open Infrastructure at dbi services. He has more than 15 years of experience in management, engineering and optimization of databases and infrastructures, especially on Oracle and PostgreSQL. Since the beginning of his career, he has specialized in Oracle Technologies and is Oracle Certified Professional 12c and Oracle Certified Expert RAC\/GridInfra. Over time, Daniel has become increasingly interested in open source technologies, becoming \u201cTechnology Leader Open Infrastructure\u201d and PostgreSQL expert. \u00a0Based on community or EnterpriseDB tools, he develops and installs complex high available solutions with PostgreSQL. He is also a certified PostgreSQL Plus 9.0 Professional and a Postgres Advanced Server 9.4 Professional. He is a regular speaker at PostgreSQL conferences in Switzerland and Europe. Today Daniel is also supporting our customers on AWS services such as AWS RDS, database migrations into the cloud, EC2 and automated infrastructure management with AWS SSM (System Manager). He is a certified AWS Solutions Architect Professional. Prior to dbi services, Daniel was Management System Engineer at LC SYSTEMS-Engineering AG in Basel. Before that, he worked as Oracle Developper &amp;\u00a0Project Manager at Delta Energy Solutions AG in Basel (today Powel AG). Daniel holds a diploma in Business Informatics (DHBW, Germany). His branch-related experience mainly covers the pharma industry, the financial sector, energy, lottery and telecommunications.","sameAs":["https:\/\/x.com\/westermanndanie"],"url":"https:\/\/www.dbi-services.com\/blog\/author\/daniel-westermann\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/10464","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/29"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=10464"}],"version-history":[{"count":0,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/10464\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=10464"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=10464"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=10464"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=10464"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}