{"id":10464,"date":"2017-09-21T12:09:25","date_gmt":"2017-09-21T10:09:25","guid":{"rendered":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/"},"modified":"2017-09-21T12:09:25","modified_gmt":"2017-09-21T10:09:25","slug":"be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives","status":"publish","type":"post","link":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/","title":{"rendered":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives"},"content":{"rendered":"<p>Today, after we did a fresh setup of a Grid Infrastructure cluster (12.1.0.2.170814) we faced two issues reported in the alert.log of the ASM instances (in fact you would see the same for the alert logs of any instance in that configuration but we did not had any other instance up and running at that time):<\/p>\n<p>This:<\/p>\n<pre class=\"brush: sql; gutter: true; first-line: 1\">\nORA-00700: soft internal error, arguments: [dbgrfrbf_1], [\/disk00\/app\/grid\/diag\/asm\/+asm\/+ASM2\/metadata\/INC_METER_SUMMARY.ams], [0], [4], [], [], [], [], [], [], [], []\nORA-27072: File I\/O error\nLinux-x86_64 Error: 22: Invalid argument\nAdditional information: 4\nAdditional information: 1\nAdditional information: 4294967295\n<\/pre>\n<p>&#8230; and this:<\/p>\n<pre class=\"brush: text; gutter: true; first-line: 1\">\nERROR: create the ADR schema in the specified ADR Base directory [\/disk00\/app\/grid]\nERROR: The ORA-48178 error is caused by the ORA-48101 error. \nORA-48101: error encountered when attempting to read a file [block] [\/disk00\/app\/grid\/diag\/asm\/+asm\/+ASM1\/metadata\/ADR_INTERNAL.mif] [0]\nORA-27072: File I\/O error\nLinux-x86_64 Error: 22: Invalid argument\nAdditional information: 4\nAdditional information: 1\nAdditional information: 4294967295\n<\/pre>\n<p><!--more--><\/p>\n<p>As it turned out this was an issue with the <a href=\"http:\/\/xfs.org\/index.php\/Main_Page\" target=\"_blank\" rel=\"noopener\">xfs<\/a> block size. In the configuration we had the block size was set to 4096 (this was chosen by default when the file system got created):<\/p>\n<pre class=\"brush: sql; gutter: true; first-line: 1; highlight: [5]\">\n$:\/disk00\/app\/grid\/diag\/asm\/+asm\/+ASM1\/metadata\/ [+ASM1] xfs_info \/disk00\nmeta-data=\/dev\/mapper\/vg_root-lv_disk00 isize=512    agcount=4, agsize=13107200 blks\n         =                       sectsz=4096  attr=2, projid32bit=1\n         =                       crc=1        finobt=0 spinodes=0\ndata     =                       bsize=4096   blocks=52428800, imaxpct=25\n         =                       sunit=0      swidth=0 blks\nnaming   =version 2              bsize=4096   ascii-ci=0 ftype=1\nlog      =internal               bsize=4096   blocks=25600, version=2\n         =                       sectsz=4096  sunit=1 blks, lazy-count=1\nrealtime =none                   extsz=4096   blocks=0, rtextents=0\n$:\/disk00\/app\/grid\/diag\/asm\/+asm\/+ASM1\/metadata\/ [+ASM1] \n<\/pre>\n<p>After changing that to 512 all was fine again:<\/p>\n<pre class=\"brush: sql; gutter: true; first-line: 1; highlight: [5]\">\n$:\/home\/ [+ASM1] xfs_info \/disk00\/\nmeta-data=\/dev\/mapper\/disk00     isize=256    agcount=4, agsize=104857600 blks\n         =                       sectsz=512   attr=2, projid32bit=1\n         =                       crc=0        finobt=0 spinodes=0\ndata     =                       bsize=512    blocks=419430400, imaxpct=25\n         =                       sunit=0      swidth=0 blks\nnaming   =version 2              bsize=4096   ascii-ci=0 ftype=1\nlog      =internal               bsize=512    blocks=204800, version=2\n         =                       sectsz=512   sunit=0 blks, lazy-count=1\nrealtime =none                   extsz=4096   blocks=0, rtextents=0\n$:\/home\/ [+ASM1] \n<\/pre>\n<p>Indeed this was not so easy because the <a href=\"https:\/\/www.cisco.com\/c\/dam\/en\/us\/products\/collateral\/servers-unified-computing\/ucs-b-series-blade-servers\/b200m4-specsheet.pdf\" target=\"_blank\" rel=\"noopener\">Cisco UCS systems<\/a> we used for that came with internal disks that had a 4k sector size so we couldn&#8217;t even create a new xfs file system on that with the settings required.<\/p>\n<pre class=\"brush: sql; gutter: true; first-line: 1; highlight: [4]\">\n[root@xxxx ~]# mkfs.xfs -s size=512 -m crc=0 -b size=512\n        \/dev\/mapper\/vg_root-lv_disk00_test \n\n      illegal sector size 512; hwsector is 4096\n<\/pre>\n<p>The solution was to get a LUN from the storage and use that instead. Another important note from the above linked data sheet:<\/p>\n<p><b>NOTE:  4K format drives are supported and qualified as bootable with Cisco UCS Manager Release 3.1(2b)and later versions. However, 4K sector format drives do not support VMware and require UEFI boot.<\/b><\/p>\n<p>Be careful &#8230;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today, after we did a fresh setup of a Grid Infrastructure cluster (12.1.0.2.170814) we faced two issues reported in the alert.log of the ASM instances (in fact you would see the same for the alert logs of any instance in that configuration but we did not had any other instance up and running at that [&hellip;]<\/p>\n","protected":false},"author":28,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[229],"tags":[1174,96,1031],"type_dbi":[],"class_list":["post-10464","post","type-post","status-publish","format-standard","hentry","category-database-administration-monitoring","tag-adr","tag-oracle","tag-xfs"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v28.8 (Yoast SEO v28.8) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives - dbi Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives\" \/>\n<meta property=\"og:description\" content=\"Today, after we did a fresh setup of a Grid Infrastructure cluster (12.1.0.2.170814) we faced two issues reported in the alert.log of the ASM instances (in fact you would see the same for the alert logs of any instance in that configuration but we did not had any other instance up and running at that [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2017-09-21T10:09:25+00:00\" \/>\n<meta name=\"author\" content=\"Open source Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Open source Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\\\/\"},\"author\":{\"name\":\"Open source Team\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#\\\/schema\\\/person\\\/4bae5e5dd8c7d48edbd948772b49b202\"},\"headline\":\"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives\",\"datePublished\":\"2017-09-21T10:09:25+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\\\/\"},\"wordCount\":216,\"commentCount\":0,\"keywords\":[\"ADR\",\"Oracle\",\"XFS\"],\"articleSection\":[\"Database Administration &amp; Monitoring\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\\\/\",\"url\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\\\/\",\"name\":\"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#website\"},\"datePublished\":\"2017-09-21T10:09:25+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#\\\/schema\\\/person\\\/4bae5e5dd8c7d48edbd948772b49b202\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#\\\/schema\\\/person\\\/4bae5e5dd8c7d48edbd948772b49b202\",\"name\":\"Open source Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g\",\"caption\":\"Open source Team\"},\"url\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/author\\\/open-source-team\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives - dbi Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/","og_locale":"en_US","og_type":"article","og_title":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives","og_description":"Today, after we did a fresh setup of a Grid Infrastructure cluster (12.1.0.2.170814) we faced two issues reported in the alert.log of the ASM instances (in fact you would see the same for the alert logs of any instance in that configuration but we did not had any other instance up and running at that [&hellip;]","og_url":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/","og_site_name":"dbi Blog","article_published_time":"2017-09-21T10:09:25+00:00","author":"Open source Team","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Open source Team","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/"},"author":{"name":"Open source Team","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/4bae5e5dd8c7d48edbd948772b49b202"},"headline":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives","datePublished":"2017-09-21T10:09:25+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/"},"wordCount":216,"commentCount":0,"keywords":["ADR","Oracle","XFS"],"articleSection":["Database Administration &amp; Monitoring"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/","url":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/","name":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"datePublished":"2017-09-21T10:09:25+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/4bae5e5dd8c7d48edbd948772b49b202"},"breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/be-careful-when-putting-the-oracle-adr-on-xfs-or-better-4k-sector-format-drives\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Be careful when putting the Oracle ADR on xfs, or better 4K sector format drives"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/4bae5e5dd8c7d48edbd948772b49b202","name":"Open source Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/eb4fb12e386e8c41fdef0733e8114594cf2653e4f55e9fa2161442b8eaf3f657?s=96&d=mm&r=g","caption":"Open source Team"},"url":"https:\/\/www.dbi-services.com\/blog\/author\/open-source-team\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/10464","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/28"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=10464"}],"version-history":[{"count":0,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/10464\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=10464"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=10464"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=10464"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=10464"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}