{"id":2181,"date":"2011-03-10T14:55:00","date_gmt":"2011-03-10T13:55:00","guid":{"rendered":"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/"},"modified":"2011-03-10T14:55:00","modified_gmt":"2011-03-10T13:55:00","slug":"flexible-io-simulating-database-like-io-activity-without-an-installed-database","status":"publish","type":"post","link":"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/","title":{"rendered":"Simulating database-like I\/O activity with Flexible I\/O"},"content":{"rendered":"

You do not want to install or configure swingbench, load runner etc. – just to test the performance of your I\/O system based on filesystems? Then Flexible I\/O is the right tool for you. This post provides an overview.<\/p>\n

In order to simulate Oracle database I\/O workload on filesystems, ORION cannot be used since it only uses raw or block devices (scratching the filesystem). To simulate Oracle database I\/O behaviour on filesystems, we can use the Flexible I\/O utility:
\nhttp:\/\/forums.oracle.com\/forums\/thread.jspa?threadID=1115772<\/a><\/p>\n

Flexible I\/O is presented here:
\nhttp:\/\/linux.die.net\/man\/1\/fio<\/a><\/p>\n

In our case, Flexible I\/O has been configured to simulate several load types similar to a database behavior, based on the following recommendations:
\nhttp:\/\/www.slideshare.net\/markwkm\/filesystem-performance-from-a-database-perspective<\/a><\/p>\n

The ext3 filesystem has been considered during the tests. Both asynchronous I\/O and direct I\/O have been enabled. The release 1.50 of the utility has been used. ext4 has not been considered since it is only reliable from Red Hat EL 6 on, and we were using a Red Hat 6 release.<\/p>\n

Flexible I\/O has been installed from the following resources:
\nhttp:\/\/rpm.pbone.net\/index.php3?stat=26&dist=52&size=176279&name=fio-1.50-1.el5.rf.x86_64.rpm<\/a><\/p>\n

The following Flexible I\/O features do really help to perform tests neat to the database I\/O reality:<\/p>\n

– Flexible I\/O simulates I\/O on a pre-allocated file, based on the filesystem (like Oracle uses its own files)
\n– It can simulate sequential or random reads or writes
\n– It can also simulate mixed workload (reads and writes, you can set the spreading between read and writes – like a database)
\n– Flexible I\/O allows to set the block size used to simulate the I\/O (ideal for database workload simulation)
\n– Flexible I\/O allows to simulate both direct and asynchronous I\/O (based on the libaio engine)
\n– Finally, Flexible I\/O allows to parallelize the load by allocating several processes (in this case the file size should be adapted, since each process will use its own file for I\/O simulation)<\/p>\n

The following configuration file has been created, with several sections corresponding to different I\/O types (sequential, random, etc.):<\/p>\n

oracle@server01:~\/fio_tests\/ cat fio_config.cfg\n [seq-read]\n # Sequential reads\n rw=read\n # Size if the the I\/O\n size=8g\n # Directory where the test file will be created\n directory=\/utest\n # Diables posix_fadvise - predeclare an access pattern for file data\n fadvise_hint=0\n # Block size\n blocksize=8k\n # Use of direct I\/O\n direct=1\n # Number of I\/O threads :\n numjobs=1\n # Number of files :\n nrfiles=1\n # Duration of the test in seconds\n runtime=300\n # Usage of ASYNC I\/O\n ioengine=libaio\n # Runtime based, overwrites or overreads several times the specified file\n time_based\n # To free pagecache, dentries and inodes (only possible as root, therefore commented out) :\n # exec_prerun=echo 3 > \/proc\/sys\/vm\/drop_caches\n[seq-write]\n rw=write\n size=8g\n directory=\/utest\n fadvise_hint=0\n blocksize=8k\n direct=1\n numjobs=1\n nrfiles=1\n runtime=300\n ioengine=libaio\n time_based\n # exec_prerun=echo 3 > \/proc\/sys\/vm\/drop_caches\n[random-read]\n # Each process allocates one file, therefore to have 8G the size should be set to 1G with 8 processes\n rw=randread\n size=1g\n directory=\/utest\n fadvise_hint=0\n blocksize=8k\n direct=1\n numjobs=8\n nrfiles=1\n runtime=300\n ioengine=libaio\n time_based\n # exec_prerun=echo 3 > \/proc\/sys\/vm\/drop_caches\n[random-write]\n # Each process allocates one file, therefore to have 8G the size should be set to 1G with 8 processes\n rw=randwrite\n size=1g\n directory=\/utest\n fadvise_hint=0\n blocksize=8k\n direct=1\n numjobs=8\n nrfiles=1\n runtime=300\n ioengine=libaio\n time_based\n # exec_prerun=echo 3 > \/proc\/sys\/vm\/drop_caches\n[read-write]\n # Each process allocates one file, therefore to have 8G the size should be set to 1G with 8 processes\n rw=rw\n rwmixread=80\n size=1g\n directory=\/utest\n fadvise_hint=0\n blocksize=8k\n direct=1\n numjobs=8\n nrfiles=1\n runtime=300\n ioengine=libaio\n time_based\n # exec_prerun=echo 3 > \/proc\/sys\/vm\/drop_caches<\/pre>\n
To start the tool, give the configuration file as parameter as well as the section you wannt to run :
\nfio –section=seq-read fio_config.cfg<\/p>\n
Make sure the filesystem \/utest has enough space to allocate the test file (its size is defined by “size”).
\nExplaining and discussing the results is of course out of the scope of this post, but just drop a comment and I will come back to you!<\/p>\n","protected":false},"excerpt":{"rendered":"
You do not want to install or configure swingbench, load runner etc. – just to test the performance of your I\/O system based on filesystems? Then Flexible I\/O is the right tool for you. This post provides an overview. In order to simulate Oracle database I\/O workload on filesystems, ORION cannot be used since it […]<\/p>\n","protected":false},"author":9,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[197],"tags":[14,17,244],"type_dbi":[],"class_list":["post-2181","post","type-post","status-publish","format-standard","hentry","category-application-integration-middleware","tag-i-o","tag-oracle-11g","tag-workload"],"acf":[],"yoast_head":"\nSimulating database-like I\/O activity with Flexible I\/O - dbi Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Simulating database-like I\/O activity with Flexible I\/O\" \/>\n<meta property=\"og:description\" content=\"You do not want to install or configure swingbench, load runner etc. – just to test the performance of your I\/O system based on filesystems? Then Flexible I\/O is the right tool for you. This post provides an overview. In order to simulate Oracle database I\/O workload on filesystems, ORION cannot be used since it […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2011-03-10T13:55:00+00:00\" \/>\n<meta name=\"author\" content=\"Yann Neuhaus\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Yann Neuhaus\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/\"},\"author\":{\"name\":\"Yann Neuhaus\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/5bfc203607127a4915b7950c4a108681\"},\"headline\":\"Simulating database-like I\/O activity with Flexible I\/O\",\"datePublished\":\"2011-03-10T13:55:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/\"},\"wordCount\":460,\"commentCount\":0,\"keywords\":[\"I\/O\",\"Oracle 11g\",\"Workload\"],\"articleSection\":[\"Application integration & Middleware\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/\",\"name\":\"Simulating database-like I\/O activity with Flexible I\/O - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\"},\"datePublished\":\"2011-03-10T13:55:00+00:00\",\"author\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/5bfc203607127a4915b7950c4a108681\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.dbi-services.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Simulating database-like I\/O activity with Flexible I\/O\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/5bfc203607127a4915b7950c4a108681\",\"name\":\"Yann Neuhaus\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/d2729b4bbf77b0fe6f6d2b9fb1b2686404c89a16ce2701e860bfd1406212f796?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d2729b4bbf77b0fe6f6d2b9fb1b2686404c89a16ce2701e860bfd1406212f796?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d2729b4bbf77b0fe6f6d2b9fb1b2686404c89a16ce2701e860bfd1406212f796?s=96&d=mm&r=g\",\"caption\":\"Yann Neuhaus\"},\"url\":\"https:\/\/www.dbi-services.com\/blog\/author\/yann-neuhaus\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Simulating database-like I\/O activity with Flexible I\/O - dbi Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/","og_locale":"en_US","og_type":"article","og_title":"Simulating database-like I\/O activity with Flexible I\/O","og_description":"You do not want to install or configure swingbench, load runner etc. – just to test the performance of your I\/O system based on filesystems? Then Flexible I\/O is the right tool for you. This post provides an overview. In order to simulate Oracle database I\/O workload on filesystems, ORION cannot be used since it […]","og_url":"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/","og_site_name":"dbi Blog","article_published_time":"2011-03-10T13:55:00+00:00","author":"Yann Neuhaus","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Yann Neuhaus","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/"},"author":{"name":"Yann Neuhaus","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/5bfc203607127a4915b7950c4a108681"},"headline":"Simulating database-like I\/O activity with Flexible I\/O","datePublished":"2011-03-10T13:55:00+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/"},"wordCount":460,"commentCount":0,"keywords":["I\/O","Oracle 11g","Workload"],"articleSection":["Application integration & Middleware"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/","url":"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/","name":"Simulating database-like I\/O activity with Flexible I\/O - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"datePublished":"2011-03-10T13:55:00+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/5bfc203607127a4915b7950c4a108681"},"breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/flexible-io-simulating-database-like-io-activity-without-an-installed-database\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Simulating database-like I\/O activity with Flexible I\/O"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/5bfc203607127a4915b7950c4a108681","name":"Yann Neuhaus","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/d2729b4bbf77b0fe6f6d2b9fb1b2686404c89a16ce2701e860bfd1406212f796?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/d2729b4bbf77b0fe6f6d2b9fb1b2686404c89a16ce2701e860bfd1406212f796?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d2729b4bbf77b0fe6f6d2b9fb1b2686404c89a16ce2701e860bfd1406212f796?s=96&d=mm&r=g","caption":"Yann Neuhaus"},"url":"https:\/\/www.dbi-services.com\/blog\/author\/yann-neuhaus\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/2181","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=2181"}],"version-history":[{"count":0,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/2181\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=2181"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=2181"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=2181"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=2181"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}