{"id":17164,"date":"2022-04-11T13:12:52","date_gmt":"2022-04-11T11:12:52","guid":{"rendered":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/"},"modified":"2022-05-31T16:40:02","modified_gmt":"2022-05-31T14:40:02","slug":"striim-real-time-data-integration","status":"publish","type":"post","link":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/","title":{"rendered":"Striim, real-time data integration"},"content":{"rendered":"

In my first blog-post<\/a> about Striim, I showed you how to create an Initial Load from an on-premise database to an Azure SQL DB.
\nIn this second blog post I will create an application which will stream Data Changes from a CDC-Enabled on-premise SQL Database to my Azure SQL Database.<\/p>\n

The first step is to enable CDC (Chane Data Capture) on the on-premise SQL Server database.
\nCDC uses the SQL Server agent to record insert, update, and delete activity that applies to a table.
\nI will enable CDC on my Pokemon database and also on my table named Pokemons by executing the following script:<\/p>\n

USE Pokemon
\nGO
\nEXEC sys.sp_cdc_enable_db
\nGO
\nselect is_cdc_enabled, * from sys.databases where name = 'Pokemon'
\nGO
\nEXEC sys.sp_cdc_enable_table @source_schema = N'dbo', @source_name = N'Pokemons',@role_name = null
\nGO
\nselect is_tracked_by_cdc, * from sys.tables where name = 'Pokemons'<\/code><\/p>\n

On Striim Platform, I will create a new app named StreamReplicationPok and select a Streaming Integration from SQL Server CDC to Azure SQL Database:
\n\"\"<\/a>
\nI name my new application:
\n\"\"<\/a>
\nI set my source database information:
\n\"\"<\/a>
\nStriim validates the connectivity to my instance and database, checks the metadata and the CDC permissions:
\n\"\"<\/a>
\nSame as last blog, I will now select my schema to move: dbo and after select my table to load from my schema: my Pokemons table.
\nAfter some validation I will now enter information to connect to my Azure SQL Database:
\n\"\"<\/a>
\nOnce done the application is created and we can review our populated information for the source and target:
\n\"\"<\/a>
\nWe can deploy the application and once done Start the App.
\nMy application is now waiting that some DML commands are running against my source to replicate it on my target:
\n\"\"<\/a>
\nI will generate some insert, update and delete on my source table and check what I can see on the monitor progress dashboard:
\n\"\"<\/a>
\nI can visualize the DML I have executed against my source table and which have been replicated to my Azure SQL Database target.
\nMore information are available by clicking the \u201cView Detailed Metrics\u201d:
\n\"\"<\/a>
\nMy Azure SQL Database is now ready to accept user connections for Offload Operational Reporting with real-time data as it is continuously feeding with data modification from my source with no overhead on the primary.
\nWe should also use the same process to migrate a database to the cloud without any downtime or very limited one.<\/p>\n

It was very interesting to test Striim which I didn\u2019t know and gave me the opportunity to discover a tool very similar in my opinion to Qlik Replicate.
\nI hope it can help you for a future migration or live data replication.<\/p>\n","protected":false},"excerpt":{"rendered":"

In my first blog-post about Striim, I showed you how to create an Initial Load from an on-premise database to an Azure SQL DB. In this second blog post I will create an application which will stream Data Changes from a CDC-Enabled on-premise SQL Database to my Azure SQL Database. The first step is to […]<\/p>\n","protected":false},"author":21,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[955,198,99,48],"tags":[614,2526,51,2527,2525],"type_dbi":[],"class_list":["post-17164","post","type-post","status-publish","format-standard","hentry","category-cloud","category-database-management","category-sql-server","category-technology-survey","tag-cdc","tag-real-time-replication","tag-sql-server","tag-stream-integration","tag-striim"],"acf":[],"yoast_head":"\nStriim, real-time data integration - dbi Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Striim, real-time data integration\" \/>\n<meta property=\"og:description\" content=\"In my first blog-post about Striim, I showed you how to create an Initial Load from an on-premise database to an Azure SQL DB. In this second blog post I will create an application which will stream Data Changes from a CDC-Enabled on-premise SQL Database to my Azure SQL Database. The first step is to […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2022-04-11T11:12:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-05-31T14:40:02+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/03\/Blog2-1.png\" \/>\n<meta name=\"author\" content=\"St\u00e9phane Savorgnano\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"St\u00e9phane Savorgnano\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/\"},\"author\":{\"name\":\"St\u00e9phane Savorgnano\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/b6bce7d75118b35bdb3b439ad6a9ca3c\"},\"headline\":\"Striim, real-time data integration\",\"datePublished\":\"2022-04-11T11:12:52+00:00\",\"dateModified\":\"2022-05-31T14:40:02+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/\"},\"wordCount\":404,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/03\/Blog2-1.png\",\"keywords\":[\"cdc\",\"real-time replication\",\"SQL Server\",\"stream integration\",\"Striim\"],\"articleSection\":[\"Cloud\",\"Database management\",\"SQL Server\",\"Technology Survey\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/\",\"name\":\"Striim, real-time data integration - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/03\/Blog2-1.png\",\"datePublished\":\"2022-04-11T11:12:52+00:00\",\"dateModified\":\"2022-05-31T14:40:02+00:00\",\"author\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/b6bce7d75118b35bdb3b439ad6a9ca3c\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#primaryimage\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/03\/Blog2-1.png\",\"contentUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/03\/Blog2-1.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.dbi-services.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Striim, real-time data integration\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/b6bce7d75118b35bdb3b439ad6a9ca3c\",\"name\":\"St\u00e9phane Savorgnano\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/88d2a790f775c52c1012ec644d883431da758f2cbcfc16067ade04d2ef625ef5?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/88d2a790f775c52c1012ec644d883431da758f2cbcfc16067ade04d2ef625ef5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/88d2a790f775c52c1012ec644d883431da758f2cbcfc16067ade04d2ef625ef5?s=96&d=mm&r=g\",\"caption\":\"St\u00e9phane Savorgnano\"},\"description\":\"St\u00e9phane Savorgnano has more than fifteen years of experience in Microsoft software development and in SQL Server database solutions. He is specialized in SQL Server installation, performance analysis, best practices, etc. St\u00e9phane Savorgnano is Microsoft Certified Solutions Associate (MCSA) and\u00a0Microsoft Certified Solutions Expert (MCSE) for SQL Server 2012. He is also Microsoft Certified Technology Specialist (MCTS) and Microsoft Certified IT Professional (MCITP) for SQL Server 2008 as well as ITIL Foundation V3 certified. Prior to joining dbi services, he was software engineer at Ciba Specialty Chemicals in Basel. St\u00e9phane Savorgnano holds a Master of Informatics from Mulhouse University (F). His branch-related experience covers Banking \/ Financial Services, Chemicals & Pharmaceuticals, etc.\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/author\/stephane-savorgnano\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Striim, real-time data integration - dbi Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/","og_locale":"en_US","og_type":"article","og_title":"Striim, real-time data integration","og_description":"In my first blog-post about Striim, I showed you how to create an Initial Load from an on-premise database to an Azure SQL DB. In this second blog post I will create an application which will stream Data Changes from a CDC-Enabled on-premise SQL Database to my Azure SQL Database. The first step is to […]","og_url":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/","og_site_name":"dbi Blog","article_published_time":"2022-04-11T11:12:52+00:00","article_modified_time":"2022-05-31T14:40:02+00:00","og_image":[{"url":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/03\/Blog2-1.png","type":"","width":"","height":""}],"author":"St\u00e9phane Savorgnano","twitter_card":"summary_large_image","twitter_misc":{"Written by":"St\u00e9phane Savorgnano","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/"},"author":{"name":"St\u00e9phane Savorgnano","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/b6bce7d75118b35bdb3b439ad6a9ca3c"},"headline":"Striim, real-time data integration","datePublished":"2022-04-11T11:12:52+00:00","dateModified":"2022-05-31T14:40:02+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/"},"wordCount":404,"commentCount":0,"image":{"@id":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#primaryimage"},"thumbnailUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/03\/Blog2-1.png","keywords":["cdc","real-time replication","SQL Server","stream integration","Striim"],"articleSection":["Cloud","Database management","SQL Server","Technology Survey"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/","url":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/","name":"Striim, real-time data integration - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#primaryimage"},"image":{"@id":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#primaryimage"},"thumbnailUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/03\/Blog2-1.png","datePublished":"2022-04-11T11:12:52+00:00","dateModified":"2022-05-31T14:40:02+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/b6bce7d75118b35bdb3b439ad6a9ca3c"},"breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#primaryimage","url":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/03\/Blog2-1.png","contentUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/03\/Blog2-1.png"},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/striim-real-time-data-integration\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Striim, real-time data integration"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/b6bce7d75118b35bdb3b439ad6a9ca3c","name":"St\u00e9phane Savorgnano","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/88d2a790f775c52c1012ec644d883431da758f2cbcfc16067ade04d2ef625ef5?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/88d2a790f775c52c1012ec644d883431da758f2cbcfc16067ade04d2ef625ef5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/88d2a790f775c52c1012ec644d883431da758f2cbcfc16067ade04d2ef625ef5?s=96&d=mm&r=g","caption":"St\u00e9phane Savorgnano"},"description":"St\u00e9phane Savorgnano has more than fifteen years of experience in Microsoft software development and in SQL Server database solutions. He is specialized in SQL Server installation, performance analysis, best practices, etc. St\u00e9phane Savorgnano is Microsoft Certified Solutions Associate (MCSA) and\u00a0Microsoft Certified Solutions Expert (MCSE) for SQL Server 2012. He is also Microsoft Certified Technology Specialist (MCTS) and Microsoft Certified IT Professional (MCITP) for SQL Server 2008 as well as ITIL Foundation V3 certified. Prior to joining dbi services, he was software engineer at Ciba Specialty Chemicals in Basel. St\u00e9phane Savorgnano holds a Master of Informatics from Mulhouse University (F). His branch-related experience covers Banking \/ Financial Services, Chemicals & Pharmaceuticals, etc.","url":"https:\/\/www.dbi-services.com\/blog\/author\/stephane-savorgnano\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/17164","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=17164"}],"version-history":[{"count":1,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/17164\/revisions"}],"predecessor-version":[{"id":17165,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/17164\/revisions\/17165"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=17164"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=17164"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=17164"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=17164"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}