Your Patroni cluster does exactly what you built it to do. A node dies at 3 a.m., a new primary is elected in a few seconds, the application reconnects, and nobody gets paged. Your HA setup works. And yet, somewhere downstream, your change-data-capture pipeline has just gone quiet. Debezium or Flink CDC was streaming every change out of that database…
Introduction When wanting to migrate from the big red to PostgreSQL, most of the time you can afford the downtime of the export/import process and starting from something fresh. It is simple and reliable. Ora2pg being one of the go-to tools for that. But sometimes, you can afford the downtime, either because the database is critical for business operations or…
Introduction “Make it simple.” When you have to create a solution, design an architecture, you should always take the simplest path, this is often the better solution proven by field knowledge and experiences of not scalable patterns. Which means also that you should only add the necessary and required complexity to your solutions. So while following this principle I tried…
In my first blog-post about Striim, I showed you how to create an Initial Load from an on-premise database to an Azure SQL DB. In this second blog post I will create an application which will stream Data Changes from a CDC-Enabled on-premise SQL Database to my Azure SQL Database. The first step is to enable CDC (Chane Data Capture)…
By Franck Pachot . In a previous post I presented how Dbvisit replicate can capture changes and write them in an audit table with old and new values. Here is how to do it wen you want only the new values – with same column names. What I want to get here is a table with: same column names as…
By Franck Pachot . You don’t want to reload the datawarehouse database every night. And you may want to have it refreshed more often, in real-time during the day. There is another reason to capture all changes from the operational database: you want the history of all updates and not only the current value. This is why you use Change…
