{"id":3976,"date":"2014-09-13T09:03:09","date_gmt":"2014-09-13T07:03:09","guid":{"rendered":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/"},"modified":"2014-09-13T09:03:09","modified_gmt":"2014-09-13T07:03:09","slug":"mysql-high-availability-management-with-clustercontrol","status":"publish","type":"post","link":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/","title":{"rendered":"MySQL high availability management with ClusterControl"},"content":{"rendered":"<p>Installing and managing a highly available MySQL infrastructure can be really tedious. Solutions to facilitate database and system administrator\u2019s task exist, but few of these cover the complete database lifecycle and address all the database infrastructure management requirements. Severalnines\u2019 product ClusterControl is probably the only solution that covers the full infrastructure lifecycle and is also able to provide a full set of functionalities required by database cluster architectures. In this article, I will show how to install, monitor and administrate a database cluster with ClusterControl.<\/p>\n<h3>Introduction<\/h3>\n<p>Severalnines is a Swedish company mostly composed of ex-MySQL AB staff. Severalnines provides automation and management software for database clusters. Severalnines\u2019 ClusterControl perfectly fits this objective by providing a full \u201cdeploy, manage, monitor, and scale\u201d solution. ClusterControl supports several database cluster technologies such as: Galera Cluster for MySQL, Percona XtraDB Cluster, MariaDB Galera Cluster, MySQL Cluster and MySQL Replication. However ClusterControl does not only support MySQL based cluster but also MongoDB clusters such as MongoDB Sharded Cluster, MongoDB Replica Set and TokuMX. In this article we will use Percona XtraDB Cluster to demonstrate ClusterControl functionalities.<\/p>\n<p align=\"justify\">\u00a0There are two different editions of ClusterControl: the community edition that provides basic functionalities and the enterprise edition that provides a full set of features and a really reactive support. All the details about the features of both editions can be found on the Severalnines website (<a href=\"http:\/\/www.severalnines.com\/clustercontrol\">http:\/\/www.severalnines.com\/ClusterControl<\/a>). In this article, we will detail four main global functionalities that are covered by ClusterControl:<\/p>\n<p>1. The cluster deployment<br \/>\n2. The cluster management<br \/>\n3. The cluster monitoring<br \/>\n4. The scalability functionalities<\/p>\n<p align=\"justify\">The cluster architecture that we chose for the purpose of this article is represented in Figure 1. This cluster is composed by three Percona XtraDB nodes (green), two HAProxy nodes (red) and one ClusterControl (blue).<\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrol001.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png\"><img decoding=\"async\" title=\"clustercontrol001.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png\" alt=\"clustercontrol001.png\" width=\"600\" \/><\/a><\/strong><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 1: Percona XtraDB Cluster architecture<\/strong><\/span><\/span><\/p>\n<h3>1. Cluster Deployment<\/h3>\n<p>As stated in the introduction, ClusterControl can manage several kinds of MySQL clusters or MongoDB clusters. The cluster deployment starts on Severalnines website on <a href=\"http:\/\/www.severalnines.com\/configurator\">http:\/\/www.severalnines.com\/configurator<\/a> by choosing the kind of cluster we want to install. Once we have selected Percona XtraDB Cluster (Galera), we can select on which infrastructure we want to deploy the cluster. We can choose between on-premise, Amazon EC2 or Rackspace. Since we want to install this cluster on our own infrastructure, our choice here is \u201con-premise\u201d.<\/p>\n<p>Then we simply have to fill in the general settings forms by specifying parameters such as operating system, platform, number of cluster nodes, ports number, OS user, MySQL password, system memory, database size, etc., as presented in Figure 1.<\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup.png\"><img decoding=\"async\" title=\"clustercontrolsetup.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup.png\" alt=\"clustercontrolsetup.png\" \/><\/a><\/strong><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 2: General Settings<\/strong><\/span><\/span><\/p>\n<p>Once the general settings forms are filled in, we have to specify the nodes that belong to the Percona XtraDB cluster as well as the storage details.<br \/>\nThe first settings are related to the ClusterControl server, the ClusterControl address and memory. There are also the details regarding the Apache settings, since the web interface is based on an Apache web server:<\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup002.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup002.png\"><img decoding=\"async\" title=\"clustercontrolsetup002.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup002.png\" alt=\"clustercontrolsetup002.png\" \/><\/a><\/strong><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 3: ClusterControl settings<\/strong><\/span><\/span><\/p>\n<p>Now you can fill in the parameters related to the Percona XtraDB data nodes.<\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup003.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup003.png\"><img decoding=\"async\" title=\"clustercontrolsetup003.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup003.png\" alt=\"clustercontrolsetup003.png\" \/><\/a><\/strong><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 4: Percona XtraDB nodes settings<\/strong><\/span><\/span><\/p>\n<p>Once all settings are entered, a deployment package can be automatically generated through the \u201cGenerate Deployment Script\u201d button. We simply have to execute it on the ClusterControl server in order to deploy the cluster. Of course, it is still possible to edit the configuration parameters by editing the my.cnf file located in s9s-galera-1.0.0-\/mysql\/config\/my.cnf.<\/p>\n<p><code class=\"mceVisualAid mceVisualGuides\">[<a href=\"mailto:root@ClusterControl severalnines\">root@ClusterControl severalnines<\/a>]# tar xvzf s9s-galera-percona-2.8.0-rpm.tar.gz<\/code><\/p>\n<p><code class=\"mceVisualAid mceVisualGuides\"> [<a href=\"mailto:root@ClusterControl severalnines\">root@ClusterControl severalnines<\/a>]# cd s9s-galera-percona-2.8.0-rpm\/mysql\/scripts\/install\/<\/code><\/p>\n<p><code class=\"mceVisualAid mceVisualGuides\">[<a href=\"mailto:root@ClusterControl install\">root@ClusterControl install<\/a>]# bash .\/deploy.sh 2&gt;&amp;1|tee cc.log<\/code><\/p>\n<p align=\"justify\">The deployment package will download and install Percona XtraDB Cluster on the database hosts, as well as the ClusterControl components to manage the cluster. When the installation is successfully finalized, we can access the ClusterControl web interface via http:\/\/ClusterControl<\/p>\n<p align=\"justify\">Once logged in to ClusterControl we are able to view all database systems that are managed and monitored by ClusterControl. This means that you can have several differing cluster installations, all managed from one ClusterControl web interface.<\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%;\" align=\"justify\"><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup004.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup004.png\"><img decoding=\"async\" title=\"clustercontrolsetup004.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup004.png\" alt=\"clustercontrolsetup004.png\" \/><\/a><\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%;\" align=\"justify\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 5: ClusterControl Database Clusters<\/strong><\/span><\/span><\/p>\n<p>Now the Percona XtraDB cluster is deployed and provides data high availability by using three data nodes. We still have to implement the service high availability and service scalability. In order to do that, we have to setup two HAProxy nodes in the frontend. Adding an HAProxy node with ClusterControl is a straightforward procedure. We would use a one-page wizard to specify the nodes to be included in the load balancing set and the node that will act as the load balancer, as presented in Figure 6.<\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup005.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup005.png\"><img decoding=\"async\" title=\"clustercontrolsetup005.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup005.png\" alt=\"clustercontrolsetup005.png\" \/><\/a><\/strong><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 6 : Load balancer installation, using HAProxy<\/strong><\/span><\/span><\/p>\n<p>To avoid having a Single Point Of Failure (SPOF), it is strongly advised to add a second HAProxy node by following the same procedure as for adding the first HAProxy node. Then simply add a Virtual IP, using the \u201cInstall Keepalived\u201d menu as presented in Figure 7.<\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%;\" align=\"justify\"><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup0x1.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup0x1.png\"><img decoding=\"async\" title=\"clustercontrolsetup0x1.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup0x1.png\" alt=\"clustercontrolsetup0x1.png\" \/><\/a><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\">\u00a0<span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 7: Virtual IP configuration using KeepAlived<\/strong><\/span><\/span><\/p>\n<h3>2. Cluster Management<\/h3>\n<p align=\"justify\">ClusterControl offers numbers of administration features such as: Online backup scheduling, configuration management, database node failover and recovery, schema management, manual start\/stop of nodes, process management, automated recovery, database user management, database upgrades\/downgrades, adding and removing nodes online, cloning (for galera clusters), configuration management (independently for each MySQL node) and comparing status of different cluster nodes.<\/p>\n<p align=\"justify\">Unfortunately, presenting all these great management functionalities is not possible in the context of this article. Therefore, we will focus on backup scheduling and user, schema, and configuration management.<\/p>\n<h4>a. Backup Scheduling<\/h4>\n<p align=\"justify\">As far as I remember, MySQL backup has always been a hot topic. ClusterControl offers three backup possibilities for MySQL databases: mysqldump, Percona Xtrabackup (full) and Percona Xtrabackup (incremental). Xtrabackup is a hot backup facility that does not lock the database during the backup. Scheduling the backups and having a look on performed backups is really easy with ClusterControl. It is also possible to immediately start a backup from the backup schedules\u2019 interface. The Figure 7 presents the backup scheduling screen.<\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%;\" align=\"justify\"><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup007.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup007.png\"><img decoding=\"async\" title=\"clustercontrolsetup007.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup007.png\" alt=\"clustercontrolsetup007.png\" \/><\/a><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 8: Backup scheduling screen (retouched image for the purpose of this article)<\/strong><\/span><\/span><\/p>\n<p align=\"justify\">You do not have to make a purge script to remove old backups anymore: ClusterControl is able to purge the backups after the definition of the retention period (from 0 to 365 days).<\/p>\n<p align=\"justify\">Unfortunately the restore procedure has to be managed manually since ClusterControl does not provide any graphical interface to restore a backup.<\/p>\n<h4>b. User, schema, and configuration management<\/h4>\n<p align=\"justify\">We can manage the database schemas, upload dumpfiles, and manage user privileges through the ClusterControl web interface.<\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup008.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup008.png\"><img decoding=\"async\" title=\"clustercontrolsetup008.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup008.png\" alt=\"clustercontrolsetup008.png\" \/><\/a><\/strong><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 9: MySQL user privileges management<\/strong><\/span><\/span><\/p>\n<p align=\"justify\">You can also change the my.cnf configuration file, apply the configuration changes across the entire cluster, and orchestrate a rolling restart \u2013 if required. Every configuration change is version-controlled.<\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup009.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup009.png\"><img decoding=\"async\" title=\"clustercontrolsetup009.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup009.png\" alt=\"clustercontrolsetup009.png\" \/><\/a><\/strong><\/span><\/span><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\">\u00a0<span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 10: MySQL Configuration management<\/strong><\/span><\/span><\/p>\n<p>New versions of the database software can be uploaded to ClusterControl, which then automates rolling software upgrades.<\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup010.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup010.png\"><img decoding=\"async\" title=\"clustercontrolsetup010.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup010.png\" alt=\"clustercontrolsetup010.png\" \/><\/a><\/strong><\/span><\/span><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 11: Rolling upgrade through ClusterControl interface<\/strong><\/span><\/span><\/p>\n<p>A production cluster can easily be cloned, with a full copy of the production data, e.g. for testing purposes.<\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup011.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup011.png\"><img decoding=\"async\" title=\"clustercontrolsetup011.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup011.png\" alt=\"clustercontrolsetup011.png\" \/><\/a><\/strong><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 12: Cloning Cluster screen<\/strong><\/span><\/span><\/p>\n<h3>3. Cluster monitoring<\/h3>\n<p>With ClusterControl, you are not only able to build a cluster from scratch or get a full set of cluster management functionalities. It is also a great monitoring tool that provides you with a number of graphs and indicators, such as the list of top queries (by execution time or Occurrence), the running queries, the query histogram, CPU\/Disk\/Swap\/RAM\/Network usage, Tables\/Databases growth, health check, and schema analyzer (showing tables without primary keys or redundant indexes). Furthermore, ClusterControl can record up to 48 different MySQL counters (such as opened tables, connected threads, aborted clients, etc.), present all these counters in charts, and many other helpful things that a database administrator will surely appreciate.<\/p>\n<p style=\"margin-bottom: 0in; line-height: 100%; page-break-before: always;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup012.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup012.png\"><img decoding=\"async\" title=\"clustercontrolsetup012.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup012.png\" alt=\"clustercontrolsetup012.png\" \/><\/a><\/strong><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 13: Database performance graphics with time range and zoom functionalities (retouched image for the purpose of this article)<\/strong><\/span><\/span><\/p>\n<p>ClusterControl provides some interesting information regarding database growth for data and indexes. Figure 14 presents a chart showing the database growth since the last 26 days.<\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup013.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup013.png\"><img decoding=\"async\" title=\"clustercontrolsetup013.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup013.png\" alt=\"clustercontrolsetup013.png\" \/><\/a><\/strong><\/span><\/span><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 14: Database growth since the last 26 days<\/strong><\/span><\/span><\/p>\n<p align=\"justify\">ClusterControl is also able to send e-mail notifications when alerts are raised or even create custom expressions. The database administrator can also setup its own warning as well as critical thresholds for CPU, RAM, disk space, and MySQL memory usage. The following figure represents the resource usage for a given node.<\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup014.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup014.png\"><img decoding=\"async\" title=\"clustercontrolsetup014.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup014.png\" alt=\"clustercontrolsetup014.png\" \/><\/a><\/strong><\/span><\/span><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 15: Resources usage for a Master node<\/strong><\/span><\/span><\/p>\n<p>Power users can set up custom KPIs, and get alerts in case of threshold breaches.<\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup015.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup015.png\"><img decoding=\"async\" title=\"clustercontrolsetup015.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup015.png\" alt=\"clustercontrolsetup015.png\" \/><\/a><\/strong><\/span><\/span><\/p>\n<p>\u00a0<span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 16: Custom KPIs definition<\/strong><\/span><\/span><\/p>\n<p>Health Report consists of a number of performance advisors that automatically examine the configuration and performance of the database servers, and alert in case of deviations from best practice rules.<\/p>\n<p><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup0xx.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup0xx.png\"><img decoding=\"async\" title=\"clustercontrolsetup0xx.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup0xx.png\" alt=\"clustercontrolsetup0xx.png\" \/><\/a><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 17: Health report with performance advisors<\/strong><\/span><\/span><\/p>\n<h3>4. Scalability functionalities<\/h3>\n<p align=\"justify\">Sooner or later it will be necessary to add or remove either a data node or a HAProxy node to the cluster for scalability or maintenance reasons. With ClusterControl, adding a new node is as easy as selecting the new host and giving it the role we want in the cluster. ClusterControl will automatically install the package needed for this new node and make the appropriate configuration in order to integrate it in the cluster. Of course, removing a node is just as easy.<\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\"><span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong><a class=\"easyblog-thumb-preview\" title=\"clustercontrolsetup017.png\" href=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup017.png\"><img decoding=\"async\" title=\"clustercontrolsetup017.png\" src=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrolsetup017.png\" alt=\"clustercontrolsetup017.png\" \/><\/a><\/strong><\/span><\/span><\/p>\n<p style=\"margin-bottom: 0.14in; line-height: 100%;\">\u00a0<span style=\"color: #4f81bd;\"><span style=\"font-size: x-small;\"><strong>Figure 18: New node addition and &#8220;add master&#8221; screens<\/strong><\/span><\/span><\/p>\n<h3>Conclusion<\/h3>\n<p align=\"justify\">With ClusterControl, Severalnines did a great job! For those who ever tried to build and administrate a highly available MySQL architecture using disparate clustering components such as heartbeat, DRBD (Data Replication Block Device), MySQL replication or any other high availability component, I am sure that you often wished to have a solution that provides a complete package. Deploying multiple clustering technologies can become a nightmare. Of course there are solutions such as MMM (Multi-Master replication Management for MySQL), but there is no solution covering the whole cluster lifecycle and offering such an amazing set of features via a nice web interface.<\/p>\n<p align=\"justify\">In addition to the great set of functionalities provided by ClusterControl, there is the Severalnines support: Their support team is amazingly efficient and reactive. The reaction time presented on the Severalnines website indicates 1 day but I never waited more than 1 hour before getting a first answer.<\/p>\n<p align=\"justify\">As stated in the introduction, there are two editions: The community edition with a limited set of functionalities is free, whereas the enterprise edition is available under a commercial license and support subscription agreement. This subscription includes ClusterControl software, upgrades, and 12 incidents per year. It is also interesting to notice that Severalnines and Percona are partners starting from this year.<\/p>\n<p>&nbsp;<\/p>\n<p align=\"justify\">The summary of my ClusterControl experience is presented in the table below:<\/p>\n<table style=\"width: 614px;\" cellspacing=\"0\" cellpadding=\"7\">\n<tbody>\n<tr valign=\"top\">\n<td style=\"border: 1px solid #00000a; padding: 0in 0.08in;\" bgcolor=\"#008000\" width=\"292\"><span style=\"color: #ffffff;\"><strong>Advantages<\/strong><\/span><\/td>\n<td style=\"border: 1px solid #00000a; padding: 0in 0.08in;\" bgcolor=\"#ff0000\" width=\"292\"><span style=\"color: #ffffff;\"><strong>Drawbacks \/ limitation<\/strong><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td style=\"border: 1px solid #00000a; padding: 0in 0.08in;\" width=\"292\">\n<p style=\"margin-bottom: 0in;\"><strong>+ Covers the whole cluster lifecycle from installation, upgrade as well as the management and monitoring phases<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p style=\"margin-bottom: 0in;\"><strong>+ Much easier to use than many other tools that do not even provide half of the ClusterControl functionalities<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p style=\"margin-bottom: 0in;\"><strong>+ Each operation includes a new job subscription \u2013 all operation are therefore logged<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p><strong>+ Amazingly reactive support!<\/strong><\/td>\n<td style=\"border: 1px solid #00000a; padding: 0in 0.08in;\" width=\"292\">\n<p style=\"margin-bottom: 0in;\"><strong>&#8211; Does not provide backup restore functionalities<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p><strong>&#8211; It is not possible to acknowledge alerts or blackout targets<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p align=\"justify\">Additional information can be found on <a href=\"http:\/\/www.severalnines.com\/blog\">http:\/\/www.severalnines.com\/blog<\/a>. Since dbi services is Severalnines partner and has installed this solution at several customer sites, feel free to contact us if you have any additional question regarding ClusterControl.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Installing and managing a highly available MySQL infrastructure can be really tedious. Solutions to facilitate database and system administrator\u2019s task exist, but few of these cover the complete database lifecycle and address all the database infrastructure management requirements. Severalnines\u2019 product ClusterControl is probably the only solution that covers the full infrastructure lifecycle and is also [&hellip;]<\/p>\n","protected":false},"author":10,"featured_media":3977,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[198],"tags":[38,483,84,144,484],"type_dbi":[],"class_list":["post-3976","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-database-management","tag-cluster","tag-clustercontrol","tag-high-availability","tag-mysql","tag-severalnines"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.2 (Yoast SEO v27.2) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>MySQL high availability management with ClusterControl - dbi Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"MySQL high availability management with ClusterControl\" \/>\n<meta property=\"og:description\" content=\"Installing and managing a highly available MySQL infrastructure can be really tedious. Solutions to facilitate database and system administrator\u2019s task exist, but few of these cover the complete database lifecycle and address all the database infrastructure management requirements. Severalnines\u2019 product ClusterControl is probably the only solution that covers the full infrastructure lifecycle and is also [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2014-09-13T07:03:09+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png\" \/>\n\t<meta property=\"og:image:width\" content=\"785\" \/>\n\t<meta property=\"og:image:height\" content=\"546\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Gr\u00e9gory Steulet\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Gr\u00e9gory Steulet\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"9 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/\"},\"author\":{\"name\":\"Gr\u00e9gory Steulet\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/7609faada8e4d63e04a28ae29e227098\"},\"headline\":\"MySQL high availability management with ClusterControl\",\"datePublished\":\"2014-09-13T07:03:09+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/\"},\"wordCount\":1851,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png\",\"keywords\":[\"Cluster\",\"ClusterControl\",\"High availability\",\"MySQL\",\"Severalnines\"],\"articleSection\":[\"Database management\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/\",\"name\":\"MySQL high availability management with ClusterControl - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png\",\"datePublished\":\"2014-09-13T07:03:09+00:00\",\"author\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/7609faada8e4d63e04a28ae29e227098\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#primaryimage\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png\",\"contentUrl\":\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png\",\"width\":785,\"height\":546},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.dbi-services.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"MySQL high availability management with ClusterControl\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/7609faada8e4d63e04a28ae29e227098\",\"name\":\"Gr\u00e9gory Steulet\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/e1531483285469fe17ea7a769ce5d8a8a01847185e4245d9c4d22c575c7c6d3e?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e1531483285469fe17ea7a769ce5d8a8a01847185e4245d9c4d22c575c7c6d3e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e1531483285469fe17ea7a769ce5d8a8a01847185e4245d9c4d22c575c7c6d3e?s=96&d=mm&r=g\",\"caption\":\"Gr\u00e9gory Steulet\"},\"description\":\"Gr\u00e9gory Steulet has more than ten years of experience in database and infrastructure management, engineering, and optimization. He is specialized in Oracle technologies and high availability solutions (Oracle DataGuard, Data Replication Block Device). His expertise also includes Avaloq banking applications, as well as the open source field (MySQL, Unix\/Linux, etc.). Gr\u00e9gory Steulet is \\\"Oracle Certified Professional 10g\\\", \\\"MySQL Cluster 5.1 Certified\\\", and \\\"Avaloq Certified Professional 2.6\\\". Prior to joining dbi services, Gr\u00e9gory Steulet was Senior Consultant at Trivadis in Lausanne. He also worked as IT Administrator at Box Telecom in Miami Beach, Florida (USA). Gr\u00e9gory Steulet has an Executive MBA from the International Institute of Management in Technology, Fribourg (CH). He also holds a Bachelor's Degree in Business Administration and Computer Science from the University of Applied Sciences Western Switzerland. His branch-related experience covers Telecommunications, Financial Services \/ Banking, Logistics, Pharma etc.\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/author\/gregory-steulet\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"MySQL high availability management with ClusterControl - dbi Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/","og_locale":"en_US","og_type":"article","og_title":"MySQL high availability management with ClusterControl","og_description":"Installing and managing a highly available MySQL infrastructure can be really tedious. Solutions to facilitate database and system administrator\u2019s task exist, but few of these cover the complete database lifecycle and address all the database infrastructure management requirements. Severalnines\u2019 product ClusterControl is probably the only solution that covers the full infrastructure lifecycle and is also [&hellip;]","og_url":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/","og_site_name":"dbi Blog","article_published_time":"2014-09-13T07:03:09+00:00","og_image":[{"width":785,"height":546,"url":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png","type":"image\/png"}],"author":"Gr\u00e9gory Steulet","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Gr\u00e9gory Steulet","Est. reading time":"9 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/"},"author":{"name":"Gr\u00e9gory Steulet","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/7609faada8e4d63e04a28ae29e227098"},"headline":"MySQL high availability management with ClusterControl","datePublished":"2014-09-13T07:03:09+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/"},"wordCount":1851,"commentCount":0,"image":{"@id":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#primaryimage"},"thumbnailUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png","keywords":["Cluster","ClusterControl","High availability","MySQL","Severalnines"],"articleSection":["Database management"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/","url":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/","name":"MySQL high availability management with ClusterControl - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#primaryimage"},"image":{"@id":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#primaryimage"},"thumbnailUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png","datePublished":"2014-09-13T07:03:09+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/7609faada8e4d63e04a28ae29e227098"},"breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#primaryimage","url":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png","contentUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/clustercontrol001.png","width":785,"height":546},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/mysql-high-availability-management-with-clustercontrol\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"MySQL high availability management with ClusterControl"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/7609faada8e4d63e04a28ae29e227098","name":"Gr\u00e9gory Steulet","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/e1531483285469fe17ea7a769ce5d8a8a01847185e4245d9c4d22c575c7c6d3e?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/e1531483285469fe17ea7a769ce5d8a8a01847185e4245d9c4d22c575c7c6d3e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e1531483285469fe17ea7a769ce5d8a8a01847185e4245d9c4d22c575c7c6d3e?s=96&d=mm&r=g","caption":"Gr\u00e9gory Steulet"},"description":"Gr\u00e9gory Steulet has more than ten years of experience in database and infrastructure management, engineering, and optimization. He is specialized in Oracle technologies and high availability solutions (Oracle DataGuard, Data Replication Block Device). His expertise also includes Avaloq banking applications, as well as the open source field (MySQL, Unix\/Linux, etc.). Gr\u00e9gory Steulet is \"Oracle Certified Professional 10g\", \"MySQL Cluster 5.1 Certified\", and \"Avaloq Certified Professional 2.6\". Prior to joining dbi services, Gr\u00e9gory Steulet was Senior Consultant at Trivadis in Lausanne. He also worked as IT Administrator at Box Telecom in Miami Beach, Florida (USA). Gr\u00e9gory Steulet has an Executive MBA from the International Institute of Management in Technology, Fribourg (CH). He also holds a Bachelor's Degree in Business Administration and Computer Science from the University of Applied Sciences Western Switzerland. His branch-related experience covers Telecommunications, Financial Services \/ Banking, Logistics, Pharma etc.","url":"https:\/\/www.dbi-services.com\/blog\/author\/gregory-steulet\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/3976","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=3976"}],"version-history":[{"count":0,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/3976\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media\/3977"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=3976"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=3976"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=3976"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=3976"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}