{"id":17148,"date":"2022-03-04T17:16:01","date_gmt":"2022-03-04T16:16:01","guid":{"rendered":"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/"},"modified":"2023-06-20T10:13:24","modified_gmt":"2023-06-20T08:13:24","slug":"oracle-21c-broker-fast-start-failover-callout-scripts-in-action","status":"publish","type":"post","link":"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/","title":{"rendered":"Oracle 21c Broker : Fast-Start Failover Callout Scripts in Action"},"content":{"rendered":"

By Mouhamadou Diaw<\/strong><\/p>\n

With Oracle 21c (In fact Oracle 20c), we have a nice new feature with the broker which is the Fast-start Failover Callout Configuration scripts.
\nI talked about this feature in some presentations I did about the new features with Oracle 21c for the broker
\nThis feature will allow to automate tasks that must be performed before and after a fast-start failover operation.<\/p>\n

Yes this means that with Oracle 21c, we can configure some tasks to be executed before and after doing a fast_start failover. Sure that this feature will make life easier.<\/p>\n

The use of this feature is very simple<\/p>\n

We have to configure the DG_ADMIN variable which will be the default location of Client-side Broker Files. See my previous blog <\/a><\/p>\n

The callout scripts should be located in the $DG_ADMIN\/config_ConfigurationSimpleName\/callout.
\nThe configuration file must be named fsfocallout.ora, and it’s mandatory.
\nThis fsfocallout.ora file will contain the names of the pre-callout configuration script and post-callout configuration script.<\/p>\n

The pre_callout script must create a .suc file and a .err file. Before doing a FSFO, then the observer will check for .suc file or a for a .err file. If a .suc file exists then the observer will initiate a FSFO.<\/p>\n

The .suc file and the .err file must be at the same location that the callout scripts.<\/p>\n

Below the configuration I am using<\/p>\n

oraadserver : 192.168.2.21 for the primary database
\noraadserver2 : 192.168.2.22 for the standby database
\noraadserver3 : 192.168.2.23 for the observer<\/p>\n

The FSFO is already configured<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n
4<\/div>\n
5<\/div>\n
6<\/div>\n
7<\/div>\n
8<\/div>\n
9<\/div>\n
10<\/div>\n
11<\/div>\n
12<\/div>\n
13<\/div>\n<\/td>\n
\n
\n
DGMGRL> show configuration<\/code><\/div>\n
<\/div>\n
Configuration - db21<\/code><\/div>\n
<\/div>\n
\u00a0\u00a0<\/code>Protection Mode: MaxPerformance<\/code><\/div>\n
\u00a0\u00a0<\/code>Members:<\/code><\/div>\n
\u00a0\u00a0<\/code>DB21_SITE1 - <\/code>Primary<\/code> database<\/code><\/div>\n
\u00a0\u00a0\u00a0\u00a0<\/code>DB21_SITE2 - (*) Physical standby <\/code>database<\/code><\/div>\n
<\/div>\n
Fast-Start Failover: Enabled <\/code>in<\/code> Potential Data Loss Mode<\/code><\/div>\n
<\/div>\n
Configuration Status:<\/code><\/div>\n
SUCCESS\u00a0\u00a0 (status updated 5 seconds ago)<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

And the observer is running<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n
4<\/div>\n
5<\/div>\n
6<\/div>\n
7<\/div>\n
8<\/div>\n
9<\/div>\n
10<\/div>\n
11<\/div>\n
12<\/div>\n
13<\/div>\n
14<\/div>\n
15<\/div>\n
16<\/div>\n
17<\/div>\n
18<\/div>\n<\/td>\n
\n
\n
DGMGRL> show observer<\/code><\/div>\n
<\/div>\n
Configuration - db21<\/code><\/div>\n
<\/div>\n
\u00a0\u00a0<\/code>Fast-Start Failover:\u00a0\u00a0\u00a0\u00a0 ENABLED<\/code><\/div>\n
<\/div>\n
\u00a0\u00a0<\/code>Primary<\/code>:\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 DB21_SITE1<\/code><\/div>\n
\u00a0\u00a0<\/code>Active Target:\u00a0\u00a0\u00a0\u00a0\u00a0 DB21_SITE2<\/code><\/div>\n
<\/div>\n
Observer <\/code>\"oraadserver3\"<\/code> - Master<\/code><\/div>\n
<\/div>\n
\u00a0\u00a0<\/code>Host <\/code>Name<\/code>:\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 oraadserver3<\/code><\/div>\n
\u00a0\u00a0<\/code>Last<\/code> Ping <\/code>to<\/code> Primary<\/code>:\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 2 seconds ago<\/code><\/div>\n
\u00a0\u00a0<\/code>Last<\/code> Ping <\/code>to<\/code> Target:\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 0 seconds ago<\/code><\/div>\n
\u00a0\u00a0<\/code>Log File:\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/log\/observer_oraadserver3.log<\/code><\/div>\n
\u00a0\u00a0<\/code>State File:\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/dat\/fsfo.dat<\/code><\/div>\n
<\/div>\n
DGMGRL><\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

On my observer server, the $DG_ADMIN variable is configured (directories of the DG_ADMIN must have some prerequisites (see previous blog <\/a> or the documentation <\/a> )<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n<\/td>\n
\n
\n
[oracle@oraadserver3 callout]$ <\/code>echo<\/code> $DG_ADMIN\/<\/code><\/div>\n
\/u01\/app\/oracle\/admin\/prod20\/broker_files\/<\/code><\/div>\n
[oracle@oraadserver3 callout]$<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

And in the $DG_ADMIN<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n
4<\/div>\n
5<\/div>\n
6<\/div>\n
7<\/div>\n
8<\/div>\n
9<\/div>\n
10<\/div>\n
11<\/div>\n
12<\/div>\n
13<\/div>\n
14<\/div>\n
15<\/div>\n
16<\/div>\n
17<\/div>\n
18<\/div>\n
19<\/div>\n
20<\/div>\n
21<\/div>\n
22<\/div>\n
23<\/div>\n
24<\/div>\n
25<\/div>\n
26<\/div>\n
27<\/div>\n
28<\/div>\n
29<\/div>\n
30<\/div>\n<\/td>\n
\n
\n
[oracle@oraadserver3 callout]$ <\/code>ls<\/code> -lR $DG_ADMIN\/<\/code><\/div>\n
\/u01\/app\/oracle\/admin\/prod20\/broker_files\/<\/code>:<\/code><\/div>\n
total 0<\/code><\/div>\n
drwx------. 2 oracle oinstall\u00a0 6 Feb\u00a0 3\u00a0 2021 admin<\/code><\/div>\n
drwx------. 5 oracle oinstall 40 Feb 25 11:35 config_db21<\/code><\/div>\n
<\/div>\n
\/u01\/app\/oracle\/admin\/prod20\/broker_files\/admin<\/code>:<\/code><\/div>\n
total 0<\/code><\/div>\n
<\/div>\n
\/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21<\/code>:<\/code><\/div>\n
total 4<\/code><\/div>\n
drwx------. 2 oracle oinstall\u00a0\u00a0 99 Mar\u00a0 4 16:36 callout<\/code><\/div>\n
drwx------. 2 oracle oinstall\u00a0\u00a0 21 Nov 29 13:50 dat<\/code><\/div>\n
drwx------. 2 oracle oinstall 4096 Feb 25 13:35 log<\/code><\/div>\n
<\/div>\n
\/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/callout<\/code>:<\/code><\/div>\n
total 12<\/code><\/div>\n
-rwx------. 1 oracle oinstall 979 Mar\u00a0 4 16:24 fsfocallout.ora<\/code><\/div>\n
-rwx------. 1 oracle oinstall\u00a0 57 Feb 25 11:36 fsfo_postcallout<\/code><\/div>\n
-rwx------. 1 oracle oinstall 351 Mar\u00a0 4 16:35 fsfo_precallout<\/code><\/div>\n
-rw-r--r--. 1 oracle oinstall\u00a0\u00a0 0 Mar\u00a0 4 16:36 fsfo_precallout.suc<\/code><\/div>\n
<\/div>\n
\/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/dat<\/code>:<\/code><\/div>\n
total 12<\/code><\/div>\n
-rw-r--r--. 1 oracle oinstall 8344 Mar\u00a0 4 16:48 fsfo.dat<\/code><\/div>\n
<\/div>\n
\/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/log<\/code>:<\/code><\/div>\n
total 84<\/code><\/div>\n
-rw-r-----. 1 oracle oinstall 66093 Mar\u00a0 4 16:48 observer_oraadserver3.log<\/code><\/div>\n
[oracle@oraadserver3 callout]$<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

In the callout directory, we have the FSFO callout scripts<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n
4<\/div>\n
5<\/div>\n
6<\/div>\n
7<\/div>\n
8<\/div>\n<\/td>\n
\n
\n
oracle@oraadserver:<\/code>\/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/callout\/<\/code> [DB21 (CDB$ROOT)] <\/code>pwd<\/code><\/div>\n
\/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/callout<\/code><\/div>\n
oracle@oraadserver:<\/code>\/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/callout\/<\/code> [DB21 (CDB$ROOT)] <\/code>ls<\/code> -l<\/code><\/div>\n
total 12<\/code><\/div>\n
-rwx------. 1 oracle oinstall 882 Feb\u00a0 1 16:11 fsfocallout.ora<\/code><\/div>\n
-rwx------. 1 oracle oinstall\u00a0 37 Feb\u00a0 1 16:48 fsfo_postcallout<\/code><\/div>\n
-rwx------. 1 oracle oinstall\u00a0 38 Feb\u00a0 1 16:47 fsfo_precallout<\/code><\/div>\n
oracle@oraadserver:<\/code>\/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/callout\/<\/code> [DB21 (CDB$ROOT)]<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

Let’s see the contents of each file<\/p>\n

fsfocallout.ora : fsfo callout configuration file<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n
4<\/div>\n
5<\/div>\n
6<\/div>\n
7<\/div>\n
8<\/div>\n
9<\/div>\n
10<\/div>\n
11<\/div>\n
12<\/div>\n
13<\/div>\n
14<\/div>\n
15<\/div>\n
16<\/div>\n
17<\/div>\n
18<\/div>\n
19<\/div>\n
20<\/div>\n
21<\/div>\n
22<\/div>\n
23<\/div>\n
24<\/div>\n<\/td>\n
\n
\n
[oracle@oraadserver3 callout]$ <\/code>cat<\/code> fsfocallout.ora<\/code><\/div>\n
# This is a fast-start failover configuration file.<\/code><\/div>\n
<\/div>\n
# The pre-callout script that is run before fast-start failover is enabled.<\/code><\/div>\n
FastStartFailoverPreCallout=fsfo_precallout<\/code><\/div>\n
<\/div>\n
# The timeout value (in seconds) for pre-callout script<\/code><\/div>\n
#FastStartFailoverPreCalloutTimeout=1200<\/code><\/div>\n
FastStartFailoverPreCalloutTimeout=25<\/code><\/div>\n
<\/div>\n
# The name of the suc file created by the pre-callout script.<\/code><\/div>\n
FastStartFailoverPreCalloutSucFileName=fsfo_precallout.suc<\/code><\/div>\n
<\/div>\n
# The name of the error file that the pre-callout script creates<\/code><\/div>\n
FastStartFailoverPreCalloutErrorFileName=fsfo_precallout.err<\/code><\/div>\n
<\/div>\n
# Action taken by observer if the suc file does not exist after FastStartFailoverPreCalloutTimeout seconds<\/code><\/div>\n
# or if an error file is detected before FastStartFailoverPreCalloutTimeout seconds passed<\/code><\/div>\n
FastStartFailoverActionOnPreCalloutFailure=STOP<\/code><\/div>\n
#FastStartFailoverActionOnPreCalloutFailure=CONTINUE<\/code><\/div>\n
<\/div>\n
# The post-callout script that is run after fast-start failover succeeds<\/code><\/div>\n
FastStartFailoverPostCallout=fsfo_postcallout<\/code><\/div>\n
[oracle@oraadserver3 callout]$<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

fsfo_precallout : to be executed before the FSFO<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n
4<\/div>\n
5<\/div>\n
6<\/div>\n
7<\/div>\n
8<\/div>\n
9<\/div>\n
10<\/div>\n
11<\/div>\n<\/td>\n
\n
\n
[oracle@oraadserver3 callout]$ <\/code>cat<\/code> fsfo_precallout<\/code><\/div>\n
#! \/bin\/bash<\/code><\/div>\n
if<\/code> [ 1 -lt 100 ]<\/code><\/div>\n
\u00a0<\/code>then<\/code><\/div>\n
\u00a0\u00a0\u00a0<\/code>touch<\/code> \/tmp\/test<\/code><\/div>\n
\u00a0\u00a0\u00a0<\/code>echo<\/code> \"starting fun observer\"<\/code> > <\/code>\/tmp\/test<\/code><\/div>\n
\u00a0\u00a0\u00a0<\/code>touch<\/code> \/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/callout\/fsfo_precallout<\/code>.suc<\/code><\/div>\n
else<\/code><\/div>\n
\u00a0\u00a0<\/code>touch<\/code> \/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/callout\/fsfo_precallout<\/code>.err<\/code><\/div>\n
fi<\/code><\/div>\n
[oracle@oraadserver3 callout]$<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

fsfo_postcallout : to be executed after the FSFO<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n
4<\/div>\n
5<\/div>\n<\/td>\n
\n
\n
[oracle@oraadserver3 callout]$ <\/code>cat<\/code> fsfo_postcallout<\/code><\/div>\n
#! \/bin\/bash<\/code><\/div>\n
touch<\/code> \/tmp\/test_2<\/code><\/div>\n
echo<\/code> \"end fun observer\"<\/code> >> <\/code>\/tmp\/test_2<\/code><\/div>\n
[oracle@oraadserver3 callout]$<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

Now let’s simulate a FSFO and let’s see if the pre-callout and post-callout tasks are executed<\/p>\n

For this we will execute a shut abort of the primary database<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n
4<\/div>\n
5<\/div>\n
6<\/div>\n
7<\/div>\n
8<\/div>\n
9<\/div>\n<\/td>\n
\n
\n
SQL> <\/code>select<\/code> db_unique_name <\/code>from<\/code> v$<\/code>database<\/code>;<\/code><\/div>\n
<\/div>\n
DB_UNIQUE_NAME<\/code><\/div>\n
------------------------------<\/code><\/div>\n
db21_site1<\/code><\/div>\n
<\/div>\n
SQL> shut abort<\/code><\/div>\n
ORACLE instance shut down.<\/code><\/div>\n
SQL><\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

In the observer logfile, we can see following<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n
4<\/div>\n
5<\/div>\n
6<\/div>\n
7<\/div>\n
8<\/div>\n
9<\/div>\n
10<\/div>\n
11<\/div>\n
12<\/div>\n
13<\/div>\n
14<\/div>\n
15<\/div>\n
16<\/div>\n
17<\/div>\n
18<\/div>\n
19<\/div>\n
20<\/div>\n
21<\/div>\n
22<\/div>\n
23<\/div>\n
24<\/div>\n
25<\/div>\n
26<\/div>\n
27<\/div>\n
28<\/div>\n
29<\/div>\n
30<\/div>\n
31<\/div>\n
32<\/div>\n
33<\/div>\n
34<\/div>\n
35<\/div>\n
36<\/div>\n
37<\/div>\n
38<\/div>\n
39<\/div>\n
40<\/div>\n
41<\/div>\n
42<\/div>\n
43<\/div>\n
44<\/div>\n
45<\/div>\n
46<\/div>\n
47<\/div>\n
48<\/div>\n
49<\/div>\n
50<\/div>\n
51<\/div>\n
52<\/div>\n<\/td>\n
\n
\n
[oracle@oraadserver3 callout]$ <\/code>cat<\/code> \/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/log\/observer_oraadserver3<\/code>.log<\/code><\/div>\n
1<\/code><\/div>\n
[W000 2022-03-04T17:34:19.533+01:00] Primary database cannot be reached.<\/code><\/div>\n
[W000 2022-03-04T17:34:19.534+01:00] Fast-Start Failover threshold has not exceeded. Retry <\/code>for<\/code> the next 15 seconds<\/code><\/div>\n
[W000 2022-03-04T17:34:20.534+01:00] Try to connect to the primary.<\/code><\/div>\n
[W000 2022-03-04T17:34:33.053+01:00] Primary database cannot be reached.<\/code><\/div>\n
[W000 2022-03-04T17:34:33.053+01:00] Fast-Start Failover threshold has not exceeded. Retry <\/code>for<\/code> the next 1 second<\/code><\/div>\n
[W000 2022-03-04T17:34:34.064+01:00] Try to connect to the primary.<\/code><\/div>\n
[W000 2022-03-04T17:34:36.084+01:00] Primary database cannot be reached.<\/code><\/div>\n
[W000 2022-03-04T17:34:36.084+01:00] Fast-Start Failover threshold has expired.<\/code><\/div>\n
[W000 2022-03-04T17:34:36.085+01:00] Succeeded to parse FSFO callout config <\/code>file<\/code> '\/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/callout\/fsfocallout.ora'<\/code><\/div>\n
[W000 2022-03-04T17:34:36.085+01:00] Try to connect to the standby.<\/code><\/div>\n
[W000 2022-03-04T17:34:36.085+01:00] Check <\/code>if<\/code> the standby is ready <\/code>for<\/code> failover.<\/code><\/div>\n
[W000 2022-03-04T17:34:36.106+01:00] Doing pre-FSFO callout.<\/code><\/div>\n
[W000 2022-03-04T17:34:37.107+01:00] Found the pre-FSFO callout suc <\/code>file<\/code> '\/u01\/app\/oracle\/admin\/prod20\/broker_files\/config_db21\/callout\/fsfo_precallout.suc'<\/code><\/div>\n
[W000 2022-03-04T17:34:37.107+01:00] Will <\/code>continue<\/code> Fast-Start Failover.<\/code><\/div>\n
[S025 2022-03-04T17:34:37.107+01:00] Fast-Start Failover started...<\/code><\/div>\n
<\/div>\n
2022-03-04T17:34:37.107+01:00<\/code><\/div>\n
Initiating Fast-Start Failover to database <\/code>\"DB21_SITE2\"<\/code>...<\/code><\/div>\n
[S025 2022-03-04T17:34:37.108+01:00] Initiating Fast-start Failover.<\/code><\/div>\n
2022-03-04T17:34:37.124+01:00<\/code><\/div>\n
Performing failover NOW, please wait...<\/code><\/div>\n
<\/div>\n
2022-03-04T17:34:57.927+01:00<\/code><\/div>\n
Failover succeeded, new primary is <\/code>\"DB21_SITE2\"<\/code>.<\/code><\/div>\n
<\/div>\n
2022-03-04T17:34:57.927+01:00<\/code><\/div>\n
Failover processing complete, broker ready.<\/code><\/div>\n
2022-03-04T17:34:57.927+01:00<\/code><\/div>\n
[S025 2022-03-04T17:34:57.927+01:00] Fast-Start Failover finished...<\/code><\/div>\n
[W000 2022-03-04T17:34:57.927+01:00] Failover succeeded. Restart pinging.<\/code><\/div>\n
[W000 2022-03-04T17:34:57.937+01:00] Primary database has changed to DB21_SITE2.<\/code><\/div>\n
[W000 2022-03-04T17:34:57.940+01:00] Try to connect to the primary.<\/code><\/div>\n
\u2026<\/code><\/div>\n
\u2026<\/code><\/div>\n
[W000 2022-03-04T17:35:08.317+01:00] Failed to <\/code>ping<\/code> the new standby.<\/code><\/div>\n
[W000 2022-03-04T17:35:08.317+01:00] Try to connect to the new standby DB21_SITE1.<\/code><\/div>\n
[W000 2022-03-04T17:35:11.317+01:00] Connection to the new standby restored!<\/code><\/div>\n
[W000 2022-03-04T17:35:11.331+01:00] Failed to <\/code>ping<\/code> the new standby.<\/code><\/div>\n
[W000 2022-03-04T17:35:12.345+01:00] Try to connect to the new standby DB21_SITE1.<\/code><\/div>\n
[W000 2022-03-04T17:35:15.331+01:00] Connection to the new standby restored!<\/code><\/div>\n
[W000 2022-03-04T17:35:17.322+01:00] Failed to <\/code>ping<\/code> the new standby.<\/code><\/div>\n
[W000 2022-03-04T17:35:17.322+01:00] Try to connect to the new standby DB21_SITE1.<\/code><\/div>\n
[W000 2022-03-04T17:35:23.322+01:00] Connection to the new standby restored!<\/code><\/div>\n
[W000 2022-03-04T17:35:39.344+01:00] Try to connect to the primary DB21_SITE2.<\/code><\/div>\n
[W000 2022-03-04T17:35:41.324+01:00] Connection to the primary restored!<\/code><\/div>\n
[W000 2022-03-04T17:35:41.324+01:00] Wait <\/code>for<\/code> new primary to be ready to reinstate.<\/code><\/div>\n
[W000 2022-03-04T17:35:42.342+01:00] New primary is now ready to reinstate.<\/code><\/div>\n
[W000 2022-03-04T17:35:43.342+01:00] Issuing REINSTATE <\/code>command<\/code>.<\/code><\/div>\n
<\/div>\n
[oracle@oraadserver3 callout]$<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

In the callout directory we have the .suc file<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n<\/td>\n
\n
\n
[oracle@oraadserver3 callout]$ <\/code>ls<\/code> -ltra *.suc<\/code><\/div>\n
-rw-r--r--. 1 oracle oinstall 0 Mar\u00a0 4 17:34 fsfo_precallout.suc<\/code><\/div>\n
[oracle@oraadserver3 callout]$<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

And in \/tmp directory<\/p>\n

\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n
4<\/div>\n<\/td>\n
\n
\n
[oracle@oraadserver3 callout]$ <\/code>ls<\/code> -l <\/code>\/tmp\/test<\/code>*<\/code><\/div>\n
-rw-r--r--. 1 oracle oinstall 22 Mar\u00a0 4 17:34 <\/code>\/tmp\/test<\/code><\/div>\n
-rw-r--r--. 1 oracle oinstall 17 Mar\u00a0 4 17:34 <\/code>\/tmp\/test_2<\/code><\/div>\n
[oracle@oraadserver3 callout]$<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n
\n
\n\n\n\n
\n
1<\/div>\n
2<\/div>\n
3<\/div>\n
4<\/div>\n
5<\/div>\n<\/td>\n
\n
\n
[oracle@oraadserver3 callout]$ <\/code>cat<\/code> \/tmp\/test<\/code><\/div>\n
starting fun observer<\/code><\/div>\n
[oracle@oraadserver3 callout]$ <\/code>cat<\/code> \/tmp\/test_2<\/code><\/div>\n
end fun observer<\/code><\/div>\n
[oracle@oraadserver3 callout]$<\/code><\/div>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

Conclusion<\/h3>\n

Sure, that this feature will help (configuring clients before FSFO, stopping application \u2026.)<\/p>\n","protected":false},"excerpt":{"rendered":"

By Mouhamadou Diaw With Oracle 21c (In fact Oracle 20c), we have a nice new feature with the broker which is the Fast-start Failover Callout Configuration scripts. I talked about this feature in some presentations I did about the new features with Oracle 21c for the broker This feature will allow to automate tasks that […]<\/p>\n","protected":false},"author":27,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[229,198,59],"tags":[2511,2512,2513,138,236],"type_dbi":[],"class_list":["post-17148","post","type-post","status-publish","format-standard","hentry","category-database-administration-monitoring","category-database-management","category-oracle","tag-callout-scripts","tag-fsfo-callout-scripts","tag-oracle-21c-borker-new-feature","tag-oracle-21c-new-features","tag-oracle-data-guard"],"acf":[],"yoast_head":"\nOracle 21c Broker : Fast-Start Failover Callout Scripts in Action - dbi Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Oracle 21c Broker : Fast-Start Failover Callout Scripts in Action\" \/>\n<meta property=\"og:description\" content=\"By Mouhamadou Diaw With Oracle 21c (In fact Oracle 20c), we have a nice new feature with the broker which is the Fast-start Failover Callout Configuration scripts. I talked about this feature in some presentations I did about the new features with Oracle 21c for the broker This feature will allow to automate tasks that […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2022-03-04T16:16:01+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-20T08:13:24+00:00\" \/>\n<meta name=\"author\" content=\"Oracle Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Oracle Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/\"},\"author\":{\"name\":\"Oracle Team\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/66ab87129f2d357f09971bc7936a77ee\"},\"headline\":\"Oracle 21c Broker : Fast-Start Failover Callout Scripts in Action\",\"datePublished\":\"2022-03-04T16:16:01+00:00\",\"dateModified\":\"2023-06-20T08:13:24+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/\"},\"wordCount\":401,\"commentCount\":0,\"keywords\":[\"Callout scripts\",\"FSFO callout scripts\",\"Oracle 21c Borker New Feature\",\"Oracle 21c New features\",\"Oracle Data Guard\"],\"articleSection\":[\"Database Administration & Monitoring\",\"Database management\",\"Oracle\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/\",\"name\":\"Oracle 21c Broker : Fast-Start Failover Callout Scripts in Action - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\"},\"datePublished\":\"2022-03-04T16:16:01+00:00\",\"dateModified\":\"2023-06-20T08:13:24+00:00\",\"author\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/66ab87129f2d357f09971bc7936a77ee\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.dbi-services.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Oracle 21c Broker : Fast-Start Failover Callout Scripts in Action\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/66ab87129f2d357f09971bc7936a77ee\",\"name\":\"Oracle Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/f711f7cd2c9b09bf2627133755b569fb5be0694810cfd33033bdd095fedba86d?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/f711f7cd2c9b09bf2627133755b569fb5be0694810cfd33033bdd095fedba86d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/f711f7cd2c9b09bf2627133755b569fb5be0694810cfd33033bdd095fedba86d?s=96&d=mm&r=g\",\"caption\":\"Oracle Team\"},\"url\":\"https:\/\/www.dbi-services.com\/blog\/author\/oracle-team\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Oracle 21c Broker : Fast-Start Failover Callout Scripts in Action - dbi Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/","og_locale":"en_US","og_type":"article","og_title":"Oracle 21c Broker : Fast-Start Failover Callout Scripts in Action","og_description":"By Mouhamadou Diaw With Oracle 21c (In fact Oracle 20c), we have a nice new feature with the broker which is the Fast-start Failover Callout Configuration scripts. I talked about this feature in some presentations I did about the new features with Oracle 21c for the broker This feature will allow to automate tasks that […]","og_url":"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/","og_site_name":"dbi Blog","article_published_time":"2022-03-04T16:16:01+00:00","article_modified_time":"2023-06-20T08:13:24+00:00","author":"Oracle Team","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Oracle Team","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/"},"author":{"name":"Oracle Team","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/66ab87129f2d357f09971bc7936a77ee"},"headline":"Oracle 21c Broker : Fast-Start Failover Callout Scripts in Action","datePublished":"2022-03-04T16:16:01+00:00","dateModified":"2023-06-20T08:13:24+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/"},"wordCount":401,"commentCount":0,"keywords":["Callout scripts","FSFO callout scripts","Oracle 21c Borker New Feature","Oracle 21c New features","Oracle Data Guard"],"articleSection":["Database Administration & Monitoring","Database management","Oracle"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/","url":"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/","name":"Oracle 21c Broker : Fast-Start Failover Callout Scripts in Action - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"datePublished":"2022-03-04T16:16:01+00:00","dateModified":"2023-06-20T08:13:24+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/66ab87129f2d357f09971bc7936a77ee"},"breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/oracle-21c-broker-fast-start-failover-callout-scripts-in-action\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Oracle 21c Broker : Fast-Start Failover Callout Scripts in Action"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/66ab87129f2d357f09971bc7936a77ee","name":"Oracle Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/f711f7cd2c9b09bf2627133755b569fb5be0694810cfd33033bdd095fedba86d?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/f711f7cd2c9b09bf2627133755b569fb5be0694810cfd33033bdd095fedba86d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/f711f7cd2c9b09bf2627133755b569fb5be0694810cfd33033bdd095fedba86d?s=96&d=mm&r=g","caption":"Oracle Team"},"url":"https:\/\/www.dbi-services.com\/blog\/author\/oracle-team\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/17148","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/27"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=17148"}],"version-history":[{"count":1,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/17148\/revisions"}],"predecessor-version":[{"id":26136,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/17148\/revisions\/26136"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=17148"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=17148"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=17148"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=17148"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}