Introduction

While patching ODAs from 19.10 to 19.13, the update-dbhome could fail if some databases inside this dbhome are stopped or only mounted. Job would then stop with a DCS-10001:Internal error encountered: PRGH-1153 : RHPHelper call to get runing nodes failed for DB: “ARITSTDB”.

How to solve this problem?

Environment description

My environment is composed of 3 X8-2M ODAs, 2 are dedicated for production with Data Guard, and 1 for test and development databases. Initialy deployed with 19.6, the goal was to patch to the latest 19.13. An intermediate patch was needed, so these ODAs will first be patched to 19.10 before applying 19.13 straight after.

Patching from 19.6 to 19.10 was fine, but patching the only 19c dbhome to 19.13 was not. Job raised an error:

odacli describe-job -i 087d618c-714c-463f-a1e8-7efcba0541fc

Job details
----------------------------------------------------------------
                     ID:  087d618c-714c-463f-a1e8-7efcba0541fc
            Description:  DB Home Patching: Home Id is 38c08a67-2730-4b76-92aa-4a47840082c5
                 Status:  Failure
                Created:  February 23, 2022 6:02:42 PM CET
                Message:  DCS-10001:Internal error encountered: PRGH-1153 : RHPHelper call to get runing nodes failed for DB: "ARITSTDB"..

Task Name                                Start Time                          End Time                            Status
---------------------------------------- ----------------------------------- ----------------------------------- ----------
DB Home Patching                         February 23, 2022 6:03:02 PM CET    February 23, 2022 7:02:53 PM CET    Failure
DB Home Patching                         February 23, 2022 6:03:03 PM CET    February 23, 2022 7:02:53 PM CET    Failure
Adding USER SSH_EQUIVALENCE              February 23, 2022 6:03:03 PM CET    February 23, 2022 6:03:03 PM CET    Success
Adding USER SSH_EQUIVALENCE              February 23, 2022 6:03:03 PM CET    February 23, 2022 6:03:04 PM CET    Success
task:TaskSequential_2030                 February 23, 2022 6:03:04 PM CET    February 23, 2022 7:01:55 PM CET    Failure
Creating wallet for DB Client            February 23, 2022 6:03:43 PM CET    February 23, 2022 6:03:43 PM CET    Success
Patch databases by RHP                   February 23, 2022 6:03:43 PM CET    February 23, 2022 6:11:03 PM CET    Success
updating database metadata               February 23, 2022 6:11:56 PM CET    February 23, 2022 6:11:56 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 6:11:56 PM CET    February 23, 2022 6:12:01 PM CET    Success
Patch databases by RHP                   February 23, 2022 6:12:01 PM CET    February 23, 2022 6:19:10 PM CET    Success
updating database metadata               February 23, 2022 6:20:03 PM CET    February 23, 2022 6:20:03 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 6:20:03 PM CET    February 23, 2022 6:20:08 PM CET    Success
Patch databases by RHP                   February 23, 2022 6:20:08 PM CET    February 23, 2022 6:25:26 PM CET    Success
updating database metadata               February 23, 2022 6:26:21 PM CET    February 23, 2022 6:26:21 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 6:26:21 PM CET    February 23, 2022 6:26:26 PM CET    Success
Patch databases by RHP                   February 23, 2022 6:26:26 PM CET    February 23, 2022 6:31:54 PM CET    Success
updating database metadata               February 23, 2022 6:32:49 PM CET    February 23, 2022 6:32:49 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 6:32:49 PM CET    February 23, 2022 6:32:53 PM CET    Success
Patch databases by RHP                   February 23, 2022 6:32:53 PM CET    February 23, 2022 6:38:09 PM CET    Success
updating database metadata               February 23, 2022 6:39:02 PM CET    February 23, 2022 6:39:03 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 6:39:03 PM CET    February 23, 2022 6:39:07 PM CET    Success
Patch databases by RHP                   February 23, 2022 6:39:07 PM CET    February 23, 2022 6:44:02 PM CET    Success
updating database metadata               February 23, 2022 6:44:58 PM CET    February 23, 2022 6:44:58 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 6:44:58 PM CET    February 23, 2022 6:45:03 PM CET    Success
Patch databases by RHP                   February 23, 2022 6:45:03 PM CET    February 23, 2022 6:51:55 PM CET    Success
updating database metadata               February 23, 2022 6:52:48 PM CET    February 23, 2022 6:52:48 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 6:52:48 PM CET    February 23, 2022 6:52:52 PM CET    Success
Patch databases by RHP                   February 23, 2022 6:52:52 PM CET    February 23, 2022 7:00:09 PM CET    Success
updating database metadata               February 23, 2022 7:01:05 PM CET    February 23, 2022 7:01:05 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 7:01:05 PM CET    February 23, 2022 7:01:10 PM CET    Success
Patch databases by RHP                   February 23, 2022 7:01:10 PM CET    February 23, 2022 7:01:55 PM CET    Failure

Status of databases after patching

Failure didn’t happen immediately, part of the job should have been done. Let’s check databases and version associated:

odacli list-databases

ID                                       DB Name    DB Type  DB Version           CDB        Class    Shape    Storage    Status        DbHomeID
---------------------------------------- ---------- -------- -------------------- ---------- -------- -------- ---------- ------------ ----------------------------------------
6e26f06c-ee16-46f2-986e-0d82602fe93a     GOTTSTDB   SI       19.13.0.0.211019     false      OLTP     odb1     ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
17c84065-9bb9-4548-bf72-d0a02ad2213f     PATSTDB    SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
f34eddac-7794-47cd-9d6a-08aa3b2f90b7     PATSITDB   SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
185bc4bf-492e-4b98-9440-b24c2864f572     PATCIDB    SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
d0657336-b416-40d7-929f-8a9fe604e908     M4CTSTDB   SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
9681f86e-88b9-468f-93c6-9b2db76bede1     MINDEVDB   SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
a5e4f009-942a-488c-9097-6e34e6b858dd     MINTSTDB   SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
62416912-551b-44cb-a23d-8f60ca7d8a37     REGNTTST   SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
af37407a-f340-43b2-bb41-7f7e1143c703     LOGMTST    SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
6ce0e7a6-7560-4b2a-b992-cf6cca7500f0     WNTVSTDB   SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
9bebb050-8090-444f-bbc7-7dcfb4bc68a1     BQ3        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
d7da5dba-03d5-4cbd-ba7f-00aaea97c55c     POQ        SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
7e396dee-e4b3-4d84-8a4e-e42b4de69884     OQ1        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
64c248c3-aaf9-4a89-a672-f6e60e20e2aa     SQ1        SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
69b805d8-db8c-4240-aadc-e267b5c6f020     SQ2        SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
76562430-5554-4876-967f-58bcb81e2818     OD1        SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
4c50b2d6-0e4f-47d6-a278-5ee6bd4635d4     BD3        SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
9c5bac01-e9a6-4345-8076-4b647fb0457e     SD1        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
b051e5be-92c1-4d85-9060-7a36bf4befd6     POD        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
efd34b41-cbda-4785-9cda-e08450203619     SD2        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
4c679720-c577-4934-ab56-67d421538366     ARITSTDB   SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5

A few databases have been migrated to the new 19.13 dhbome, then job stopped after ARITSTDB database. Actually, ARITSTDB is a decommissioned database, still existing on my ODA. On one of the other ODA, behaviour was the same, but for another reason: databases were mostly standbys. So this part of the patch is not continuing after trying on a database not in read/write mode.

Retry to apply the patch on the dbhome

Let’s retry the patch to see if it can continue:

odacli update-dbhome -i 38c08a67-2730-4b76-92aa-4a47840082c5 -v 19.13.0.0.0 -f

odacli describe-job -i 9ec82ccd-d726-4172-be80-943bafbfbd18

Job details
----------------------------------------------------------------
                     ID:  9ec82ccd-d726-4172-be80-943bafbfbd18
            Description:  DB Home Patching: Home Id is 38c08a67-2730-4b76-92aa-4a47840082c5
                 Status:  Failure
                Created:  February 23, 2022 7:11:36 PM CET
                Message:  DCS-10001:Internal error encountered: PRCT-1014 : Internal error: CmdToolUtil-execute1-error1.

Task Name                                Start Time                          End Time                            Status
---------------------------------------- ----------------------------------- ----------------------------------- ----------
DB Home Patching                         February 23, 2022 7:11:50 PM CET    February 23, 2022 7:13:29 PM CET    Failure
DB Home Patching                         February 23, 2022 7:11:50 PM CET    February 23, 2022 7:13:29 PM CET    Failure
Adding USER SSH_EQUIVALENCE              February 23, 2022 7:11:50 PM CET    February 23, 2022 7:11:51 PM CET    Success
Adding USER SSH_EQUIVALENCE              February 23, 2022 7:11:51 PM CET    February 23, 2022 7:11:51 PM CET    Success
task:TaskSequential_3109                 February 23, 2022 7:11:51 PM CET    February 23, 2022 7:12:54 PM CET    Failure
Creating wallet for DB Client            February 23, 2022 7:12:30 PM CET    February 23, 2022 7:12:30 PM CET    Success
Patch databases by RHP                   February 23, 2022 7:12:30 PM CET    February 23, 2022 7:12:54 PM CET    Failure

Despite the failure status, my stopped database is now switched to its new home, but the task stopped again after this change.

odacli list-databases

ID                                       DB Name    DB Type  DB Version           CDB        Class    Shape    Storage    Status        DbHomeID
---------------------------------------- ---------- -------- -------------------- ---------- -------- -------- ---------- ------------ ----------------------------------------
6e26f06c-ee16-46f2-986e-0d82602fe93a     GOTTSTDB   SI       19.13.0.0.211019     false      OLTP     odb1     ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
17c84065-9bb9-4548-bf72-d0a02ad2213f     PATSTDB    SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
f34eddac-7794-47cd-9d6a-08aa3b2f90b7     PATSITDB   SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
185bc4bf-492e-4b98-9440-b24c2864f572     PATCIDB    SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
d0657336-b416-40d7-929f-8a9fe604e908     M4CTSTDB   SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
9681f86e-88b9-468f-93c6-9b2db76bede1     MINDEVDB   SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
a5e4f009-942a-488c-9097-6e34e6b858dd     MINTSTDB   SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
62416912-551b-44cb-a23d-8f60ca7d8a37     REGNTTST   SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
af37407a-f340-43b2-bb41-7f7e1143c703     LOGMTST    SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
6ce0e7a6-7560-4b2a-b992-cf6cca7500f0     WNTVSTDB   SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
9bebb050-8090-444f-bbc7-7dcfb4bc68a1     BQ3        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
d7da5dba-03d5-4cbd-ba7f-00aaea97c55c     POQ        SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
7e396dee-e4b3-4d84-8a4e-e42b4de69884     OQ1        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
64c248c3-aaf9-4a89-a672-f6e60e20e2aa     SQ1        SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
69b805d8-db8c-4240-aadc-e267b5c6f020     SQ2        SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
76562430-5554-4876-967f-58bcb81e2818     OD1        SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
4c50b2d6-0e4f-47d6-a278-5ee6bd4635d4     BD3        SI       19.10.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   38c08a67-2730-4b76-92aa-4a47840082c5
9c5bac01-e9a6-4345-8076-4b647fb0457e     SD1        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
b051e5be-92c1-4d85-9060-7a36bf4befd6     POD        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
efd34b41-cbda-4785-9cda-e08450203619     SD2        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
4c679720-c577-4934-ab56-67d421538366     ARITSTDB   SI       19.13.0.0.210119     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9

Let’s start again the patching of this dbhome:

odacli update-dbhome -i 38c08a67-2730-4b76-92aa-4a47840082c5 -v 19.13.0.0.0 -f

odacli describe-job -i "36843376-2ea3-4d17-b641-dac34270d1f2"


Job details
----------------------------------------------------------------
                     ID:  36843376-2ea3-4d17-b641-dac34270d1f2
            Description:  DB Home Patching: Home Id is 38c08a67-2730-4b76-92aa-4a47840082c5
                 Status:  Success
                Created:  February 23, 2022 7:16:42 PM CET
                Message:

Task Name                                Start Time                          End Time                            Status
---------------------------------------- ----------------------------------- ----------------------------------- ----------
Adding USER SSH_EQUIVALENCE              February 23, 2022 7:16:56 PM CET    February 23, 2022 7:16:57 PM CET    Success
Adding USER SSH_EQUIVALENCE              February 23, 2022 7:16:57 PM CET    February 23, 2022 7:16:57 PM CET    Success
Creating wallet for DB Client            February 23, 2022 7:17:36 PM CET    February 23, 2022 7:17:36 PM CET    Success
Patch databases by RHP                   February 23, 2022 7:17:36 PM CET    February 23, 2022 7:23:05 PM CET    Success
updating database metadata               February 23, 2022 7:23:59 PM CET    February 23, 2022 7:23:59 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 7:23:59 PM CET    February 23, 2022 7:24:03 PM CET    Success
Patch databases by RHP                   February 23, 2022 7:24:03 PM CET    February 23, 2022 7:31:11 PM CET    Success
updating database metadata               February 23, 2022 7:32:09 PM CET    February 23, 2022 7:32:09 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 7:32:09 PM CET    February 23, 2022 7:32:13 PM CET    Success
Patch databases by RHP                   February 23, 2022 7:32:13 PM CET    February 23, 2022 7:39:15 PM CET    Success
updating database metadata               February 23, 2022 7:40:09 PM CET    February 23, 2022 7:40:09 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 7:40:09 PM CET    February 23, 2022 7:40:14 PM CET    Success
Patch databases by RHP                   February 23, 2022 7:40:14 PM CET    February 23, 2022 7:47:25 PM CET    Success
updating database metadata               February 23, 2022 7:48:26 PM CET    February 23, 2022 7:48:26 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 7:48:26 PM CET    February 23, 2022 7:48:29 PM CET    Success
Patch databases by RHP                   February 23, 2022 7:48:29 PM CET    February 23, 2022 7:55:39 PM CET    Success
updating database metadata               February 23, 2022 7:56:34 PM CET    February 23, 2022 7:56:34 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 7:56:34 PM CET    February 23, 2022 7:56:39 PM CET    Success
Patch databases by RHP                   February 23, 2022 7:56:39 PM CET    February 23, 2022 8:03:39 PM CET    Success
updating database metadata               February 23, 2022 8:04:33 PM CET    February 23, 2022 8:04:33 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 8:04:34 PM CET    February 23, 2022 8:04:37 PM CET    Success
Patch databases by RHP                   February 23, 2022 8:04:37 PM CET    February 23, 2022 8:11:27 PM CET    Success
updating database metadata               February 23, 2022 8:12:19 PM CET    February 23, 2022 8:12:19 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 8:12:19 PM CET    February 23, 2022 8:12:23 PM CET    Success
Patch databases by RHP                   February 23, 2022 8:12:23 PM CET    February 23, 2022 8:18:00 PM CET    Success
updating database metadata               February 23, 2022 8:18:54 PM CET    February 23, 2022 8:18:54 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 8:18:54 PM CET    February 23, 2022 8:18:58 PM CET    Success
Patch databases by RHP                   February 23, 2022 8:18:58 PM CET    February 23, 2022 8:24:02 PM CET    Success
updating database metadata               February 23, 2022 8:24:56 PM CET    February 23, 2022 8:24:56 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 8:24:56 PM CET    February 23, 2022 8:25:00 PM CET    Success
Patch databases by RHP                   February 23, 2022 8:25:00 PM CET    February 23, 2022 8:30:13 PM CET    Success
updating database metadata               February 23, 2022 8:31:06 PM CET    February 23, 2022 8:31:06 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 8:31:06 PM CET    February 23, 2022 8:31:13 PM CET    Success
Patch databases by RHP                   February 23, 2022 8:31:13 PM CET    February 23, 2022 8:36:19 PM CET    Success
updating database metadata               February 23, 2022 8:37:15 PM CET    February 23, 2022 8:37:15 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 8:37:15 PM CET    February 23, 2022 8:37:19 PM CET    Success
Patch databases by RHP                   February 23, 2022 8:37:19 PM CET    February 23, 2022 8:42:41 PM CET    Success
updating database metadata               February 23, 2022 8:43:36 PM CET    February 23, 2022 8:43:36 PM CET    Success
Set log_archive_dest for Database        February 23, 2022 8:43:36 PM CET    February 23, 2022 8:43:39 PM CET    Success
Update System version                    February 23, 2022 8:43:39 PM CET    February 23, 2022 8:43:39 PM CET    Success
TDE parameter update                     February 23, 2022 8:44:27 PM CET    February 23, 2022 8:44:27 PM CET    Success

odacli list-databases
ID                                       DB Name    DB Type  DB Version           CDB        Class    Shape    Storage    Status        DbHomeID
---------------------------------------- ---------- -------- -------------------- ---------- -------- -------- ---------- ------------ ----------------------------------------
6e26f06c-ee16-46f2-986e-0d82602fe93a     GOTTSTDB   SI       19.13.0.0.211019     false      OLTP     odb1     ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
17c84065-9bb9-4548-bf72-d0a02ad2213f     PATSTDB    SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
f34eddac-7794-47cd-9d6a-08aa3b2f90b7     PATSITDB   SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
185bc4bf-492e-4b98-9440-b24c2864f572     PATCIDB    SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
d0657336-b416-40d7-929f-8a9fe604e908     M4CTSTDB   SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
9681f86e-88b9-468f-93c6-9b2db76bede1     MINDEVDB   SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
a5e4f009-942a-488c-9097-6e34e6b858dd     MINTSTDB   SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
62416912-551b-44cb-a23d-8f60ca7d8a37     REGNTTST   SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
af37407a-f340-43b2-bb41-7f7e1143c703     LOGMTST    SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
6ce0e7a6-7560-4b2a-b992-cf6cca7500f0     WNTVSTDB   SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
9bebb050-8090-444f-bbc7-7dcfb4bc68a1     BQ3        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
d7da5dba-03d5-4cbd-ba7f-00aaea97c55c     POQ        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
7e396dee-e4b3-4d84-8a4e-e42b4de69884     OQ1        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
64c248c3-aaf9-4a89-a672-f6e60e20e2aa     SQ1        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
69b805d8-db8c-4240-aadc-e267b5c6f020     SQ2        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
76562430-5554-4876-967f-58bcb81e2818     OD1        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
4c50b2d6-0e4f-47d6-a278-5ee6bd4635d4     BD3        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
9c5bac01-e9a6-4345-8076-4b647fb0457e     SD1        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
b051e5be-92c1-4d85-9060-7a36bf4befd6     POD        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
efd34b41-cbda-4785-9cda-e08450203619     SD2        SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9
4c679720-c577-4934-ab56-67d421538366     ARITSTDB   SI       19.13.0.0.211019     false      OLTP     odb1s    ASM        CONFIGURED   e087a1ea-bf81-44a0-8f04-4d154c1fecc9

odacli finally managed to patch everything, but applying multiple time the patch on this home was needed. Number of runs depends on the number of databases not being read/write opened. As long as you have databases still pointing to the old dbhome you need to apply the patch again.

Conclusion

The solution to solve this problem is to start the patching again on the same dbhome and it will continue. Keep in mind that this has to be done in a sequential mode.

Patching an ODA takes time, time to prepare, time to backup prior patching, time to apply the patch, time to do the troubleshooting. But it works and everything is up to date with a single patch.