{"id":37692,"date":"2025-03-14T13:47:55","date_gmt":"2025-03-14T12:47:55","guid":{"rendered":"https:\/\/www.dbi-services.com\/blog\/?p=37692"},"modified":"2025-03-14T13:47:59","modified_gmt":"2025-03-14T12:47:59","slug":"prgh-1030-when-doing-restore-node-g-on-oda","status":"publish","type":"post","link":"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/","title":{"rendered":"PRGH-1030 when doing restore-node -g on ODA"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\" id=\"h-introduction\">Introduction<\/h2>\n\n\n\n<p>Patching your Oracle Database Appliance from 19.20 or earlier release to 19.21 or newer release implies the use of Data Preserving Reprovisioning (DPR). Most of the time, and with an adequate preparation, the DPR works fine. But if something goes wrong at the restore-node -g step, you will need some troubleshooting and maybe opening a SR. There is no possible rollback. Here is the problem I recently had when patching an ODA from 19.20 to 19.26 using the intermediate 19.24 for DPR.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-is-dpr-and-why-you-need-it-on-oda\">What is DPR and why you need it on ODA?<\/h2>\n\n\n\n<p>Oracle Database Appliance has a global quarterly patch: this is the only patch you are supposed to use on this kind of hardware. The patch includes updates for Grid Infrastructure (GI) and database (DB), but also updates for the operating system (OS), BIOS, firmwares and other software components. Regarding the OS, Linux 7 was in use up to 19.20 version. Starting from 19.21, Linux 8 is mandatory and there is no update-server command available: you will need to reinstall the new OS on your ODA using DPR.<\/p>\n\n\n\n<p>Basically, DPR is a complete reinstall of the OS without erasing the data disks. Before doing the reinstall, you will &#8220;detach&#8221; the node. After the reinstall, you will &#8220;restore&#8221; the node using an odacli command: restore-node -g. You can compare this to the unplug\/plug operations on a PDB. Unplugging a PDB is writing the metadata in a file you will later use to plug in back your PDB somewhere else. The DPR feature is embedded in patch 19.21, 19.22, 19.23 and 19.24. As patches are only cumulative with the 4 previous versions, starting from 19.25 you&#8217;re supposed to use release 19.21 at least, meaning already in Linux 8.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-my-oda-setup-a-real-client-environment\">My ODA setup: a real client environment<\/h2>\n\n\n\n<p>My client has 2x ODA X9-2S with Enterprise Edition and Data Guard for production databases. These ODAs were deployed 2 years ago, and already patched from 19.17 to 19.20 1 year ago. Now, it&#8217;s time to patch them to the latest 19.26, using DPR 19.24 for the Linux 8 jump.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-pre-upgrade-report-and-detach-node\">Pre-upgrade report and detach-node<\/h2>\n\n\n\n<p>DCS components are updated to 19.24 at first step, then the pre-upgrade report can be tried:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>odacli update-dcsadmin -v 19.24.0.0.0\nodacli update-dcscomponents -v 19.24.0.0.0\nodacli update-dcsagent -v 19.24.0.0.0\nodacli create-preupgradereport -bm \nodacli describe-preupgradereport -i 03f53c9c-fe82-4c2b-bf18-49fd31853054\n...\n<\/code><\/pre>\n\n\n\n<p>This pre-upgrade report MUST be successful: if not, solve the listed problems and retry until it&#8217;s OK.<\/p>\n\n\n\n<p>Once OK, the detach-node will backup the metadata of your ODA for later restore:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>odacli detach-node -all\n<\/code><\/pre>\n\n\n\n<p>As detach files are stored locally, make sure to backup these files on an external volume otherwise you will not be able to restore your data after reimaging.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>cp -r \/opt\/oracle\/oak\/restore\/out\/* \/mnt\/backup\/ODA_backup\/\n<\/code><\/pre>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-reimaging-the-oda\">Reimaging the ODA<\/h2>\n\n\n\n<p>Reimaging is done with patch 30403643 (version 19.24 in my case). This is an ISO file you will virtually plug in through ILOM as a virtual CDROM. Then you will reboot the server and automatic setup will start. After this reimaging, you will need to do a configure-firstnet for basic network configuration, and then register the new GI and the detached server archive:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>odacli update-repository -f \/mnt\/backup\/ODA_backup\/odacli-dcs-19.24.0.0.0-240724-GI-19.24.0.0.zip\nodacli update-repository -f \/mnt\/backup\/ODA_backup\/serverarchive_srvoda1.zip<\/code><\/pre>\n\n\n\n<p>Once both files have successfully been registered, the restore-node can be done:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>odacli restore-node -g\n<\/code><\/pre>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-prgh-1030-and-timeout-of-the-restore-node-g\">PRGH-1030 and timeout of the restore-node -g<\/h2>\n\n\n\n<p>The restore-node -g is similar to a create-appliance: it will configure the system, create the users, provision GI and configure ASM. Instead of configuring ASM with fresh disks without any data, it will read the ASM headers on disks and mount the existing diskgroups. It means that you will get back the DB homes, the databases and ACFS volumes.<\/p>\n\n\n\n<p>This time, the restore-node -g didn&#8217;t work for me, it took a very long time (more than one hour) before ending with a failure, a timeout was probably triggered as odacli jobs always finish with a success or a failure:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>odacli describe-job -i \"46addc5f-7a1f-4f4b-bccf-78cb3708bef9\"\nJob details\n----------------------------------------------------------------\n                     ID:  46addc5f-7a1f-4f4b-bccf-78cb3708bef9\n            Description:  Restore node service - GI\n                 Status:  Failure (To view Error Correlation report, run \"odacli describe-job -i 46addc5f-7a1f-4f4b-bccf-78cb3708bef9 --ecr\" command)\n                Created:  March 5, 2025 9:03:44 AM CET\n                Message:  DCS-10001:Internal error encountered: Failed to provision GI with RHP at the home: \/u01\/app\/19.24.0.0\/grid: DCS-10001:Internal error encountered: PRGH-1030 : The environments on nodes 'srvoda1' do not satisfy some of the prerequisite checks.\n..\n\u2003\nTask Name                                Start Time                               End Time                                 Status\n---------------------------------------- ---------------------------------------- ---------------------------------------- ---------\nRestore node service creation            March 5, 2025 9:04:01 AM CET             March 5, 2025 10:17:35 AM CET            Failure\nRestore node service creation            March 5, 2025 9:04:01 AM CET             March 5, 2025 10:17:35 AM CET            Failure\nRestore node service creation            March 5, 2025 9:04:01 AM CET             March 5, 2025 10:17:35 AM CET            Failure\nProvisioning service creation            March 5, 2025 9:04:01 AM CET             March 5, 2025 10:17:35 AM CET            Failure\nProvisioning service creation            March 5, 2025 9:04:01 AM CET             March 5, 2025 10:17:35 AM CET            Failure\nValidate absence of Interconnect         March 5, 2025 9:04:01 AM CET             March 5, 2025 9:04:02 AM CET             Success\nnetwork configuration file\nSetting up Network                       March 5, 2025 9:04:03 AM CET             March 5, 2025 9:04:03 AM CET             Success\nRestart network interface pubnet         March 5, 2025 9:04:03 AM CET             March 5, 2025 9:04:09 AM CET             Success\nSetting up Vlan                          March 5, 2025 9:04:09 AM CET             March 5, 2025 9:04:10 AM CET             Success\nRestart network interface priv0.100      March 5, 2025 9:04:10 AM CET             March 5, 2025 9:04:11 AM CET             Success\nRestart network interface privasm        March 5, 2025 9:04:11 AM CET             March 5, 2025 9:04:11 AM CET             Success\nSetting up Network                       March 5, 2025 9:04:11 AM CET             March 5, 2025 9:04:11 AM CET             Success\nRestart network interface privasm        March 5, 2025 9:04:11 AM CET             March 5, 2025 9:04:17 AM CET             Success\nNetwork update                           March 5, 2025 9:04:17 AM CET             March 5, 2025 9:04:30 AM CET             Success\nUpdating network                         March 5, 2025 9:04:17 AM CET             March 5, 2025 9:04:30 AM CET             Success\nSetting up Network                       March 5, 2025 9:04:17 AM CET             March 5, 2025 9:04:17 AM CET             Success\nRestart network interface btbond1        March 5, 2025 9:04:17 AM CET             March 5, 2025 9:04:20 AM CET             Success\nRestart network interface btbond1        March 5, 2025 9:04:20 AM CET             March 5, 2025 9:04:24 AM CET             Success\nRestart network interface pubnet         March 5, 2025 9:04:24 AM CET             March 5, 2025 9:04:29 AM CET             Success\nValidate availability of pubnet          March 5, 2025 9:04:30 AM CET             March 5, 2025 9:04:30 AM CET             Success\nOS usergroup 'asmdba' creation           March 5, 2025 9:04:30 AM CET             March 5, 2025 9:04:30 AM CET             Success\nOS usergroup 'asmoper' creation          March 5, 2025 9:04:30 AM CET             March 5, 2025 9:04:30 AM CET             Success\nOS usergroup 'asmadmin' creation         March 5, 2025 9:04:30 AM CET             March 5, 2025 9:04:30 AM CET             Success\nOS usergroup 'dba' creation              March 5, 2025 9:04:30 AM CET             March 5, 2025 9:04:30 AM CET             Success\nOS usergroup 'dbaoper' creation          March 5, 2025 9:04:30 AM CET             March 5, 2025 9:04:30 AM CET             Success\nOS usergroup 'oinstall' creation         March 5, 2025 9:04:30 AM CET             March 5, 2025 9:04:31 AM CET             Success\nOS user 'grid' creation                  March 5, 2025 9:04:31 AM CET             March 5, 2025 9:04:31 AM CET             Success\nOS user 'oracle' creation                March 5, 2025 9:04:31 AM CET             March 5, 2025 9:04:31 AM CET             Success\nDefault backup policy creation           March 5, 2025 9:04:31 AM CET             March 5, 2025 9:04:31 AM CET             Success\nBackup Config name validation            March 5, 2025 9:04:31 AM CET             March 5, 2025 9:04:31 AM CET             Success\nBackup config metadata persist           March 5, 2025 9:04:31 AM CET             March 5, 2025 9:04:31 AM CET             Success\nGrant permission to RHP files            March 5, 2025 9:04:31 AM CET             March 5, 2025 9:04:31 AM CET             Success\nAdd SYSNAME in Env                       March 5, 2025 9:04:32 AM CET             March 5, 2025 9:04:32 AM CET             Success\nInstall oracle-ahf                       March 5, 2025 9:04:32 AM CET             March 5, 2025 9:06:13 AM CET             Success\nStop DCS Admin                           March 5, 2025 9:06:16 AM CET             March 5, 2025 9:06:16 AM CET             Success\nGenerate mTLS certificates               March 5, 2025 9:06:16 AM CET             March 5, 2025 9:06:17 AM CET             Success\nExporting Public Keys                    March 5, 2025 9:06:17 AM CET             March 5, 2025 9:06:18 AM CET             Success\nCreating Trust Store                     March 5, 2025 9:06:18 AM CET             March 5, 2025 9:06:22 AM CET             Success\nUpdate config files                      March 5, 2025 9:06:22 AM CET             March 5, 2025 9:06:22 AM CET             Success\nRestart DCS Admin                        March 5, 2025 9:06:22 AM CET             March 5, 2025 9:06:43 AM CET             Success\nUnzipping storage configuration files    March 5, 2025 9:06:43 AM CET             March 5, 2025 9:06:43 AM CET             Success\nReloading multipath devices              March 5, 2025 9:06:43 AM CET             March 5, 2025 9:06:44 AM CET             Success\nRestart oakd                             March 5, 2025 9:06:44 AM CET             March 5, 2025 9:06:55 AM CET             Success\nRestart oakd                             March 5, 2025 9:08:05 AM CET             March 5, 2025 9:08:15 AM CET             Success\nRestore Quorum Disks                     March 5, 2025 9:08:15 AM CET             March 5, 2025 9:08:16 AM CET             Success\nCreating GI home directories             March 5, 2025 9:08:16 AM CET             March 5, 2025 9:08:16 AM CET             Success\nExtract GI clone                         March 5, 2025 9:08:16 AM CET             March 5, 2025 9:09:29 AM CET             Success\nCreating wallet for Root User            March 5, 2025 9:09:29 AM CET             March 5, 2025 9:09:33 AM CET             Success\nCreating wallet for ASM Client           March 5, 2025 9:09:33 AM CET             March 5, 2025 9:09:39 AM CET             Success\nGrid stack creation                      March 5, 2025 9:09:39 AM CET             March 5, 2025 10:17:35 AM CET            Failure\nGI Restore with RHP                      March 5, 2025 9:09:39 AM CET             March 5, 2025 10:17:35 AM CET            Failure<\/code><\/pre>\n\n\n\n<p>According to the error message, my system doesn&#8217;t satisfy the prerequisites checks.<\/p>\n\n\n\n<p>Let&#8217;s check if error correlation may help:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>odacli describe-job -i 46addc5f-7a1f-4f4b-bccf-78cb3708bef9 --ecr\nODA Assistant - Error Correlation report\n----------------------------------------\n          Failed job ID:  46addc5f-7a1f-4f4b-bccf-78cb3708bef9\n            Description:  Restore node service - GI\n             Start Time:  2025-03-05 09:04:01\n               End Time:  2025-03-05 10:17:35\n         EC report path: \/opt\/oracle\/dcs\/da\/da_repo\/46addc5f-7a1f-4f4b-bccf-78cb3708bef9.json\n\nFailed Task Messages\n--------------------\n&#091;Restore node service - GI] -  DCS-10001:Internal error encountered: Failed to provision GI with RHP at the home: \/u01\/app\/19.24.0.0\/grid: DCS-10001:Internal error encountered: PRGH-1030 : The environments on nodes 'srvoda1' do not satisfy some of the prerequisite checks. ..\n\nsrvoda1 Log Messages\n----------------------------\n  DCS Agent\n  ~~~~~~~~~\n    Error Logs\n    ==========\n    &#091;Install oracle-ahf] - Trying to add string &#091;ERROR] : Unable to switch to home directory\n    &#091;Install oracle-ahf] - error is package tfa-oda is not installed\n    &#091;GI Restore with RHP] - Calling rhp provGI\n    &#091;GI Restore with RHP] - Task(id: TaskDcsJsonRpcExt_707, name: GI Restore with RHP) failed\n    &#091;GI Restore with RHP] - .. d.subtasks.isempty=true d.status=Failure\n    &#091;Grid stack creation] - ..\n    &#091;Grid stack creation] - .. d.subtasks.isempty=false d.status=Failure\n    &#091;Grid stack creation] - DCS-10001:Internal error encountered: PRGH-1030 : The environments on nodes 'srvoda1' do not satisfy some of the prerequisite checks.\n      Error code - DCS-10001\n      Cause: An internal error occurred.\n      Action: Contact Oracle Support for assistance.\n    &#091;Grid stack creation] - .., output:\n    Warning Logs\n    ============\n    &#091;&#091; SEND-THREAD 77 ]] - &#091; &#091; SEND-THREAD 77 ] dcs0-priv:22001] Request failed: Operation: GET Host: dcs0-priv:22001 Path: \/joblocks\/46addc5f-7a1f-4f4b-bccf-78cb3708bef9 Data: null Status: 404\n    &#091;Provisioning service creation] - dm_multipath module is not loaded, attempting to load it...\n\n  RHP\n  ~~~\n    Error Logs\n    ==========\n    &#091;jobid-46addc5f-7a1f-4f4b-bccf-78cb3708bef9] - &#091;SiteFactoryImpl.fetchSite:136]  EntityNotExistsException PRGR-110 : Repository object \"SRVODA1\" of type \"SITE\" does not exist.\n    &#091;jobid-46addc5f-7a1f-4f4b-bccf-78cb3708bef9] - &#091;WorkingCopyOperationImpl.internalAddGI:18517]  Expected: Site does not exist, will have to be created :PRGR-119 : Site \"srvoda1\" does not exist.\n    &#091;jobid-46addc5f-7a1f-4f4b-bccf-78cb3708bef9] - &#091;RemoteFactoryImpl.getCRSHomeOfRemoteCluster:1377]  COException: PRCZ-4001 : failed to execute command \"\/bin\/cat\" using the privileged execution plugin \"odaexec\" on nodes \"srvoda1\" within 120 seconds\n    &#091;jobid-46addc5f-7a1f-4f4b-bccf-78cb3708bef9] - PRCZ-2103 : Failed to execute command \"\/bin\/cat\" on node \"srvoda1\" as user \"root\". Detailed error:\n    &#091;jobid-46addc5f-7a1f-4f4b-bccf-78cb3708bef9] - \/bin\/cat: \/etc\/oracle\/olr.loc: No such file or directory\n    &#091;jobid-46addc5f-7a1f-4f4b-bccf-78cb3708bef9] - &#091;WorkingCopyOperationImpl.internalAddGI:18972]  Exec Exception, expected here :PRGR-118 : Working copy \"OraGrid192400\" does not exist.\n    &#091;jobid-46addc5f-7a1f-4f4b-bccf-78cb3708bef9] - &#091;OracleHomeImpl.addWCMarkerFile:4403]  Ignore the exception to create RHP WC marker file : PRKH-1009 : CRS HOME must be defined in the environment or in the Oracle Cluster Registry\n    &#091;jobid-46addc5f-7a1f-4f4b-bccf-78cb3708bef9] - &#091;ExecCommandNoUserEqImpl.runCmd:491]  Final CompositeOperation exception: PRCC-1021 : One or more of the submitted commands did not execute successfully.\n    &#091;jobid-46addc5f-7a1f-4f4b-bccf-78cb3708bef9] - PRCC-1026 : Command \"\/u01\/app\/19.24.0.0\/grid\/gridSetup.sh -silent -responseFile \/u01\/app\/19.24.0.0\/grid\/\/crs\/install\/rhpdata\/grid7317919467403765800.rsp -ignorePrereq -J-Dskip.cvu.root.checks=true -J-Doracle.install.grid.validate.all=false oracle_install_crs_ODA_CONFIG=olite oracle_install_crs_ConfigureMgmtDB=false -J-Doracle.install.crs.skipGIMRDiskGroupSizeCheck=true oracle_install_asm_UseExistingDG=true -J-Doracle.install.grid.validate.CreateASMDiskGroup=false\" submitted on node srvoda1 timed out after 4,000 seconds.\n    &#091;jobid-46addc5f-7a1f-4f4b-bccf-78cb3708bef9] - &lt;\/OUTPUT&gt;\n    &#091;jobid-46addc5f-7a1f-4f4b-bccf-78cb3708bef9] - &#091;OperationAPIImpl.provGI:676]  OperationAPIException: PRGH-1030 : The environments on nodes 'srvoda1' do not satisfy some of the prerequisite checks.\n\nRelease Notes\n-------------\n  No matching results were found.\n\nDocumentation\n-------------\n  1. Error in restore node process in Data Preserving Reprovisioning\n      Abstract - In the Data Preserving Reprovisioning process, during node restore, an error may be encountered.\n      Link - https:\/\/srvoda1.dbi-services.net:7093\/docs\/cmtrn\/issues-with-oda-odacli.html#GUID-F1385628-9F87-4FEF-8D27-289A3ED459EC\n  2. Error in restore node process in Data Preserving Reprovisioning\n      Abstract - In the Data Preserving Reprovisioning process, during node restore, an error may be encountered.\n      Link - https:\/\/srvoda1.dbi-services.net:7093\/docs\/cmtrn\/issues-with-oda-odacli.html#GUID-75D52887-D425-4753-AF44-EFAB5C148873\n  3. Managing Backup, Restore, and Recovery on a DB System in a KVM Deployment\n      Abstract - Understand the backup, restore, and recovery operations supported on a DB system in a KVM deployment.\n      Link - https:\/\/srvoda1.dbi-services.net:7093\/docs\/cmtxp\/managing-oracle-database-appliance-kvm-deployment1.html#GUID-7318F4D7-4CB8-486C-9DC7-A7490925B866\n  4. Backup, Restore and Recover Databases\n      Abstract - Review backup, restore, and recovery operations for your databases.\n      Link - https:\/\/srvoda1.dbi-services.net:7093\/docs\/cmtxp\/backup-recover-restore.html#GUID-032C43EC-20B9-4036-ADA9-7631EEBBFEF6\n  5. Using the CLI to Backup, Restore, and Recover\n      Abstract - Use the command-line interface to backup, restore, and recover databases.\n      Link - https:\/\/srvoda1.dbi-services.net:7093\/docs\/cmtxp\/backup-recover-restore.html#GUID-54F9A4A6-59B8-4A18-BE41-1CCB9096E2C5\n\nNOTE: For additional details such as file name and line numbers of error logs, please refer to \/opt\/oracle\/dcs\/da\/da_repo\/924d139e-50cc-4893-ab0a-6acb7e7eeb9c.json\n<\/code><\/pre>\n\n\n\n<p>There is a lot of errors, but hard to find what is the source problem.<\/p>\n\n\n\n<p>Let&#8217;s have a look at the logfile of the GI setup:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>vi \/u01\/app\/oraInventory\/logs\/GridSetupActions2025-03-05_09-09-40AM\/gridSetupActions2025-03-05_09-09-40AM.out\n\u2026\nResolution failed, cached value is left untouched for variable\n\u2026\nNo ECDSA host key is known for srvoda1 and you have requested strict checking\n\u2026<\/code><\/pre>\n\n\n\n<p>Could it be a DNS issue? Regarding the network settings, I&#8217;m pretty sure that IP, netmask and gateway are OK.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-identify-and-solve-the-problem-by-editing-the-json-file\">Identify and solve the problem by editing the json file<\/h2>\n\n\n\n<p>Like the create-appliance, the restore-node -g will use a json file restored previously with the update-repository of the server archive.<\/p>\n\n\n\n<p>Let&#8217;s compare my own backup files and the json file used by restore-node -g:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>cat \/mnt\/backup\/ODA_backup\/backup_ODA_srvoda1_20250312_0820\/resolv.conf\nsearch dbi-services.net\nnameserver 10.1.2.127\nnameserver 10.1.2.128\n\ncat \/opt\/oracle\/oak\/restore\/metadata\/provisionInstance.json  | grep dns\n    \"dnsServers\" : &#091; \"10.4.110.4\", \"10.4.110.5\" ],<\/code><\/pre>\n\n\n\n<p>OK, DNS servers have been changed manually in the resolv.conf. They are no more correct in the json file.<\/p>\n\n\n\n<p>As the restore-node -g failed, a cleanup of the system is mandatory:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>\/opt\/oracle\/oak\/onecmd\/cleanup.pl\nINFO: Log file is \/opt\/oracle\/oak\/log\/srvoda1\/cleanup\/cleanup_2025-03-05_10-40-06.log\nINFO: Log file is \/opt\/oracle\/oak\/log\/srvoda1\/cleanup\/dcsemu_diag_precleanup_2025-03-05_10-40-06.log\n\nINFO: Platform is 'BM'\nINFO: *******************************************************************\nINFO: ** Starting process to cleanup provisioned host srvoda1          **\nINFO: *******************************************************************\nWARNING: DPR environment detected. DPR specific cleanup involves\nWARNING: deconfiguring the ODA software stack without touching ASM\nWARNING: storage to allow rerunning of the 'odacli restore-node -g'\nWARNING: command. If regular cleanup(which erases ASM disk headers)\nWARNING: is intended, rerun cleanup.pl with '-nodpr' option.\nWARNING: If Multi-User Access is enabled, use '-omausers' option to\nWARNING: delete the custom users created during the previous run.\nDo you want to continue (yes\/no) : yes\nINFO:\nRunning cleanup will delete Grid User - 'grid' and\nINFO: DB user - 'oracle' and also the\nINFO: groups 'oinstall,dba,asmadmin,asmoper,asmdba'\nINFO: nodes will be rebooted\nDo you want to continue (yes\/no) : yes\n\nINFO: \/u01\/app\/19.24.0.0\/grid\/bin\/crsctl.bin\n\nINFO: *************************************\nINFO: ** Checking for GI bits presence\nINFO: *************************************\nINFO: GI bits \/u01\/app\/19.24.0.0\/grid found on system under \/u01\/app directory...\n\nINFO: *************************************\nINFO: ** DPR Cleanup\nINFO: *************************************\nINFO: Nothing to do.\nSUCCESS: DPR cleanup actions completed.\nINFO: Attempting to stop DCS agent on local node\n\nINFO: *************************************\nINFO: ** Executing AFD cleanup commands\nINFO: *************************************\nINFO: *************************************\nINFO: ** Cleaning Oracle HAMI for ODA\nINFO: *************************************\nINFO: ** - Oracle HAMI for ODA - ensembles cleaned successfully\nINFO: ** - Oracle HAMI for ODA - users cleaned successfully\nINFO: *************************************\nINFO: ** Executing stack deinstall commands\nINFO: *************************************\nINFO: *************************************\nINFO: ** Removing IPC objects\nINFO: *************************************\nINFO: Cleaning up IDM configurations...\nDeleting directory &lt;\/opt\/oracle\/dcs\/idm&gt;INFO: *************************************\n\u2003\nINFO: ** Cleaning miscellaneous components:\nINFO: *************************************\nINFO: ** - reset limits.conf\nINFO: ** - delete users\nINFO: ** - delete groups\nINFO: ** - hostname, gateway and hosts reset commands\nINFO: ** - dcs cleanup and orphan files removal commands\nINFO: Attempting to clean MySQL tables on local node\n\nINFO: Cleaning up network bridges\nINFO: default net is: pubnet\nINFO: Cleaning up network bridges: pubnet on btbond1\nINFO: Reset public interface: pubnet\nINFO: Cleaning up network bridges: privasm on priv0.100\nINFO: remove VLAN config: \/etc\/sysconfig\/network-scripts\/ifcfg-priv0.100\nINFO: BaseDBCC cleanup - skip\nINFO: *************************************\nINFO: ** Removing KVM files\nINFO: *************************************\nINFO: *************************************\nINFO: ** Removing BM CPU Pool files\nINFO: *************************************\nINFO: ** - networking cleaning commands\nINFO: ** - UTC reset commands\nINFO: *************************************\nINFO: ** Removing Oracle AHF RPM\nINFO: *************************************\nINFO: Oracle AHF RPM is installed as : oracle-ahf-2405000-20240715121646.x86_64\nINFO: Uninstalling Oracle AHF RPM\nINFO: Oracle AHF RPM uninstalled successfully\nINFO: Oracle AHF RPM is installed as : oracle-ahf-2405000-20240715121646.x86_64\nINFO: Delete directory clones.local (if existing)...\nINFO: Cleaning up ACFS mounts...\nINFO: Reset password for 'root' to default value\nINFO: Executing &lt;command to reset root password to default value&gt;\nINFO: Removing SSH keys on srvoda1\n\nINFO: Rebooting the system via &lt;reboot&gt;...\nINFO: Executing &lt;reboot&gt;\n\nINFO: Cleanup was successful\nINFO: Log file is \/opt\/oracle\/oak\/log\/srvoda1\/cleanup\/cleanup_2025-03-05_10-40-06.log\n\nWARNING: After system reboot, please re-run \"odacli update-repository\" for GI\/DB clones,\nWARNING: before running \"odacli restore-node -g\".\n<\/code><\/pre>\n\n\n\n<p>Once the server has rebooted, let&#8217;s register again the GI and server archive files:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>odacli update-repository -f \/mnt\/backup\/ODA_backup\/odacli-dcs-19.24.0.0.0-240724-GI-19.24.0.0.zip\nodacli update-repository -f \/mnt\/backup\/ODA_backup\/serverarchive_srvoda1.zip<\/code><\/pre>\n\n\n\n<p>Let&#8217;s change the DNS in the provisionInstance.json and do the restore-node -g:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sed -i 's\/10.4.110.4\/10.1.2.127\/g' \/opt\/oracle\/oak\/restore\/metadata\/provisionInstance.json\nsed -i 's\/10.4.110.5\/10.1.2.128\/g' \/opt\/oracle\/oak\/restore\/metadata\/provisionInstance.json\n\ncat \/opt\/oracle\/oak\/restore\/metadata\/provisionInstance.json  | grep dns\n    \"dnsServers\" : &#091; \"10.1.2.127\", \"10.1.2.128\" ],\n\nodacli restore-node -g\n...\n\nodacli describe-job -i \"f2e14691-1fc4-4b8d-9186-cbb55a69c5dd\"\nJob details\n----------------------------------------------------------------\n                     ID:  f2e14691-1fc4-4b8d-9186-cbb55a69c5dd\n            Description:  Restore node service - GI\n                 Status:  Success\n                Created:  March 5, 2025 5:33:33 PM CET\n                Message:\n\nTask Name                                Start Time                               End Time                                 Status\n---------------------------------------- ---------------------------------------- ---------------------------------------- ---------\nRestore node service creation            March 5, 2025 5:33:40 PM CET             March 5, 2025 5:53:33 PM CET             Success\nValidate absence of Interconnect         March 5, 2025 5:33:40 PM CET             March 5, 2025 5:33:41 PM CET             Success\nnetwork configuration file\nSetting up Network                       March 5, 2025 5:33:42 PM CET             March 5, 2025 5:33:42 PM CET             Success\nRestart network interface pubnet         March 5, 2025 5:33:42 PM CET             March 5, 2025 5:33:48 PM CET             Success\nSetting up Vlan                          March 5, 2025 5:33:48 PM CET             March 5, 2025 5:33:49 PM CET             Success\nRestart network interface priv0.100      March 5, 2025 5:33:49 PM CET             March 5, 2025 5:33:50 PM CET             Success\nRestart network interface privasm        March 5, 2025 5:33:50 PM CET             March 5, 2025 5:33:50 PM CET             Success\nSetting up Network                       March 5, 2025 5:33:51 PM CET             March 5, 2025 5:33:51 PM CET             Success\nRestart network interface privasm        March 5, 2025 5:33:51 PM CET             March 5, 2025 5:33:56 PM CET             Success\nNetwork update                           March 5, 2025 5:33:56 PM CET             March 5, 2025 5:34:09 PM CET             Success\nUpdating network                         March 5, 2025 5:33:56 PM CET             March 5, 2025 5:34:09 PM CET             Success\nSetting up Network                       March 5, 2025 5:33:56 PM CET             March 5, 2025 5:33:56 PM CET             Success\nRestart network interface btbond1        March 5, 2025 5:33:56 PM CET             March 5, 2025 5:34:00 PM CET             Success\nRestart network interface btbond1        March 5, 2025 5:34:00 PM CET             March 5, 2025 5:34:03 PM CET             Success\nRestart network interface pubnet         March 5, 2025 5:34:03 PM CET             March 5, 2025 5:34:09 PM CET             Success\nValidate availability of pubnet          March 5, 2025 5:34:09 PM CET             March 5, 2025 5:34:09 PM CET             Success\nOS usergroup 'asmdba' creation           March 5, 2025 5:34:09 PM CET             March 5, 2025 5:34:09 PM CET             Success\nOS usergroup 'asmoper' creation          March 5, 2025 5:34:09 PM CET             March 5, 2025 5:34:09 PM CET             Success\nOS usergroup 'asmadmin' creation         March 5, 2025 5:34:09 PM CET             March 5, 2025 5:34:09 PM CET             Success\nOS usergroup 'dba' creation              March 5, 2025 5:34:09 PM CET             March 5, 2025 5:34:10 PM CET             Success\nOS usergroup 'dbaoper' creation          March 5, 2025 5:34:10 PM CET             March 5, 2025 5:34:10 PM CET             Success\nOS usergroup 'oinstall' creation         March 5, 2025 5:34:10 PM CET             March 5, 2025 5:34:10 PM CET             Success\nOS user 'grid' creation                  March 5, 2025 5:34:10 PM CET             March 5, 2025 5:34:10 PM CET             Success\nOS user 'oracle' creation                March 5, 2025 5:34:10 PM CET             March 5, 2025 5:34:11 PM CET             Success\nDefault backup policy creation           March 5, 2025 5:34:11 PM CET             March 5, 2025 5:34:11 PM CET             Success\nBackup Config name validation            March 5, 2025 5:34:11 PM CET             March 5, 2025 5:34:11 PM CET             Success\nBackup config metadata persist           March 5, 2025 5:34:11 PM CET             March 5, 2025 5:34:11 PM CET             Success\nGrant permission to RHP files            March 5, 2025 5:34:11 PM CET             March 5, 2025 5:34:11 PM CET             Success\nAdd SYSNAME in Env                       March 5, 2025 5:34:11 PM CET             March 5, 2025 5:34:11 PM CET             Success\nInstall oracle-ahf                       March 5, 2025 5:34:11 PM CET             March 5, 2025 5:35:54 PM CET             Success\nStop DCS Admin                           March 5, 2025 5:35:56 PM CET             March 5, 2025 5:35:56 PM CET             Success\nGenerate mTLS certificates               March 5, 2025 5:35:56 PM CET             March 5, 2025 5:35:58 PM CET             Success\nExporting Public Keys                    March 5, 2025 5:35:58 PM CET             March 5, 2025 5:35:59 PM CET             Success\nCreating Trust Store                     March 5, 2025 5:35:59 PM CET             March 5, 2025 5:36:02 PM CET             Success\nUpdate config files                      March 5, 2025 5:36:02 PM CET             March 5, 2025 5:36:02 PM CET             Success\nRestart DCS Admin                        March 5, 2025 5:36:02 PM CET             March 5, 2025 5:36:23 PM CET             Success\nUnzipping storage configuration files    March 5, 2025 5:36:23 PM CET             March 5, 2025 5:36:23 PM CET             Success\nReloading multipath devices              March 5, 2025 5:36:23 PM CET             March 5, 2025 5:36:24 PM CET             Success\nRestart oakd                             March 5, 2025 5:36:24 PM CET             March 5, 2025 5:36:34 PM CET             Success\nRestart oakd                             March 5, 2025 5:37:45 PM CET             March 5, 2025 5:37:55 PM CET             Success\nRestore Quorum Disks                     March 5, 2025 5:37:55 PM CET             March 5, 2025 5:37:56 PM CET             Success\nCreating GI home directories             March 5, 2025 5:37:56 PM CET             March 5, 2025 5:37:56 PM CET             Success\nExtract GI clone                         March 5, 2025 5:37:56 PM CET             March 5, 2025 5:39:07 PM CET             Success\nCreating wallet for Root User            March 5, 2025 5:39:07 PM CET             March 5, 2025 5:39:15 PM CET             Success\nCreating wallet for ASM Client           March 5, 2025 5:39:15 PM CET             March 5, 2025 5:39:18 PM CET             Success\nGrid stack creation                      March 5, 2025 5:39:18 PM CET             March 5, 2025 5:49:35 PM CET             Success\nGI Restore with RHP                      March 5, 2025 5:39:18 PM CET             March 5, 2025 5:46:26 PM CET             Success\nUpdating GIHome version                  March 5, 2025 5:46:28 PM CET             March 5, 2025 5:46:31 PM CET             Success\nRestarting Clusterware                   March 5, 2025 5:46:32 PM CET             March 5, 2025 5:49:35 PM CET             Success\nPost cluster OAKD configuration          March 5, 2025 5:49:35 PM CET             March 5, 2025 5:50:30 PM CET             Success\nMounting disk group DATA                 March 5, 2025 5:50:30 PM CET             March 5, 2025 5:50:31 PM CET             Success\nMounting disk group RECO                 March 5, 2025 5:50:38 PM CET             March 5, 2025 5:50:45 PM CET             Success\nSetting ACL for disk groups              March 5, 2025 5:50:53 PM CET             March 5, 2025 5:50:55 PM CET             Success\nRegister Scan and Vips to Public Network March 5, 2025 5:50:55 PM CET             March 5, 2025 5:50:57 PM CET             Success\nAdding Volume DUMPS to Clusterware       March 5, 2025 5:51:10 PM CET             March 5, 2025 5:51:13 PM CET             Success\nAdding Volume ACFSCLONE to Clusterware   March 5, 2025 5:51:13 PM CET             March 5, 2025 5:51:15 PM CET             Success\nAdding Volume ODABASE_N0 to Clusterware  March 5, 2025 5:51:15 PM CET             March 5, 2025 5:51:18 PM CET             Success\nAdding Volume COMMONSTORE to Clusterware March 5, 2025 5:51:18 PM CET             March 5, 2025 5:51:20 PM CET             Success\nAdding Volume ORAHOME_SH to Clusterware  March 5, 2025 5:51:20 PM CET             March 5, 2025 5:51:23 PM CET             Success\nEnabling Volume(s)                       March 5, 2025 5:51:23 PM CET             March 5, 2025 5:52:26 PM CET             Success\nDiscover ACFS clones config              March 5, 2025 5:53:18 PM CET             March 5, 2025 5:53:27 PM CET             Success\nConfigure export clones resource         March 5, 2025 5:53:26 PM CET             March 5, 2025 5:53:27 PM CET             Success\nDiscover DbHomes ACFS config             March 5, 2025 5:53:27 PM CET             March 5, 2025 5:53:30 PM CET             Success\nDiscover OraHomeStorage volumes          March 5, 2025 5:53:27 PM CET             March 5, 2025 5:53:30 PM CET             Success\nSetting up Hugepages                     March 5, 2025 5:53:30 PM CET             March 5, 2025 5:53:30 PM CET             Success\nProvisioning service creation            March 5, 2025 5:53:32 PM CET             March 5, 2025 5:53:32 PM CET             Success\nPersist new agent state entry            March 5, 2025 5:53:32 PM CET             March 5, 2025 5:53:32 PM CET             Success\nPersist new agent state entry            March 5, 2025 5:53:32 PM CET             March 5, 2025 5:53:32 PM CET             Success\nRestart DCS Agent                        March 5, 2025 5:53:32 PM CET             March 5, 2025 5:53:33 PM CET             Success<\/code><\/pre>\n\n\n\n<p>This time it worked fine. Next step will be the restore-node -d for restoring the databases.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-the-backup-script-i-use-before-patching-an-oda\">The backup script I use before patching an ODA<\/h2>\n\n\n\n<p>Troubleshooting is easier if you can have a look at configuration files that were in use prior reimaging. Here is a script I&#8217;ve been using for years before patching or reimaging an ODA. I would recommend making your own script based on mine according to your specific configuration:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>vi \/mnt\/backup\/prepatch_backup.sh\n# Backup important files before patching\nexport BKPPATH=\/mnt\/backup\/ODA_backup\/backup_ODA_`hostname`_`date +\"%Y%m%d_%H%M\"`\necho \"Backing up to \" $BKPPATH\nmkdir -p $BKPPATH\nodacli list-databases &gt; $BKPPATH\/list-databases.txt\nps -ef | grep pmon | grep -v ASM | grep -v APX | grep -v grep | cut -c 58- | sort &gt; $BKPPATH\/running-instances.txt\nodacli list-dbhomes &gt; $BKPPATH\/list-dbhomes.txt\nodacli list-dbsystems &gt; $BKPPATH\/list-dbsystems.txt\nodacli list-vms &gt; $BKPPATH\/list-vms.txt\ncrontab -u oracle -l  &gt; $BKPPATH\/crontab-oracle.txt\ncrontab -u grid -l  &gt; $BKPPATH\/crontab-grid.txt\ncrontab -l  &gt; $BKPPATH\/crontab-root.txt\n\ncat \/etc\/fstab &gt;  $BKPPATH\/fstab.txt\ncat \/etc\/oratab &gt;  $BKPPATH\/oratab.txt\ncat \/etc\/sysconfig\/network &gt;  $BKPPATH\/etc-sysconfig-network.txt\ncat \/etc\/hosts  &gt;  $BKPPATH\/hosts\ncat \/etc\/resolv.conf  &gt;  $BKPPATH\/resolv.conf\ncp \/etc\/krb5.conf  $BKPPATH\/\ncp \/etc\/krb5.keytab  $BKPPATH\/\nmkdir $BKPPATH\/network-scripts\ncp  \/etc\/sysconfig\/network-scripts\/ifcfg*  $BKPPATH\/network-scripts\/\nodacli describe-system &gt; $BKPPATH\/describe-system.txt\nodacli  describe-component &gt;  $BKPPATH\/describe-component.txt\nHISTFILE=~\/.bash_history\nset -o history\nhistory &gt; $BKPPATH\/history-root.txt\ncp \/home\/oracle\/.bash_history $BKPPATH\/history-oracle.txt\ndf -h &gt;  $BKPPATH\/filesystems-status.txt\n\nfor a in `odacli list-dbhomes -j | grep dbHomeLocation | awk -F '\"' '{print $4}' | sort` ; do mkdir -p $BKPPATH\/$a\/network\/admin\/ ; cp $a\/network\/admin\/tnsnames.ora $BKPPATH\/$a\/network\/admin\/; cp $a\/network\/admin\/sqlnet.ora $BKPPATH\/$a\/network\/admin\/; done\nfor a in `odacli list-dbhomes -j | grep dbHomeLocation | awk -F '\"' '{print $4}' | sort` ; do mkdir -p $BKPPATH\/$a\/owm\/ ; cp -r $a\/owm\/* $BKPPATH\/$a\/owm\/; done\ncp `ps -ef | grep -v grep | grep LISTENER | awk -F ' ' '{print $8}' | awk -F 'bin' '{print $1}'`network\/admin\/listener.ora $BKPPATH\/gridhome-listener.ora\ncp `ps -ef | grep -v grep | grep LISTENER | awk -F ' ' '{print $8}' | awk -F 'bin' '{print $1}'`\/network\/admin\/sqlnet.ora $BKPPATH\/gridhome-sqlnet.ora\n\ntar czf $BKPPATH\/u01-app-oracle-admin.tgz \/u01\/app\/oracle\/admin\/\ntar czf $BKPPATH\/u01-app-oracle-local.tgz \/u01\/app\/oracle\/local\/\ntar czf $BKPPATH\/home.tgz \/home\/\ncp \/etc\/passwd $BKPPATH\/\ncp \/etc\/group $BKPPATH\/\n\necho \"End\"\necho \"Backup files size:\"\ndu -hs  $BKPPATH\necho \"Backup files content:\"\nls -lrt  $BKPPATH\n<\/code><\/pre>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-conclusion\">Conclusion<\/h2>\n\n\n\n<p>I would recommend these 3 rules to save hours of troubleshooting:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>as mentioned in the ODA documentation: never change networks parameters manually (IP, gateway, hostname, DNS, bonding mode, \u2026)<\/li>\n\n\n\n<li>document every manual change you make on your ODA (additional tools setup, specific settings, \u2026)<\/li>\n\n\n\n<li>do an extensive backup of all configuration files before doing a patching or a DPR (use the script provided in the previous chapter for creating yours)<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Introduction Patching your Oracle Database Appliance from 19.20 or earlier release to 19.21 or newer release implies the use of Data Preserving Reprovisioning (DPR). Most of the time, and with an adequate preparation, the DPR works fine. But if something goes wrong at the restore-node -g step, you will need some troubleshooting and maybe opening [&hellip;]<\/p>\n","protected":false},"author":45,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[59],"tags":[3121,3383,3468,2620,2184,3580,3579,3582,2568,2280,3578,3235,3581,3079,1330,1331,1697,1698,2427,2429],"type_dbi":[],"class_list":["post-37692","post","type-post","status-publish","format-standard","hentry","category-oracle","tag-19-21","tag-19-23","tag-19-24","tag-data-preserving-reprovisioning","tag-dcs-10001","tag-error-is-package-tfa-oda-is-not-installed","tag-failed-to-provision-gi","tag-grid-stack-creation-failure","tag-oracle-database-appliance-2","tag-patching-oda","tag-prgh-1030","tag-restore-node","tag-trying-to-add-string-error-unable-to-switch-to-home-directory","tag-x10-s","tag-x7-2ha","tag-x7-2m","tag-x8-2ha","tag-x8-2m","tag-x9-2ha","tag-x9-2s"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.2 (Yoast SEO v27.2) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>PRGH-1030 when doing restore-node -g on ODA - dbi Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"PRGH-1030 when doing restore-node -g on ODA\" \/>\n<meta property=\"og:description\" content=\"Introduction Patching your Oracle Database Appliance from 19.20 or earlier release to 19.21 or newer release implies the use of Data Preserving Reprovisioning (DPR). Most of the time, and with an adequate preparation, the DPR works fine. But if something goes wrong at the restore-node -g step, you will need some troubleshooting and maybe opening [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2025-03-14T12:47:55+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-03-14T12:47:59+00:00\" \/>\n<meta name=\"author\" content=\"J\u00e9r\u00f4me Dubar\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"J\u00e9r\u00f4me Dubar\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/\"},\"author\":{\"name\":\"J\u00e9r\u00f4me Dubar\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/0fb4bbf128b4cda2f96d662dec2baedd\"},\"headline\":\"PRGH-1030 when doing restore-node -g on ODA\",\"datePublished\":\"2025-03-14T12:47:55+00:00\",\"dateModified\":\"2025-03-14T12:47:59+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/\"},\"wordCount\":912,\"commentCount\":0,\"keywords\":[\"19.21\",\"19.23\",\"19.24\",\"Data Preserving Reprovisioning\",\"DCS-10001\",\"error is package tfa-oda is not installed\",\"Failed to provision GI\",\"Grid stack creation failure\",\"oracle database appliance\",\"patching oda\",\"PRGH-1030\",\"restore-node\",\"Trying to add string [ERROR] : Unable to switch to home directory\",\"x10-s\",\"X7-2HA\",\"X7-2M\",\"x8-2ha\",\"x8-2m\",\"X9-2HA\",\"X9-2S\"],\"articleSection\":[\"Oracle\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/\",\"name\":\"PRGH-1030 when doing restore-node -g on ODA - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\"},\"datePublished\":\"2025-03-14T12:47:55+00:00\",\"dateModified\":\"2025-03-14T12:47:59+00:00\",\"author\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/0fb4bbf128b4cda2f96d662dec2baedd\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.dbi-services.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"PRGH-1030 when doing restore-node -g on ODA\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/0fb4bbf128b4cda2f96d662dec2baedd\",\"name\":\"J\u00e9r\u00f4me Dubar\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/efaa5a7def0aa4cdaf49a470fb4a7641a3ea6e378ae1455096a0933f99f46d6b?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/efaa5a7def0aa4cdaf49a470fb4a7641a3ea6e378ae1455096a0933f99f46d6b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/efaa5a7def0aa4cdaf49a470fb4a7641a3ea6e378ae1455096a0933f99f46d6b?s=96&d=mm&r=g\",\"caption\":\"J\u00e9r\u00f4me Dubar\"},\"description\":\"J\u00e9r\u00f4me Dubar has more than 15 years of experience in the field of Information Technology. Ten years ago, he specialized in the Oracle Database technology. His expertise is focused on database architectures, high availability (RAC), disaster recovery (DataGuard), backups (RMAN), performance analysis and tuning (AWR\/statspack), migration, consolidation and appliances, especially ODA (his main projects during the last years). Prior to joining dbi services, J\u00e9r\u00f4me Dubar worked in a Franco-Belgian IT service company as Database team manager and main consultant for 7 years. He also worked for 5 years in a software editor company as technical consultant across France. He was also teaching Oracle Database lessons for 9 years. J\u00e9r\u00f4me Dubar holds a Computer Engineering degree from the Lille Sciences and Technologies university in northern France. His branch-related experience covers the public sector, retail, industry, banking, health, e-commerce and IT sectors.\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/author\/jerome-dubar\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"PRGH-1030 when doing restore-node -g on ODA - dbi Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/","og_locale":"en_US","og_type":"article","og_title":"PRGH-1030 when doing restore-node -g on ODA","og_description":"Introduction Patching your Oracle Database Appliance from 19.20 or earlier release to 19.21 or newer release implies the use of Data Preserving Reprovisioning (DPR). Most of the time, and with an adequate preparation, the DPR works fine. But if something goes wrong at the restore-node -g step, you will need some troubleshooting and maybe opening [&hellip;]","og_url":"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/","og_site_name":"dbi Blog","article_published_time":"2025-03-14T12:47:55+00:00","article_modified_time":"2025-03-14T12:47:59+00:00","author":"J\u00e9r\u00f4me Dubar","twitter_card":"summary_large_image","twitter_misc":{"Written by":"J\u00e9r\u00f4me Dubar","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/"},"author":{"name":"J\u00e9r\u00f4me Dubar","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/0fb4bbf128b4cda2f96d662dec2baedd"},"headline":"PRGH-1030 when doing restore-node -g on ODA","datePublished":"2025-03-14T12:47:55+00:00","dateModified":"2025-03-14T12:47:59+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/"},"wordCount":912,"commentCount":0,"keywords":["19.21","19.23","19.24","Data Preserving Reprovisioning","DCS-10001","error is package tfa-oda is not installed","Failed to provision GI","Grid stack creation failure","oracle database appliance","patching oda","PRGH-1030","restore-node","Trying to add string [ERROR] : Unable to switch to home directory","x10-s","X7-2HA","X7-2M","x8-2ha","x8-2m","X9-2HA","X9-2S"],"articleSection":["Oracle"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/","url":"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/","name":"PRGH-1030 when doing restore-node -g on ODA - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"datePublished":"2025-03-14T12:47:55+00:00","dateModified":"2025-03-14T12:47:59+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/0fb4bbf128b4cda2f96d662dec2baedd"},"breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/prgh-1030-when-doing-restore-node-g-on-oda\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"PRGH-1030 when doing restore-node -g on ODA"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/0fb4bbf128b4cda2f96d662dec2baedd","name":"J\u00e9r\u00f4me Dubar","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/efaa5a7def0aa4cdaf49a470fb4a7641a3ea6e378ae1455096a0933f99f46d6b?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/efaa5a7def0aa4cdaf49a470fb4a7641a3ea6e378ae1455096a0933f99f46d6b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/efaa5a7def0aa4cdaf49a470fb4a7641a3ea6e378ae1455096a0933f99f46d6b?s=96&d=mm&r=g","caption":"J\u00e9r\u00f4me Dubar"},"description":"J\u00e9r\u00f4me Dubar has more than 15 years of experience in the field of Information Technology. Ten years ago, he specialized in the Oracle Database technology. His expertise is focused on database architectures, high availability (RAC), disaster recovery (DataGuard), backups (RMAN), performance analysis and tuning (AWR\/statspack), migration, consolidation and appliances, especially ODA (his main projects during the last years). Prior to joining dbi services, J\u00e9r\u00f4me Dubar worked in a Franco-Belgian IT service company as Database team manager and main consultant for 7 years. He also worked for 5 years in a software editor company as technical consultant across France. He was also teaching Oracle Database lessons for 9 years. J\u00e9r\u00f4me Dubar holds a Computer Engineering degree from the Lille Sciences and Technologies university in northern France. His branch-related experience covers the public sector, retail, industry, banking, health, e-commerce and IT sectors.","url":"https:\/\/www.dbi-services.com\/blog\/author\/jerome-dubar\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/37692","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/45"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=37692"}],"version-history":[{"count":3,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/37692\/revisions"}],"predecessor-version":[{"id":37695,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/37692\/revisions\/37695"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=37692"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=37692"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=37692"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=37692"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}