{"id":14194,"date":"2020-05-25T20:33:07","date_gmt":"2020-05-25T18:33:07","guid":{"rendered":"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/"},"modified":"2020-05-25T20:33:07","modified_gmt":"2020-05-25T18:33:07","slug":"issue-deleting-a-database-on-oda","status":"publish","type":"post","link":"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/","title":{"rendered":"Issue deleting a database on ODA?"},"content":{"rendered":"<p>I have recently faced an issue deleting database on an ODA. I was getting following error whatever database I wanted to delete : <strong><em>DCS-10001:Internal error encountered: null<\/em><\/strong>.<\/p>\n<p>Through this blog, I would like to share with you my experience on this case hoping it will help you if you are facing same problem. On this project I was using ODA Release 18.5 and 18.8 and faced the same problem on both versions. On 18.3 and previous releases this was not the case.<\/p>\n<p><!--more--><\/p>\n<h3>Deleting the database<\/h3>\n<p>With odacli I tried to delete my TEST database, running following commands :<\/p>\n<p><code>[root@ODA01 bin]# <strong>odacli delete-database -in TEST -fd<\/strong><br \/>\n{<br \/>\n\"jobId\" : \"bcdcbf59-0fe6-44b7-af7f-91f68c7697ed\",<br \/>\n\"status\" : \"Running\",<br \/>\n\"message\" : null,<br \/>\n\"reports\" : [ {<br \/>\n\"taskId\" : \"TaskZJsonRpcExt_858\",<br \/>\n\"taskName\" : \"Validate db d6542252-dfa4-47f9-9cfc-22b4f0575c51 for deletion\",<br \/>\n\"taskResult\" : \"\",<br \/>\n\"startTime\" : \"May 06, 2020 11:36:38 AM CEST\",<br \/>\n\"endTime\" : \"May 06, 2020 11:36:38 AM CEST\",<br \/>\n\"status\" : \"Success\",<br \/>\n\"taskDescription\" : null,<br \/>\n\"parentTaskId\" : \"TaskSequential_856\",<br \/>\n\"jobId\" : \"bcdcbf59-0fe6-44b7-af7f-91f68c7697ed\",<br \/>\n\"tags\" : [ ],<br \/>\n\"reportLevel\" : \"Info\",<br \/>\n\"updatedTime\" : \"May 06, 2020 11:36:38 AM CEST\"<br \/>\n} ],<br \/>\n\"createTimestamp\" : \"May 06, 2020 11:36:38 AM CEST\",<br \/>\n\"resourceList\" : [ ],<br \/>\n\"description\" : \"Database service deletion with db name: TEST with id : d6542252-dfa4-47f9-9cfc-22b4f0575c51\",<br \/>\n\"updatedTime\" : \"May 06, 2020 11:36:38 AM CEST\"<br \/>\n}<\/code><\/p>\n<p>The job was failing with DCS-10001 Error :<\/p>\n<p><code>[root@ODA01 bin]# <strong>odacli describe-job -i \"bcdcbf59-0fe6-44b7-af7f-91f68c7697ed\"<\/strong><br \/>\n&nbsp;<br \/>\nJob details<br \/>\n----------------------------------------------------------------<br \/>\nID:  bcdcbf59-0fe6-44b7-af7f-91f68c7697ed<br \/>\nDescription:  Database service deletion with db name: TEST with id : d6542252-dfa4-47f9-9cfc-22b4f0575c51<br \/>\nStatus:  Failure<br \/>\nCreated:  May 6, 2020 11:36:38 AM CEST<br \/>\nMessage:  <strong>DCS-10001:Internal error encountered: null.<\/strong><br \/>\n&nbsp;<br \/>\nTask Name                                Start Time                          End Time                            Status<br \/>\n---------------------------------------- ----------------------------------- ----------------------------------- ----------<br \/>\ndatabase Service deletion for d6542252-dfa4-47f9-9cfc-22b4f0575c51 May 6, 2020 11:36:38 AM CEST        May 6, 2020 11:36:50 AM CEST        Failure<br \/>\ndatabase Service deletion for d6542252-dfa4-47f9-9cfc-22b4f0575c51 May 6, 2020 11:36:38 AM CEST        May 6, 2020 11:36:50 AM CEST        Failure<br \/>\nValidate db d6542252-dfa4-47f9-9cfc-22b4f0575c51 for deletion May 6, 2020 11:36:38 AM CEST        May 6, 2020 11:36:38 AM CEST        Success<br \/>\nDatabase Deletion                        May 6, 2020 11:36:39 AM CEST        May 6, 2020 11:36:39 AM CEST        Success<br \/>\nUnregister Db From Cluster               May 6, 2020 11:36:39 AM CEST        May 6, 2020 11:36:39 AM CEST        Success<br \/>\nKill Pmon Process                        May 6, 2020 11:36:39 AM CEST        May 6, 2020 11:36:39 AM CEST        Success<br \/>\nDatabase Files Deletion                  May 6, 2020 11:36:39 AM CEST        May 6, 2020 11:36:40 AM CEST        Success<br \/>\nDeleting Volume                          May 6, 2020 11:36:47 AM CEST        May 6, 2020 11:36:50 AM CEST        Success<br \/>\ndatabase Service deletion for d6542252-dfa4-47f9-9cfc-22b4f0575c51 May 6, 2020 11:36:50 AM CEST        May 6, 2020 11:36:50 AM CEST        Failure<\/code><\/p>\n<h3>Troubleshooting<\/h3>\n<p>In the dcs-agent.log, located in \/opt\/oracle\/dcs\/log folder, you might see following errors :<\/p>\n<p><code>2019-11-27 13:54:30,106 ERROR [database Service deletion for 89e11f5d-9789-44a3-a09d-2444f0fda99e : JobId=05a2d017-9b64-4e92-a7df-3ded603d0644] [] c.o.d.c.j.JsonRequestProcessor: RPC request invocation failed on request: {\"classz\":\"com.oracle.dcs.agent.rpc.service.dataguard.DataguardActions\",\"method\":\"<strong>deleteListenerEntry<\/strong>\",\"params\":[{\"type\":\"com.oracle.dcs.agent.model.DB\",\"value\":{\"updatedTime\":1573023492194,\"id\":\"89e11f5d-9789-44a3-a09d-2444f0fda99e\",\"name\":\"TEST\",\"createTime\":1573023439244,\"state\":{\"status\":\"CONFIGURED\"},\"dbName\":\"TEST\",\"databaseUniqueName\":\"TEST_RZB\",\"dbVersion\":\"11.2.0.4.190115\",\"dbHomeId\":\"c58cdcfd-e5b2-4041-b993-8df5a5d5ada4\",\"dbId\":null,\"isCdb\":false,\"pdBName\":null,\"pdbAdminUserName\":null,\"enableTDE\":false,\"isBcfgInSync\":null,\"dbType\":\"SI\",\"dbTargetNodeNumber\":\"0\",\"dbClass\":\"OLTP\",\"dbShape\":\"odb1\",\"dbStorage\":\"ACFS\",\"dbOnFlashStorage\":false,\"level0BackupDay\":\"sunday\",\"instanceOnly\":true,\"registerOnly\":false,\"rmanBkupPassword\":null,\"dbEdition\":\"SE\",\"dbDomainName\":\"ksbl.local\",\"dbRedundancy\":null,\"dbCharacterSet\":{\"characterSet\":\"AL32UTF8\",\"nlsCharacterset\":\"AL16UTF16\",\"dbTerritory\":\"AMERICA\",\"dbLanguage\":\"AMERICAN\"},\"dbConsoleEnable\":false,\"backupDestination\":\"NONE\",\"cloudStorageContainer\":null,\"backupConfigId\":null,\"isAutoBackupDisabled\":false}}],\"revertable\":false,\"threadId\":111}<br \/>\n! java.lang.NullPointerException: null<br \/>\n! at com.oracle.dcs.agent.rpc.service.dataguard.DataguardOperations.deleteListenerEntry(DataguardOperations.java:2258)<br \/>\n! at com.oracle.dcs.agent.rpc.service.dataguard.DataguardActions.deleteListenerEntry(DataguardActions.java:24)<br \/>\n! at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)<br \/>\n! at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)<br \/>\n! at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)<br \/>\n! at java.lang.reflect.Method.invoke(Method.java:498)<br \/>\n! at com.oracle.dcs.commons.jrpc.JsonRequestProcessor.invokeRequest(JsonRequestProcessor.java:33)<br \/>\n! ... 23 common frames omitted<br \/>\n! Causing: com.oracle.dcs.commons.exception.DcsException: DCS-10001:Internal error encountered: null.<br \/>\n! at com.oracle.dcs.commons.exception.DcsException$Builder.build(DcsException.java:68)<br \/>\n! at com.oracle.dcs.commons.jrpc.JsonRequestProcessor.invokeRequest(JsonRequestProcessor.java:45)<br \/>\n! at com.oracle.dcs.commons.jrpc.JsonRequestProcessor.process(JsonRequestProcessor.java:74)<br \/>\n! at com.oracle.dcs.agent.task.TaskZJsonRpcExt.callInternal(TaskZJsonRpcExt.java:65)<br \/>\n! at com.oracle.dcs.agent.task.TaskZJsonRpc.call(TaskZJsonRpc.java:182)<br \/>\n! at com.oracle.dcs.agent.task.TaskZJsonRpc.call(TaskZJsonRpc.java:26)<br \/>\n! at com.oracle.dcs.commons.task.TaskWrapper.call(TaskWrapper.java:82)<br \/>\n! at com.oracle.dcs.commons.task.TaskApi.call(TaskApi.java:37)<br \/>\n! at com.oracle.dcs.commons.task.TaskSequential.call(TaskSequential.java:39)<br \/>\n! at com.oracle.dcs.commons.task.TaskSequential.call(TaskSequential.java:10)<br \/>\n! at com.oracle.dcs.commons.task.TaskWrapper.call(TaskWrapper.java:82)<br \/>\n! at com.oracle.dcs.commons.task.TaskApi.call(TaskApi.java:37)<br \/>\n! at com.oracle.dcs.commons.task.TaskSequential.call(TaskSequential.java:39)<br \/>\n! at com.oracle.dcs.agent.task.TaskZLockWrapper.call(TaskZLockWrapper.java:64)<br \/>\n! at com.oracle.dcs.agent.task.TaskZLockWrapper.call(TaskZLockWrapper.java:21)<br \/>\n! at com.oracle.dcs.commons.task.TaskWrapper.call(TaskWrapper.java:82)<br \/>\n! at com.oracle.dcs.commons.task.TaskApi.call(TaskApi.java:37)<br \/>\n! at com.oracle.dcs.commons.task.TaskSequential.call(TaskSequential.java:39)<br \/>\n! at com.oracle.dcs.commons.task.TaskSequential.call(TaskSequential.java:10)<br \/>\n! at com.oracle.dcs.commons.task.TaskWrapper.call(TaskWrapper.java:82)<br \/>\n! at com.oracle.dcs.commons.task.TaskWrapper.call(TaskWrapper.java:17)<br \/>\n! at java.util.concurrent.FutureTask.run(FutureTask.java:266)<br \/>\n! at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)<br \/>\n! at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)<br \/>\n! at java.lang.Thread.run(Thread.java:748)<br \/>\n2019-11-27 13:54:30,106 INFO [database Service deletion for 89e11f5d-9789-44a3-a09d-2444f0fda99e : JobId=05a2d017-9b64-4e92-a7df-3ded603d0644] [] c.o.d.a.z.DCSZooKeeper: DCS node id is - node_0<br \/>\n2019-11-27 13:54:30,106 DEBUG [database Service deletion for 89e11f5d-9789-44a3-a09d-2444f0fda99e : JobId=05a2d017-9b64-4e92-a7df-3ded603d0644] [] c.o.d.a.t.TaskZJsonRpc: Task[TaskZJsonRpcExt_124] <strong>RPC request 'Local:node_0@deleteListenerEntry()' completed: Failure<\/strong><\/code><\/p>\n<p>The key error to note would be : <strong><em>Local:node_0@deleteListenerEntry()&#8217; completed: Failure<\/em><\/strong><\/p>\n<h3>Explaination<\/h3>\n<p>This problem comes from the fact that the listener.ora file has been customized. As per Oracle Support, on an ODA, the listener.ora should never be customized and default listener.ora file should be used. I still have a SR opened with Oracle Support to clarify the situation as I&#8217;m fully convinced that this is a regression :<\/p>\n<ol>\n<li>It was always possible in previous ODA versions to delete a database with a customized listener file<\/li>\n<li>We need to customize the listener when setting Data Guard on Oracle 11.2.0.4 Version (still supported on ODA)<\/li>\n<li>We need to customize the listener when doing duplication as dynamic registration is not possible when the database is in nomount state and database is restarted during the duplication.<\/li>\n<\/ol>\n<p>Moreover other ODA documentations are still referring customization of the listener.ora file when using ODA :<br \/>\n<a href=\"https:\/\/www.oracle.com\/technetwork\/database\/database-appliance\/overview\/asm-acfs-migration-2379319.pdf\">White paper : STEPS TO MIGRATE NON-CDB DATABASES TO ACFS ON ORACLE DATABASEAPPLIANCE 12.1.2<\/a><br \/>\n<a href=\"https:\/\/support.oracle.com\/epmos\/faces\/DocumentDisplay?_afrLoop=445023872120068&amp;parent=EXTERNAL_SEARCH&amp;sourceId=HOWTO&amp;id=2392307.1&amp;_afrWindowMode=0&amp;_adf.ctrl-state=7qd28nrs3_4\">Deploying Oracle Data Guard with Oracle Database Appliance &#8211; A WhitePaper (2016-7) (Doc ID 2392307.1)<\/a><\/p>\n<p>I will update the post as soon as I have some feedback from Oracle support on this.<\/p>\n<p>The workaround would be to set back the default listener.ora file time of the deletion, which would request a maintenance windows for some customer.<\/p>\n<h3>Solution\/Workaround<\/h3>\n<h4>Backup of the current listener configuration<\/h4>\n<p>OK, so let&#8217;s backup our current listener configuration first :<\/p>\n<p><code>grid@ODA01:\/home\/grid\/ [+ASM1] <strong>cd $TNS_ADMIN<\/strong><br \/>\n&nbsp;<br \/>\ngrid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>cp -p listener.ora .\/history\/listener.ora.20200506<\/strong><\/code><\/p>\n<h4>Default ODA listener configuration<\/h4>\n<p>The backup of the default listener configuration is the following one :<\/p>\n<p><code>grid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>cat listener19071611AM2747.bak<\/strong><br \/>\nLISTENER=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER))))            # line added by Agent<br \/>\nASMNET1LSNR_ASM=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=ASMNET1LSNR_ASM))))              # line added by Agent<br \/>\nENABLE_GLOBAL_DYNAMIC_ENDPOINT_ASMNET1LSNR_ASM=ON               # line added by Agent<br \/>\nVALID_NODE_CHECKING_REGISTRATION_ASMNET1LSNR_ASM=SUBNET         # line added by Agent<br \/>\nENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER=ON              # line added by Agent<br \/>\nVALID_NODE_CHECKING_REGISTRATION_LISTENER=SUBNET                # line added by Agent<\/code><\/p>\n<h4>Stopping the listener<\/h4>\n<p>Let&#8217;s stop the listener :<\/p>\n<p><code>grid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>srvctl stop listener -listener listener<\/strong><br \/>\n&nbsp;<br \/>\ngrid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>srvctl status listener -listener listener<\/strong><br \/>\nListener LISTENER is enabled<br \/>\nListener LISTENER is not running<\/code><\/p>\n<h4>Put default listener configuration<\/h4>\n<p><code>grid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>mv listener.ora listener.ora.before_db_del_20200506<\/strong><br \/>\n&nbsp;<br \/>\ngrid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>cp -p listener19071611AM2747.bak listener.ora<\/strong><\/code><\/p>\n<h4>Start the listener<\/h4>\n<p><code>grid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>srvctl start listener -listener listener<\/strong><br \/>\n&nbsp;<br \/>\ngrid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>srvctl status listener -listener listener<\/strong><br \/>\nListener LISTENER is enabled<br \/>\nListener LISTENER is running on node(s): oda01<\/code><\/p>\n<h4>Delete database<\/h4>\n<p>We will try to delete the database again by running the same odacli command :<br \/>\n<code><br \/>\n[root@ODA01 bin]# <strong>odacli delete-database -in TEST -fd<\/strong><br \/>\n{<br \/>\n\"jobId\" : \"5655be19-e0fe-4452-b8a9-35382c67bf96\",<br \/>\n\"status\" : \"Running\",<br \/>\n\"message\" : null,<br \/>\n\"reports\" : [ {<br \/>\n\"taskId\" : \"TaskZJsonRpcExt_1167\",<br \/>\n\"taskName\" : \"Validate db d6542252-dfa4-47f9-9cfc-22b4f0575c51 for deletion\",<br \/>\n\"taskResult\" : \"\",<br \/>\n\"startTime\" : \"May 06, 2020 11:45:01 AM CEST\",<br \/>\n\"endTime\" : \"May 06, 2020 11:45:01 AM CEST\",<br \/>\n\"status\" : \"Success\",<br \/>\n\"taskDescription\" : null,<br \/>\n\"parentTaskId\" : \"TaskSequential_1165\",<br \/>\n\"jobId\" : \"5655be19-e0fe-4452-b8a9-35382c67bf96\",<br \/>\n\"tags\" : [ ],<br \/>\n\"reportLevel\" : \"Info\",<br \/>\n\"updatedTime\" : \"May 06, 2020 11:45:01 AM CEST\"<br \/>\n} ],<br \/>\n\"createTimestamp\" : \"May 06, 2020 11:45:01 AM CEST\",<br \/>\n\"resourceList\" : [ ],<br \/>\n\"description\" : \"Database service deletion with db name: TEST with id : d6542252-dfa4-47f9-9cfc-22b4f0575c51\",<br \/>\n\"updatedTime\" : \"May 06, 2020 11:45:01 AM CEST\"<br \/>\n}<\/code><\/p>\n<p>Unfortunately the deletion will fail with another error : <strong><em>DCS-10011:Input parameter &#8216;ACFS Device for delete&#8217; cannot be NULL<\/em><\/strong>.<\/p>\n<p>This is due to the fact that previous deletion has already removed the corresponding ACFS volume for the database (DATA and REDO). We will have to create them manually again. I have already described this solution in a previous post : <a href=\"https:\/\/www.dbi-services.com\/blog\/oda-database-been-stuck-in-deleting-status\/\">Database deletion stuck in deleting-status<\/a>.<\/p>\n<p>After restoring the corresponding ACFS Volume, we can retry our database deletion again :<\/p>\n<p><code>[root@ODA01 bin]# <strong>odacli delete-database -in TEST -fd<\/strong><br \/>\n{<br \/>\n\"jobId\" : \"5e227755-478b-46c5-a5cd-36687cb21ed8\",<br \/>\n\"status\" : \"Running\",<br \/>\n\"message\" : null,<br \/>\n\"reports\" : [ {<br \/>\n\"taskId\" : \"TaskZJsonRpcExt_1443\",<br \/>\n\"taskName\" : \"Validate db d6542252-dfa4-47f9-9cfc-22b4f0575c51 for deletion\",<br \/>\n\"taskResult\" : \"\",<br \/>\n\"startTime\" : \"May 06, 2020 11:47:53 AM CEST\",<br \/>\n\"endTime\" : \"May 06, 2020 11:47:53 AM CEST\",<br \/>\n\"status\" : \"Success\",<br \/>\n\"taskDescription\" : null,<br \/>\n\"parentTaskId\" : \"TaskSequential_1441\",<br \/>\n\"jobId\" : \"5e227755-478b-46c5-a5cd-36687cb21ed8\",<br \/>\n\"tags\" : [ ],<br \/>\n\"reportLevel\" : \"Info\",<br \/>\n\"updatedTime\" : \"May 06, 2020 11:47:53 AM CEST\"<br \/>\n} ],<br \/>\n\"createTimestamp\" : \"May 06, 2020 11:47:53 AM CEST\",<br \/>\n\"resourceList\" : [ ],<br \/>\n\"description\" : \"Database service deletion with db name: TEST with id : d6542252-dfa4-47f9-9cfc-22b4f0575c51\",<br \/>\n\"updatedTime\" : \"May 06, 2020 11:47:53 AM CEST\"<br \/>\n}<\/code><\/p>\n<p>Which this time will be successful :<\/p>\n<p><code>[root@ODA01 bin]# <strong>odacli describe-job -i \"5e227755-478b-46c5-a5cd-36687cb21ed8\"<\/strong><br \/>\n&nbsp;<br \/>\nJob details<br \/>\n----------------------------------------------------------------<br \/>\nID:  5e227755-478b-46c5-a5cd-36687cb21ed8<br \/>\nDescription:  Database service deletion with db name: TEST with id : d6542252-dfa4-47f9-9cfc-22b4f0575c51<br \/>\nStatus:  <strong>Success<\/strong><br \/>\nCreated:  May 6, 2020 11:47:53 AM CEST<br \/>\nMessage:<br \/>\n&nbsp;<br \/>\nTask Name                                Start Time                          End Time                            Status<br \/>\n---------------------------------------- ----------------------------------- ----------------------------------- ----------<br \/>\nValidate db d6542252-dfa4-47f9-9cfc-22b4f0575c51 for deletion May 6, 2020 11:47:53 AM CEST        May 6, 2020 11:47:53 AM CEST        Success<br \/>\nDatabase Deletion                        May 6, 2020 11:47:53 AM CEST        May 6, 2020 11:47:54 AM CEST        Success<br \/>\nUnregister Db From Cluster               May 6, 2020 11:47:54 AM CEST        May 6, 2020 11:47:54 AM CEST        Success<br \/>\nKill Pmon Process                        May 6, 2020 11:47:54 AM CEST        May 6, 2020 11:47:54 AM CEST        Success<br \/>\nDatabase Files Deletion                  May 6, 2020 11:47:54 AM CEST        May 6, 2020 11:47:54 AM CEST        Success<br \/>\nDeleting Volume                          May 6, 2020 11:48:01 AM CEST        May 6, 2020 11:48:05 AM CEST        Success<br \/>\nDelete File Groups of Database TEST      May 6, 2020 11:48:05 AM CEST        May 6, 2020 11:48:05 AM CEST        Success<\/code><\/p>\n<h4>Restore our customized listener configuration<\/h4>\n<p>We can now restore our customized configuration as follows :<\/p>\n<p><code>grid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>srvctl stop listener -listener listener<\/strong><br \/>\n&nbsp;<br \/>\ngrid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>srvctl status listener -listener listener<\/strong><br \/>\nListener LISTENER is enabled<br \/>\nListener LISTENER is not running<br \/>\n&nbsp;<br \/>\ngrid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>mv listener.ora.before_db_del_20200506 listener.ora<\/strong><br \/>\n&nbsp;<br \/>\ngrid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>srvctl start listener -listener listener<\/strong><br \/>\n&nbsp;<br \/>\ngrid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>srvctl status listener -listener listener<\/strong><br \/>\nListener LISTENER is enabled<br \/>\nListener LISTENER is running on node(s): oda01<\/code><\/p>\n<p>We could also confirm that the listener started successfully by displaying the tnslsnr running processes :<br \/>\n<code><br \/>\ngrid@ODA01:\/u01\/app\/18.0.0.0\/grid\/network\/admin\/ [+ASM1] <strong>ps -ef | grep tnslsnr | grep -v grep<\/strong><br \/>\ngrid     14922     1  0 10:52 ?        00:00:00 \/u01\/app\/18.0.0.0\/grid\/bin\/tnslsnr ASMNET1LSNR_ASM -no_crs_notify -inherit<br \/>\ngrid     97812     1  0 12:07 ?        00:00:00 \/u01\/app\/18.0.0.0\/grid\/bin\/tnslsnr LISTENER -no_crs_notify -inherit<\/code><\/p>\n<h3>Updates from 13th of October 2020<\/h3>\n<p>I recently had to delete databases again, and could test that restoring the default listener.ora configuration file is enough. There is no need to stop and start the listener to have the odacli delete-database command successes.<\/p>\n<p>But I could see that the odacli command would anyhow restart a new listener process. I had 2 listener processes running :<br \/>\n<code>grid@ODA01:\/u01\/app\/19.0.0.0\/grid\/network\/admin\/ [+ASM1] ps -ef | grep tnslsnr | grep -v grep<br \/>\ngrid     13776     1  0 Sep03 ?        00:21:34 \/u01\/app\/19.0.0.0\/grid\/bin\/tnslsnr LISTENER -no_crs_notify -inherit<br \/>\ngrid     13780     1  0 Sep03 ?        00:14:12 \/u01\/app\/19.0.0.0\/grid\/bin\/tnslsnr ASMNET1LSNR_ASM -no_crs_notify -inherit<br \/>\ngrid     65971     1  0 14:23 ?        00:00:00 \/u01\/app\/19.0.0.0\/grid\/bin\/tnslsnr LISTENER -no_crs_notify -inherit<\/code><\/p>\n<p>Thus restarting the listener correctly and killing the unuseful one would be anyhow recommended.<\/p>\n<h3>Conclusion<\/h3>\n<p>Starting ODA Release 18.5, database deletion will fail if the listener has been customized. Workaround is to to restore the listener default configuration for executing the deletion. This might imply for some customers to have a maintenance windows.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I have recently faced an issue deleting database on an ODA. I was getting following error whatever database I wanted to delete : DCS-10001:Internal error encountered: null. Through this blog, I would like to share with you my experience on this case hoping it will help you if you are facing same problem. On this [&hellip;]<\/p>\n","protected":false},"author":48,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[229,59],"tags":[43,79,1327,1956,96],"type_dbi":[],"class_list":["post-14194","post","type-post","status-publish","format-standard","hentry","category-database-administration-monitoring","category-oracle","tag-listener","tag-oda","tag-odacli","tag-odacli-delete-database","tag-oracle"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.2 (Yoast SEO v27.2) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Issue deleting a database on ODA? - dbi Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Issue deleting a database on ODA?\" \/>\n<meta property=\"og:description\" content=\"I have recently faced an issue deleting database on an ODA. I was getting following error whatever database I wanted to delete : DCS-10001:Internal error encountered: null. Through this blog, I would like to share with you my experience on this case hoping it will help you if you are facing same problem. On this [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2020-05-25T18:33:07+00:00\" \/>\n<meta name=\"author\" content=\"Marc Wagner\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Marc Wagner\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"11 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/\"},\"author\":{\"name\":\"Marc Wagner\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/225d9884b8467ead9a872823acb14628\"},\"headline\":\"Issue deleting a database on ODA?\",\"datePublished\":\"2020-05-25T18:33:07+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/\"},\"wordCount\":632,\"commentCount\":0,\"keywords\":[\"Listener\",\"ODA\",\"odacli\",\"odacli delete-database\",\"Oracle\"],\"articleSection\":[\"Database Administration &amp; Monitoring\",\"Oracle\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/\",\"name\":\"Issue deleting a database on ODA? - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\"},\"datePublished\":\"2020-05-25T18:33:07+00:00\",\"author\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/225d9884b8467ead9a872823acb14628\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/www.dbi-services.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Issue deleting a database on ODA?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#website\",\"url\":\"https:\/\/www.dbi-services.com\/blog\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/225d9884b8467ead9a872823acb14628\",\"name\":\"Marc Wagner\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/a873cc6e7fbdbbcbdbcaf5dbded14ad9a77b2ec2c3e03b4d724ed33d35d5f328?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/a873cc6e7fbdbbcbdbcaf5dbded14ad9a77b2ec2c3e03b4d724ed33d35d5f328?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/a873cc6e7fbdbbcbdbcaf5dbded14ad9a77b2ec2c3e03b4d724ed33d35d5f328?s=96&d=mm&r=g\",\"caption\":\"Marc Wagner\"},\"url\":\"https:\/\/www.dbi-services.com\/blog\/author\/marc-wagner\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Issue deleting a database on ODA? - dbi Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/","og_locale":"en_US","og_type":"article","og_title":"Issue deleting a database on ODA?","og_description":"I have recently faced an issue deleting database on an ODA. I was getting following error whatever database I wanted to delete : DCS-10001:Internal error encountered: null. Through this blog, I would like to share with you my experience on this case hoping it will help you if you are facing same problem. On this [&hellip;]","og_url":"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/","og_site_name":"dbi Blog","article_published_time":"2020-05-25T18:33:07+00:00","author":"Marc Wagner","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Marc Wagner","Est. reading time":"11 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/"},"author":{"name":"Marc Wagner","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/225d9884b8467ead9a872823acb14628"},"headline":"Issue deleting a database on ODA?","datePublished":"2020-05-25T18:33:07+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/"},"wordCount":632,"commentCount":0,"keywords":["Listener","ODA","odacli","odacli delete-database","Oracle"],"articleSection":["Database Administration &amp; Monitoring","Oracle"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/","url":"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/","name":"Issue deleting a database on ODA? - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"datePublished":"2020-05-25T18:33:07+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/225d9884b8467ead9a872823acb14628"},"breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/issue-deleting-a-database-on-oda\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Issue deleting a database on ODA?"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/225d9884b8467ead9a872823acb14628","name":"Marc Wagner","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/a873cc6e7fbdbbcbdbcaf5dbded14ad9a77b2ec2c3e03b4d724ed33d35d5f328?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/a873cc6e7fbdbbcbdbcaf5dbded14ad9a77b2ec2c3e03b4d724ed33d35d5f328?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/a873cc6e7fbdbbcbdbcaf5dbded14ad9a77b2ec2c3e03b4d724ed33d35d5f328?s=96&d=mm&r=g","caption":"Marc Wagner"},"url":"https:\/\/www.dbi-services.com\/blog\/author\/marc-wagner\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/14194","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/48"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=14194"}],"version-history":[{"count":0,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/14194\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=14194"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=14194"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=14194"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=14194"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}