ERROR: RC-50014: Fatal: Execution of AutoConfig was failed Raised by oracle.apps.ad.clone.ApplyApplTop

 While performing clone in one of my Oracle EBS R12.2 patch environment, I faced an issue in the autoconfig process though the clone(Rapid clone) process completed successfully.

Below is the excerpt of the rapid clone and autoconfig log files.

RC Log:

Log file located at /op01/oracle/<Instance_Name>/fs1/inst/apps/<Instance_Name>_<hostname>/admin/log/clone/ApplyAppsTier_09261049.log

  /     50% completed       <Sep 26, 2023 11:26:47 AM PDT> <Warning> <JNDI> <BEA-050001> <WLContext.close() was called in a different thread than the one in which it was created.>

  |    100% completed


Completed Apply...

Tue Sep 26 11:29:26 2023


Running:

/op01/oracle/<Instance_Name>/fs1/EBSapps/10.1.2/bin/sqlplus -s /nolog > /op01/oracle/<Instance_Name>/fs1/EBSapps/comn/clone/bin/truncate_ad_nodes_config_status.log 2>&1


Running:

/op01/oracle/<Instance_Name>/fs1/EBSapps/10.1.2/bin/sqlplus -s /nolog > /op01/oracle/<Instance_Name>/fs1/EBSapps/comn/clone/bin/update_patchbase.log 2>&1


Running:

/op01/oracle/<Instance_Name>/fs1/EBSapps/10.1.2/bin/sqlplus -s /nolog > /op01/oracle/<Instance_Name>/fs1/EBSapps/comn/clone/bin/delete_adopvalidnodes.log 2>&1


Skipping the starting of services

INFO :  Rapid Clone completed successfully , but the AutoConfig run recorded  some errors.

Please review the AutoConfig section in the logfile.  and Re-Run the entire cloning cycle , after fixing the problem. 


Autoconfig log:

WARNING: [AutoConfig Error Report]


The following report lists errors AutoConfig encountered during each phase of its execution.  Errors are grouped by directory and phase.


The report format is:

      <filename>  <phase>  <return code where appropriate>


  [INSTANTIATE PHASE]

  AutoConfig could not successfully instantiate the following files:

    Directory: /op01/oracle/<Instance_Name>/fs1/inst/apps/<Instance_Name>_<hostname>/portal

      inst_log.html           INSTE8


  [APPLY PHASE]

  AutoConfig could not successfully execute the following scripts:

    Directory: /op01/oracle/<Instance_Name>/fs1/FMW_Home/webtier/perl/bin/perl -I /op01/oracle/<Instance_Name>/fs1/FMW_Home/webtier/perl/lib/5.10.0 -I /op01/oracle/<Instance_Name>/fs1/FMW_Home/webtier/perl/lib/site_perl/5.10.0 -I /op01/oracle/<Instance_Name>/fs1/EBSapps/appl/au/12.0.0/perl -I /op01/oracle/<Instance_Name>/fs1/FMW_Home/webtier/ohs/mod_perl/lib/site_perl/5.10.0/x86_64-linux-thread-multi /op01/oracle/<Instance_Name>/fs1/inst/apps/<Instance_Name>_<hostname>/admin/install


      txkGenADOPWrapper.pl    INSTE8_APPLY       1


AutoConfig is exiting with status 2

ERROR: RC-50014: Fatal: Execution of AutoConfig was failed

Raised by oracle.apps.ad.clone.ApplyApplTop


END: Executed runAutoConfig...


Exact Issue

Script Name    : txkGenADOPWrapper.pl

Script Version : 120.0.12020000.7

ERROR DESCRIPTION:


(*******FATAL ERROR*******

PROGRAM : (/op01/oracle/<Instance_Name>/fs1/inst/apps/<Instance_Name>_<hostname>/admin/install/txkGenADOPWrapper.pl)

TIME    : Tue Sep 26 11:12:32 2023

FUNCTION: TXK::SQLPLUS::_doExecute [ Level 3 ]

MESSAGES:

SQLPLUS error: buffer=


SQL*Plus: Release 10.1.0.5.0 - Production on Tue Sep 26 11:12:31 2023

Copyright (c) 1982, 2005, Oracle.  All rights reserved.

SQL> SQL> Connected.

SQL> SELECT ad_zd_adop.get_node_type('<hostname>') FROM DUAL

       *

ERROR at line 1:

ORA-01422: exact fetch returns more than requested number of rows

ORA-06512: at "APPS.AD_ZD_ADOP", line 3075


Disconnected from Oracle Database 19c EE Extreme Perf Release 19.0.0.0.0 - Production


STACK TRACE

 at /op01/oracle/<Instance_Name>/fs1/EBSapps/appl/au/12.0.0/perl/TXK/Error.pm line 168

        TXK::Error::abort('TXK::Error', 'HASH(0x229b1d8)') called at /op01/oracle/<Instance_Name>/fs1/EBSapps/appl/au/12.0.0/perl/TXK/Common.pm line 299

        TXK::Common::doError('TXK::SQLPLUS=HASH(0x3394ab0)', 'SQLPLUS error: buffer=\x{a}\x{a}SQL*Plus: Release 10.1.0.5.0 - Produc...', undef) called at /op01/oracle/<Instance_Name>/fs1/EBSapps/appl/au/12.0.0/perl/TXK/Common.pm line 314

        TXK::Common::setError('TXK::SQLPLUS=HASH(0x3394ab0)', 'SQLPLUS error: buffer=\x{a}\x{a}SQL*Plus: Release 10.1.0.5.0 - Produc...') called at /op01/oracle/<Instance_Name>/fs1/EBSapps/appl/au/12.0.0/perl/TXK/SQLPLUS.pm line 832

        TXK::SQLPLUS::_doExecute('TXK::SQLPLUS=HASH(0x3394ab0)', 0) called at /op01/oracle/<Instance_Name>/fs1/EBSapps/appl/au/12.0.0/perl/TXK/SQLPLUS.pm line 234

        TXK::SQLPLUS::execute('TXK::SQLPLUS=HASH(0x3394ab0)', 'HASH(0x321eb40)') called at /op01/oracle/<Instance_Name>/fs1/EBSapps/appl/au/12.0.0/perl/TXK/TechstackDB.pm line 623

        TXK::TechstackDB::_getSQLValue('TXK::TechstackDB=HASH(0x29d21d8)', 'SELECT ad_zd_adop.get_node_type(\'<hostname>\') FROM DUAL') called at /op01/oracle/<Instance_Name>/fs1/EBSapps/appl/au/12.0.0/perl/TXK/TechstackDB.pm line 575

        TXK::TechstackDB::getSQLValue('TXK::TechstackDB=HASH(0x29d21d8)', 'SELECT ad_zd_adop.get_node_type(\'<hostname>\') FROM DUAL') called at /op01/oracle/<Instance_Name>/fs1/inst/apps/<Instance_Name>_<hostname>/admin/install/txkGenADOPWrapper.pl line 506

        main::getNodeType() called at /op01/oracle/<Instance_Name>/fs1/inst/apps/<Instance_Name>_<hostname>/admin/install/txkGenADOPWrapper.pl line 202

        eval {...} called at /op01/oracle/<Instance_Name>/fs1/inst/apps/<Instance_Name>_<hostname>/admin/install/txkGenADOPWrapper.pl line 143

)

ERRORCODE = 1 ERRORCODE_END

.end std out.

.end err out.


****************************************************


Fixes I tried

[oracle@<hostname> scripts]$ sqlplus apps/<password>

COL node_name FORMAT A20

COL note_type FORMAT A10    

SELECT avn.node_name,

DECODE(EXTRACTVALUE(XMLType(focf.text),'//APPL_TOP_NAME'),

admin_node.appl_top, DECODE(avn.node_name,admin_node.node_name, 1,3),

DECODE(ROW_NUMBER() OVER (PARTITION BY EXTRACTVALUE(XMLType(focf.text),'//APPL_TOP_NAME')

ORDER BY avn.node_name),

1,2,4)) node_type

FROM

fnd_oam_context_files focf,

adop_valid_nodes avn,

(SELECT node_name,

EXTRACTVALUE(XMLType(text),'//APPL_TOP_NAME') appl_top

FROM fnd_oam_context_files

WHERE name NOT IN ('TEMPLATE','METADATA','config.txt')

AND CTX_TYPE='A'

AND (status IS NULL or UPPER(status) IN ('S','F'))

AND EXTRACTVALUE(XMLType(text),'//file_edition_type') = 'run'

AND EXTRACTVALUE(XMLType(text),'//oa_service_group_status[@oa_var=''s_web_admin_status'']')='enabled'

AND EXTRACTVALUE(XMLType(text),'//oa_service_list/oa_service[@type=''admin_server'']/oa_service_status')='enabled') admin_node

WHERE focf.name not IN ('TEMPLATE','METADATA','config.txt')

AND focf.CTX_TYPE='A'

AND (focf.status is null

or upper(focf.status) IN ('S','F'))

AND EXTRACTVALUE(XMLType(focf.text),'//file_edition_type') = 'run'

AND upper(focf.node_name)=upper(avn.node_name); 

NODE_NAME             NODE_TYPE

----------------------        --------------------

<hostname>                1

<hostname>                1

<hostname>                1

<hostname>                1


SQL>


  The meaning of various return values are:

  -----------------------------------------------------

    1 - Admin Node

    2 - Non-Shared master node

    3 - Admin Shared slave node

    4 - Shared slave node


since the above query returned more than 1 row of the same host, we need to disable the "s_web_admin_status" parameter on the application context file of the recently cloned node and Rerun autoconfig and confirm the issue is solved.


I tried but this doesn't fix the issue.

Ref: Doc ID 2212698.1


Then I tried

fnd_conc_clone.setup_clean; --> as apps user on DB tier

Autoconfig on DB

Autoconfig on APPS [Run fs]


Here also no changes happened.


Fix

As per Doc ID 2268532.1 Modify these two variables to 'enabled' in the RUN file system context file on the target server.


<oa_service_status oa_var="s_adminserverstatus">disabled</oa_service_status>

<oa_service_group_status oa_var="s_web_admin_status">disabled</oa_service_group_status>

to 

<oa_service_status oa_var="s_adminserverstatus">enabled</oa_service_status>

<oa_service_group_status oa_var="s_web_admin_status">enabled</oa_service_group_status>


Run autoconfig again. ===> sh $AD_TOP/bin/adconfig.sh contextfile=<RUN_CONTEXT_FILE>


Before:

SQL> SELECT ad_zd_adop.get_node_type('<hostname>') FROM DUAL;

SELECT ad_zd_adop.get_node_type('<hostname>') FROM DUAL

       *

ERROR at line 1:

ORA-20001: Node name <hostname> not found in adop repository tables

ORA-06512: at "APPS.AD_ZD_ADOP", line 3105


After:

SQL> SELECT ad_zd_adop.get_node_type('<hostname>') FROM DUAL;

AD_ZD_ADOP.GET_NODE_TYPE('<hostname>')

------------------------------------------------------------------

                                         1


Now run the autoconfig script. The issue should be fixed now.



****************************நன்றி****************************

Comments

Popular posts from this blog

Common R12.2 adcfgclone Issues

REP-3000: Internal error starting Oracle Toolkit

Error 404 -- Not Found From RFC 2068 hypertext Transfer Protocol -- HTTP/1.1