Posts

Troubleshooting adop Cutover Hung or Port Conflicts in Oracle EBS R12.2

 When applying CPU (Critical Patch Update) patches or standard patch sets in Oracle E-Business Suite (EBS) R12.2, the Online Patching Utility (adop) relies on a strict sequence of execution phases: prepare, apply, finalize, cutover, and cleanup. Among these, the cutover phase is the most critical operational event. It performs the actual switchover between the RUN and PATCH file systems (fs1 and fs2), bringing down the application services, swapping the dual file system mount points/environment variables, and bringing the new application services back online. A common real-world issue DBAs face during cutover is an unexpected hang where adop appears stuck while shutting down internal managers or service controllers. In this post, we will walk through a live diagnostic scenario during a July 2026 CPU Patching cycle, analyze why orphaned Mobile Supply Chain Applications / Mobile Web Applications (MSCA/MWA) processes block adop, dive deep into Linux process hierarchies (PPID=1), ...

OEM 13c: Agent is out-of-sync with repository. This most likely means that the agent was reinstalled or recovered

Image
Understanding OEM 13c Agent Out-of-Sync Errors In Oracle Enterprise Manager (OEM) 13c, the Management Agent acts as the vital communication bridge between target host systems and the Management Repository (OMR). When an agent status throws the error "Agent is out-of-sync with repository. This most likely means that the agent was reinstalled or recovered," it signifies a mismatch in sequence numbers or timestamp tokens between the agent state and the Management Server (OMS). This situation usually occurs during: Host-level server recovery or disaster recovery tests. Unscheduled agent re-installations without clearing old target metadata. Long periods of network disconnection between the host and OMS. Abrupt server shutdowns causing local state corruptions in the agent's filesystem. Prerequisites & Initial Checks Before starting the resynchronization process, log in to the affected target node via SSH as the Oracle installation owner and run an initial status check: $ ...

ERROR: RC-50014: Fatal: Execution of AutoConfig was failed Raised by oracle.apps.ad.clone.ApplyApplTop

Overview of AutoConfig RC-50014 Error During Oracle E-Business Suite (EBS) cloning, environment patching, or system configuration updates, running adconfig.sh (AutoConfig) is mandatory to synchronize context files with system templates. A common failure during the ApplyApplTop execution phase triggers the error: ERROR: RC-50014: Fatal: Execution of AutoConfig failed This error indicates that the underlying deployment script was unable to execute terminal commands or write XML driver properties to the application file system, bringing the clone or patching process to a complete halt. Root Causes The RC-50014 exception usually points to one of three underlying system issues: Permission Mismatches: The Linux account running AutoConfig lacks read/write/execute permissions on APPL_TOP or sub-directories (e.g., inst/apps/$CONTEXT_NAME/admin/log ). Environment Variable Corruption: Missing or incorrectly set PATH , LD_LIBRARY_PATH , or ORACLE_HOME variables in the APPS tier environment f...

IAS Cache initialization failed

Image
  Resolving "IAS Cache Initialization Failed" and Distributed Caching System Port Errors in Oracle EBS R12.2    In Oracle E-Business Suite (EBS) R12.2, encountering application tier login failures or runtime Java errors can disrupt user access across the enterprise. One common error DBAs encounter after entering credentials on the login page is an IAS Cache Initialization Failed  exception tied to the Distributed Caching System (DCS).   While the fix in some instances is as straightforward as a targeted managed server bounce, the underlying root cause can range from transient socket exhaustion to network firewall locks or port conflicts. In this post, we will break down the architecture of the IAS Cache in Oracle EBS R12.2, analyze the error logs, explore the potential root causes, and walk through step-by-step solutions based on Oracle Metalink/My Oracle Support (MOS) guidelines. 1. The Issue: Application Login Failure After submitting credentials on the O...

REP-3000: Internal error starting Oracle Toolkit

Image
Resolving "REP-3000: Internal error starting Oracle Toolkit" in Oracle EBS (11i / R12) When running concurrent programs in Oracle E-Business Suite (EBS) that produce PDF , PostScript , or HTML  output, DBAs frequently encounter the infamous runtime exception: ' REP-3000: Internal error starting Oracle Toolkit' .   This issue is notorious for disrupting the Output Post-Processor (OPP)  and concurrent manager operations across both Linux and UNIX platforms. In this post, we will examine the architectural reason behind the REP-3000 error, walk through testing the OS-level X11 display environment, update the EBS Context File, and ensure persistent display settings across AutoConfig executions.  1. Understanding the Cause: Why Does Oracle Reports Need a DISPLAY Variable? The core engine responsible for generating character-based, PDF, or PostScript reports in legacy Oracle Developer / Oracle Reports (such as ' rwrun'  or ' rwserver' ) relies on Oracle Toolk...

Decrypting Weblogic Password

Image
How to Decrypt WebLogic Admin Passwords Using WLST in Oracle EBS and WebLogic Server Forgetting the Oracle WebLogic Server Admin password or inheriting a system with undocumented credentials is a common challenge for System Administrators and Oracle Middleware DBAs.   When WebLogic services start up, credentials stored in the ' boot.properties'  file are automatically encrypted using AES/Triple-DES keys tied specifically to that WebLogic domain. If you ever need to recover the original plain-text password without triggering a full password reset, you can decrypt the hash directly using the WebLogic Scripting Tool (WLST) .   In this guide, we will break down how WebLogic domain encryption works and walk through a step-by-step process to recover your WebLogic password.  1. How WebLogic Encryption Works To safely decrypt a WebLogic password, it helps to understand the underlying security architecture: boot.properties : Located within your WebLogic server domai...