Enterprise Manager Agent Recovery After Oracle PCA Upgrade

This procedure covers Enterprise Manager agent recovery for Oracle PCA upgrades from version 2.3.1. If your Oracle PCA is not 2.3.1 then refer to My Oracle Support note 2242177.1, which includes steps for Oracle Enterprise Manager. Note that Oracle Private Cloud Appliance X3-2 cannot be upgraded with PCA software version 2.4.1.

Note:

For Private Cloud Appliance v2.3.3 and lower, the Enterprise Manager agent must be stopped before initiating the PCA upgrade /nfs/shared_storage/oemagent/agent_13.3.0.0.0/bin/emctl stop agent.
It is recommended to upgrade the OMS and PCA management node agent to the latest version of the VT and supporting plugins.

Backup the oraInventory agent to the NFS-shared location:

# cd /u01/app
# tar -cvf EMagent_oraInventory.tar oraInventory
# cp EMagent_oraInventory.tar /nfs/shared_storage

Create the full blackout on Oracle PCA rack.
To create full blackout on Oracle PCA rack, login to the Enterprise Manager 13c UI as the Cloud Administrator and do the following:
- From the Targets menu, select Private Cloud Appliance.
- From the Private Cloud Appliance home page menu, select Control, and then select Create Blackout option.
Enter suitable information describing the reason for the blackout.
Update the Oracle PCA rack.
For more information, refer to Updating Oracle Private Cloud Appliance.

Note:

If you are running or upgrading to Oracle Private Cloud Appliance Software v2.3.4 or higher, then Steps 4 to 10 are not required.
The next step is to recover the Oracle Enterprise Manager agent installed on the NFS shared storage which is presented to both active and passive management nodes.
You should restore the oraInventory backup taken in the first step as the root user on the active management node:
```
[root@ovcamn06r1 ~]# pca-check-master
NODE: 192.168.4.4 MASTER: True"
```
```
# cp /nfs/shared_storage/EMagent_oraInventory.tar /u01/app
# tar -xvf EMagent_oraInventory.tar
```
Keep the same password you created in Installing the Management Agent on Oracle PCA for the oracle user on both management nodes:
```
# passwd oracle
```

Run the privileged agent scripts on the active management node:

# /nfs/shared_storage/oemagent/agent_13.3.0.0.0/root.sh
# /u01/app/oraInventory/orainstRoot.sh

The Oracle Enterprise Manager agent needs to be under control of the Oracle Private Cloud Appliance software and not any local OS based startup scripts. Therefore, as the root user on the active management node, you should remove any OS based rc.* links to scripts.
```
#  for x in `find /etc/rc.*/rc* | grep gcstart`; do  rm $x; done
```

Copy the following agent installation files to the passive management node as the root user (ovcamn06r1 is passive in this example):

# scp /etc/init.d/gcstartup root@ovcamn06r1:/etc/init.d/
# rsync -og /etc/oragchomelist root@ovcamn06r1:/etc/oragchomelist
# rsync -rog /u01/app/oraInventory/ oracle@ovcamn06r1:/u01/app/oraInventory

Note:

By default, the Enterprise Manager agent port 3872 is pre-populated by PCA software. If you used this default Enterprise Manager agent port 3872 for pushing the agent, then this step is not needed.

Add the Enterprise Manager agent port to the number chosen during agent push (see Installing the Management Agent on Oracle PCA) (default 3872) to the firewall settings on both management nodes (active and passive):
```
iptables -I INPUT <line_num> -m state --state NEW -m tcp -p tcp --dport <agent_port> -j ACCEPT
where line_num is the any line_num before the iptables rule to block all traffic
This line_num can be obtained using # service iptables status
# service iptables save
# service iptables reload
```

Restart the Enterprise Manager agent on the active management node as oracle from the agent's emctl command::

% /nfs/shared_storage/oemagent/agent_inst/bin/emctl stop agent
% /nfs/shared_storage/oemagent/agent_inst/bin/emctl start agent

Remove the blackout on Oracle PCA rack.

Note:

On Oracle Private Cloud Appliance X3-2, after the upgrade of Private Cloud Appliance is complete and the agent is restored, you must ensure that Prerequisites to Monitor the Fabric Interconnect in Oracle Private Cloud Appliance are met to enable the new Fabric Interconnect Target features in Oracle PCA.