Perform this procedure on each compute node to change CPU and memory resource allocation at the socket granularity level.
The tool makes these changes:
Automatically detects Root Domains.
Calculates the minimum and maximum resources for all domains, and only enables you to select valid quantities.
Modifies domain resources according to the choices you make.
Automatically assigns memory capacity in the same proportion to CPU resources.
(If needed) Stops nonprimary domains.
(If needed) Reboots the primary domain with new resources .
(If needed) Brings up nonprimary domains with new resources.
The examples in this procedure show a SuperCluster T5-8 Full-Rack compute node that has six domains. The concepts in this procedure also apply to other SuperCluster models.
In this example, one socket and 256 GB memory are removed from the primary domain and allocated to ssccn2-dom2.
This table shows the allocation plan (see Plan CPU and Memory Allocations).
|
The tool does not continue if any inactive domains are present.
Respond when prompted. Press Enter to select the default value.
# /opt/oracle.supercluster/bin/osc-setcoremem osc-setcoremem v1.0 built on Oct 29 2014 10:21:05 Current Configuration: Full-Rack T5-8 SuperCluster +-------------------------+-------+--------+-----------+--- MINIMUM ----+ | DOMAIN | CORES | MEM_GB | TYPE | CORES | MEM_GB | +-------------------------+-------+--------+-----------+-------+--------+ | primary | 32 | 512 | Dedicated | 9 | 64 | | ssccn2-dom1 | 16 | 256 | Dedicated | 4 | 32 | | ssccn2-dom2 | 16 | 256 | Dedicated | 4 | 32 | | ssccn2-dom3 | 16 | 256 | Dedicated | 4 | 32 | | ssccn2-dom4 | 16 | 256 | Dedicated | 4 | 32 | | ssccn2-dom5 | 4 | 64 | Root | 4 | 64 | +-------------------------+-------+--------+-----------+-------+--------+ | unallocated or parked | 28 | 448 | -- | -- | -- | +-------------------------+-------+--------+-----------+-------+--------+ [Note] Following domains will be skipped in this session. Root Domains ------------ ssccn2-dom5 CPU allocation preference: 1. Socket level 2. Core level In case of Socket level granularity, proportional memory capacity is automatically selected for you. Choose Socket or Core level [S or C] s Step 1 of 1: Socket count selection primary : desired socket count [min: 1, max: 2. default: 1] : 1 you chose [1] socket for primary domain ssccn2-dom1 : desired socket count [min: 1, max: 2. default: 1] : 1 you chose [1] socket for ssccn2-dom1 domain ssccn2-dom2 : desired socket count [min: 1, max: 2. default: 1] : 2 you chose [2] sockets for ssccn2-dom2 domain ssccn2-dom3 : desired socket count [min: 1, max: 1. default: 1] : 1 you chose [1] socket for ssccn2-dom3 domain ssccn2-dom4 : desired socket count [min: 1, max: 1. default: 1] : 1 you chose [1] socket for ssccn2-dom4 domain New Configuration in progress after Socket count selection: +-------------------------+----------+----------+-----------+ | DOMAIN | SOCKETS | MEM_GB | TYPE | +-------------------------+----------+----------+-----------+ | primary | 1 | 256 | Dedicated | | ssccn2-dom1 | 1 | 256 | Dedicated | | ssccn2-dom2 | 2 | 512 | Dedicated | | ssccn2-dom3 | 1 | 256 | Dedicated | | ssccn2-dom4 | 1 | 256 | Dedicated | | *ssccn2-dom5 | 0.250 | 64 | Root | +-------------------------+----------+----------+-----------+ | unallocated or parked | 1.750 | 448 | -- | +-------------------------+----------+----------+-----------+ The following domains will be stopped and restarted: ssccn2-dom2 This configuration requires rebooting the control domain. Do you want to proceed? Y/N : y IMPORTANT NOTE: +----------------------------------------------------------------------------+ |After the reboot, osc-setcoremem attempts to complete CPU, memory re-configuration| | Please check syslog and the state of all domains before using the system. | | eg., dmesg | grep osc-setcoremem ; ldm list | grep -v active ; date | +----------------------------------------------------------------------------+ All activity is being recorded in log file: /opt/oracle.supercluster/osc-setcoremem/log/osc-setcoremem_activity_10-29-2014_16:15:44.log Please wait while osc-setcoremem is setting up the new CPU, memory configuration. It may take a while. Please be patient and do not interrupt. 0% 10 20 30 40 50 60 70 80 90 100% |-----|-----|-----|-----|-----|-----|-----|-----|-----|-----| *=====*=====*=====*=====*=====*=====*=====*=====*=====*=====* Broadcast Message from root (pts/1) on etc27dbadm0201 Wed Oct 29 16:21:19... THE SYSTEM etc27dbadm0201 IS BEING SHUT DOWN NOW ! ! ! Log off now or risk your files being damaged Task complete with no errors.
Example:
# dmesg | grep osc-setcoremem Oct 29 16:27:59 etc27dbadm0201 root[2870]: [ID 702911 user.alert] osc-setcoremem: core, memory re-configuration complete. system can be used for regular work.
You can verify the resource allocation and check for possible osc-setcoremem errors in several ways: