Use the osc-setcoremem command to change how CPU and memory resources are allocated at the socket granularity level. Perform this procedure on each compute node.
You can use the osc-setcoremem simulator to view different allocations and select the best configuration for you. For instructions on using the osc-setcoremem simulator, see Run a Simulation. Examples are based on SuperCluster T5. However, the same concepts apply to other supported systems.
The osc-setcoremem command makes these changes:
Automatically detects Root Domains.
Calculates the minimum and maximum resources for all domains, and only enables you to select valid quantities.
Modifies domain resources according to the choices you make.
Automatically assigns memory capacity in the same proportion to CPU resources.
(If needed) Stops nonprimary domains.
(If needed) Reboots the primary domain with new resources .
(If needed) Brings up nonprimary domains with new resources.
In this example, one socket and 1 TB memory are removed from the primary domain and allocated to ssccn3-dom1.
This table shows the allocation plan (see Plan CPU and Memory Allocations).
|
The tool does not continue if any inactive domains are present.
Respond when prompted. Press Enter to select the default value.
# /opt/oracle.supercluster/bin/osc-setcoremem
osc-setcoremem (non-interactive)
v2.3 built on May 25 2017 09:36:31
Current Configuration: SuperCluster Full-Rack T5-8
+-----+-----------------------------+---- CURRENT ---+-----------+--- MIN REQD ---+
| ID | DOMAIN | CORES | MEM GB | TYPE | CORES | MEM GB |
+-----+-----------------------------+-------+--------+-----------+-------+--------+
| 1 | primary | 32 | 512 | Dedicated | 8 | 64 |
| 2 | ssccn2-dom1 | 16 | 256 | Dedicated | 4 | 32 |
| 3 | ssccn2-dom3 | 16 | 256 | Dedicated | 4 | 32 |
| 4 | ssccn2-dom4 | 16 | 256 | Dedicated | 4 | 32 |
+-----+-----------------------------+-------+--------+-----------+-------+--------+
root@etc30zadm0201:/var/tmp/v24# ./osc-setcoremem
osc-setcoremem
v2.3 built on May 25 2017 09:36:31
Current Configuration: SuperCluster Full-Rack T5-8
+----------------------------------+-------+--------+-----------+--- MINIMUM ----+
| DOMAIN | CORES | MEM GB | TYPE | CORES | MEM GB |
+----------------------------------+-------+--------+-----------+-------+--------+
| primary | 32 | 512 | Dedicated | 8 | 64 |
| ssccn2-dom1 | 16 | 256 | Dedicated | 4 | 32 |
| ssccn2-dom2 | 1 | 16 | Root | 1 | 16 |
| ssccn2-dom3 | 16 | 256 | Dedicated | 4 | 32 |
| ssccn2-dom4 | 16 | 256 | Dedicated | 4 | 32 |
| ssccn2-dom5 | 4 | 64 | Root | 4 | 64 |
| *ssccn2-io-opcssc42 | 2 | 32 | IO | 1 | 16 |
| *ssccn2-io-opcssc46 | 2 | 32 | IO | 1 | 16 |
| *ssccn2-io-opcssc46-app | 2 | 32 | IO | 1 | 16 |
| *ssccn2-io-opcssc48 | 2 | 32 | IO | 1 | 16 |
| *ssccn2-io-opcssc48-app | 2 | 32 | IO | 1 | 16 |
| *ssccn2-io-opcssc50 | 2 | 32 | IO | 1 | 16 |
| *ssccn2-io-opcssc50-app | 2 | 32 | IO | 1 | 16 |
+----------------------------------+-------+--------+-----------+-------+--------+
| Parked Resources (Approx) | 29 | 240 | -- | -- | -- |
| Memory in Use by _sys_ Pool | -- | 1.25 | -- | -- | -- |
+----------------------------------+-------+--------+-----------+-------+--------+
[ INFO ] following domains will be ignored in this session.
Root Domains IO Domains
------------ ----------
ssccn2-dom2 ssccn2-io-opcssc42
ssccn2-dom5 ssccn2-io-opcssc46
ssccn2-io-opcssc46-app
ssccn2-io-opcssc48
ssccn2-io-opcssc48-app
ssccn2-io-opcssc50
ssccn2-io-opcssc50-app
CPU Granularity Preference:
1. Socket
2. Core
In case of Socket granularity, proportional memory capacity is automatically selected for you.
Choose Socket or Core [S or C] s
Step 1 of 1: Socket Count
primary : specify socket count [min: 1, max: 2. default: 1] :
you chose [1] socket for primary domain
ssccn2-dom1 : specify socket count [min: 1, max: 2. default: 1] : 1
you chose [1] socket for ssccn2-dom1 domain
ssccn2-dom3 : specify socket count [min: 1, max: 2. default: 1] : 1
you chose [1] socket for ssccn2-dom3 domain
ssccn2-dom4 : specify socket count [min: 1, max: 2. default: 1]:
you chose [1] socket for ssccn2-dom4 domain
Configuration In Progress After Socket Count Selection:
+----------------------------------+----------+----------+-----------+
| DOMAIN | SOCKETS | MEM GB | TYPE |
+----------------------------------+----------+----------+-----------+
| primary | 1 | 228.00 | Dedicated |
| ssccn2-dom1 | 1 | 228.00 | Dedicated |
| ssccn2-dom3 | 1 | 228.00 | Dedicated |
| ssccn2-dom4 | 1 | 228.00 | Dedicated |
| *ssccn2-dom2 | 0.062 | 16 | Root |
| *ssccn2-dom5 | 0.250 | 64 | Root |
| *ssccn2-io-opcssc42 | 0.125 | 32 | IO |
| *ssccn2-io-opcssc46 | 0.125 | 32 | IO |
| *ssccn2-io-opcssc46-app | 0.125 | 32 | IO |
| *ssccn2-io-opcssc48 | 0.125 | 32 | IO |
| *ssccn2-io-opcssc48-app | 0.125 | 32 | IO |
| *ssccn2-io-opcssc50 | 0.125 | 32 | IO |
| *ssccn2-io-opcssc50-app | 0.125 | 32 | IO |
+----------------------------------+----------+----------+-----------+
| Parked Resources (Approx) | 2.812 | 608 | -- |
| Memory in Use by _sys_ Pool | -- | 1.25 | -- |
+----------------------------------+----------+----------+-----------+
[ INFO ] Equivalent non-interactive input string for the record:
/opt/oracle.supercluster/bin/osc-setcoremem -type socket -res 1:1:1:1
Following domains will be restarted:
ssccn2-dom1
ssccn2-dom3
ssccn2-dom4
This configuration change requires rebooting the Control Domain.
Do you want to proceed? Y/N : Y
+- IMPORTANT NOTE: -+
| After the reboot, osc-setcoremem attempts to complete CPU, memory re-configuration. |
| Please check syslog and the state of all domains before using the system. |
| eg., dmesg | grep osc-setcoremem ; ldm list | grep -v active ; date |
+- -+
All activity is being recorded in log file:
/opt/oracle.supercluster/osc-setcoremem/log/osc-setcoremem_activity_05-25-2015_09:56:31.log
7
Please wait while osc-setcoremem is setting up the new CPU, memory configuration.
It may take a while. Be patient and do not interrupt.
0% 10 20 30 40 50 60 70 80 90 100%
|-----|-----|-----|-----|-----|-----|-----|-----|-----|-----|
[Info] Domain ssccn3-dom1 is taking too long to stop. Waiting ..
*=====*=====*=====*=====*=====*=====*=====*=====*=====*=====*
Task complete with no errors.
For example:
# dmesg | grep osc-setcoremem Aug 28 15:43:46 etc5mdbadm0301 root[2074]: [ID 702911 user.alert] osc-setcoremem: core, memory re-configuration complete. system can be used for regular work.
You can verify the resource allocation and check for possible osc-setcoremem errors in several ways: