Perform this procedure on a compute node to change its CPU and memory resource allocation. Perform this task on each compute node you want to adjust.
The tool makes the changes in the following order:
modify domain resources
stop non-primary domains
reboot primary domains with new resources
reboot system
bring up non-primary domains with new resources
The tool will not continue if any inactive domains are present.
Running setcoremem is a two step process. When you issue setcoremem -s 0, the system reports back the current CPU and memory allocations and allows you to change these allocations. Issuing setcoremem -s 1 makes the changes to the system.
If you implement changes using the setcoremem -s 0 command (Step 3), you must run the setcoremem -s 1 command (Step 5), otherwise the system is left in an unstable state.
$ ssh root@etc8cn06-app1 Password: Last login: Mon Jul 11 1:03:50 2012 Oracle Corporation SunOS 5.11 11.0 May 2012 root@etc8cn06-app1:~# cd /opt/oracle.supercluster/bin root@etc8cn06-app1:/opt/oracle.supercluster/bin/setcoremem/lib/bin# ./setcoremem -s 0 Info: A log of the activities is being recorded in /opt/oracle.supercluster/setcoremem/log/modlocality.log A previous configuration that has not been fully applied already exist, Do you want to reconfigure again? (y,n default: n) y Info: The current or Next Power On SP-Config is layout7_ML10212012031137 Info: Found 4 Domains including primary DOMAIN CORES Memory(GB) ====== ===== ========== primary 20 928 s11-sru2a-dump-1 4 32 s11-sru2a-dump-2 4 32 s11-sru2a-dump-3 4 32 With this configuration adjustment tool, existing domains can be re-configured with new CPU-core count and memory size. The minimum number of Cores for a domain is 4. Adjustments are allowed in multiple of 4 cores. The minimum amount of Memory for a domain is 32 GB, Adjustments are allowed in multiple of 32 GB. Info: Parking cores (for license purposes) ==================================== 'Parked' cores are cores that are not assigned to any domain and are therefore not counted for license purposes. Parked cores are unusable and essentially wasted. A better alternative in most situations is to avoid unwanted license charges by assigning cores to a different domain. This resource adjustment tool cannot be used to modify the number of domains. Do you want to reconfigure cpu and memory for all 4 domains? (y,n default: n) y DOMAIN CORES-Cur/New Mem(GB)-Cur/New ====== ============= =============== primary 20/0 928/0 s11-sru2a-dump-1 4/0 32/0 s11-sru2a-dump-2 4/0 32/0 s11-sru2a-dump-3 4/0 32/0
Enter 0 as the value for Core or Memory if you wish to abort Valid Core Options are 0, 4, 8, 12, 16, 20 For [primary ] Enter the number of Cores between 4-20: 4 Valid Memory Options are 0, 32, 64, 96, 128, 160, 192, 224, 256, 288, 320, 352, 384, 416, 448, 480, 512, 544, 576, 608, 640, 672, 704, 736, 768, 800, 832, 864, 896, 928 For [primary ] Enter Memory size in GB between 32-928: 32 DOMAIN CORES-Cur/New Mem(GB)-Cur/New ====== ============= =============== primary 20/4 928/32 s11-sru2a-dump-1 4/0 32/0 s11-sru2a-dump-2 4/0 32/0 s11-sru2a-dump-3 4/0 32/0
Enter 0 as the value for Core or Memory if you wish to abort Valid Core Options are 0, 4, 8, 12, 16, 20 For [s11-sru2a-dump-1 ] Enter the number of Cores between 4-20: 8 Valid Memory Options are 0, 32, 64, 96, 128, 160, 192, 224, 256, 288, 320, 352, 384, 416, 448, 480, 512, 544, 576, 608, 640, 672, 704, 736, 768, 800, 832, 864, 896, 928 For [s11-sru2a-dump-1 ] Enter Memory size in GB between 32-928: 288 DOMAIN CORES-Cur/New Mem(GB)-Cur/New ====== ============= =============== primary 20/4 928/32 s11-sru2a-dump-1 4/8 32/288 s11-sru2a-dump-2 4/0 32/0 s11-sru2a-dump-3 4/0 32/0 Enter 0 as the value for Core or Memory if you wish to abort Valid Core Options are 0, 4, 8, 12, 16 For [s11-sru2a-dump-2 ] Enter the number of Cores between 4-16: 8 Valid Memory Options are 0, 32, 64, 96, 128, 160, 192, 224, 256, 288, 320, 352, 384, 416, 448, 480, 512, 544, 576, 608, 640, 672 For [s11-sru2a-dump-2 ] Enter Memory size in GB between 32-672: 288 DOMAIN CORES-Cur/New Mem(GB)-Cur/New ====== ============= =============== primary 20/4 928/32 s11-sru2a-dump-1 4/8 32/288 s11-sru2a-dump-2 4/8 32/288 s11-sru2a-dump-3 4/0 32/0
Enter 0 as the value for Core or Memory if you wish to abort Valid Core Options are 0, 4, 8, 12, 16 For [s11-sru2a-dump-3 ] Enter the number of Cores between 4-16: 8 Valid Memory Options are 0, 32, 64, 96, 128, 160, 192, 224, 256, 288, 320, 352, 384, 416, 448, 480, 512, 544, 576, 608, 640, 672 For [s11-sru2a-dump-3 ] Enter Memory size in GB between 32-672: 288 DOMAIN CORES-Cur/New Mem(GB)-Cur/New ====== ============= =============== primary 20/4 928/32 s11-sru2a-dump-1 4/8 32/288 s11-sru2a-dump-2 4/8 32/288 s11-sru2a-dump-3 4/0 32/288 [4 Cores] and [128 GB] of Memory will be parked Do you wish to continue with these changes? (y,n default: n) y Please Execute ./setcoremem -s 1 and follow the instructions there Execution of above command will cause all domains in this system to be halted and will require a reboot of this domain. Please enusre that you have stopped all applications in all domains on this system, before proceeding with the above command root@etc8cn06-app1:/opt/oracle.supercluster/bin#
root@etc8cn06-app1:/opt/oracle.supercluster/bin# ./setcoremem -s 1 -v Info: A log of the activities is being recorded in /opt/oracle.supercluster/log/modlocality.log Info: Executing step 1 - Please do not interrupt until this step is complete The system has 1024 GB memory Info: The current ldoms config is layout7_ML10212012031137 Info: It will remain preserved, and a new config will be added at end of step 2 Info: The name of the new config will be layout7_ML10222012031925 LDom s11-sru2a-dump-3 stopped Warning: Resulting memory size is zero. Domain s11-sru2a-dump-3 uses physically bound core resources Warning: setting required number of cores to zero LDom s11-sru2a-dump-2 stopped Warning: Resulting memory size is zero. Domain s11-sru2a-dump-2 uses physically bound core resources Warning: setting required number of cores to zero LDom s11-sru2a-dump-1 stopped Warning: Resulting memory size is zero. Domain s11-sru2a-dump-1 uses physically bound core resources Warning: setting required number of cores to zero Initiating a delayed reconfiguration operation on the primary domain. All configuration changes for other domains are disabled until the primary domain reboots, at which time the new configuration for the primary domain will also take effect. ------------------------------------------------------------------------------ Notice: The primary domain is in the process of a delayed reconfiguration. Any changes made to the primary domain will only take effect after it reboots. ------------------------------------------------------------------------------ Info: Adding 4 Cores to Primary Domain... ------------------------------------------------------------------------------ Notice: The primary domain is in the process of a delayed reconfiguration. Any changes made to the primary domain will only take effect after it reboots. ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ Notice: The primary domain is in the process of a delayed reconfiguration. Any changes made to the primary domain will only take effect after it reboots. ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ Notice: The primary domain is in the process of a delayed reconfiguration. Any changes made to the primary domain will only take effect after it reboots. ------------------------------------------------------------------------------ Info: Done with changes Info: Done with step 1 - system reboot is required Info: After reboot, Please run setcoremem -s 2 root@etc8cn06-app1:/opt/oracle.supercluster/bin#
$ ssh root@etc8cn04-app1 Password: Last login: Mon Aug 23 10:44:50 2012 Oracle Corporation SunOS 5.11 11.0 May 2012 You have new mail. root@ssc6cn06:~# cd /opt/oracle.supercluster/bin root@etc8cn06-app1:/opt/oracle.supercluster/bin# ./setcoremem -s 2 -v Info: A log of the activities is being recorded in /opt/oracle.supercluster/log/modlocality.log Info: Executing step 2 - Please do not interrupt until this step is complete Info: Setting CORE Constraints for Domain s11-sru2a-dump-1 Info: Setting COREs to 1,2,9,10,17,18,25,26 for Domain s11-sru2a-dump-1 Info: Setting Memory for Domain s11-sru2a-dump-1 Info: Binding Domain s11-sru2a-dump-1 Info: Starting Domain s11-sru2a-dump-1 LDom s11-sru2a-dump-1 started Info: Setting CORE Constraints for Domain s11-sru2a-dump-2 Info: Setting COREs to 3,4,11,12,19,20,27,28 for Domain s11-sru2a-dump-2 Info: Setting Memory for Domain s11-sru2a-dump-2 Info: Binding Domain s11-sru2a-dump-2 Cannot validate NIC net9 on service domain s11-sru2a-dump-2 Cannot validate path /dev/rdsk/c0t5000C500436FEBB7d0s1 on service domain s11-sru2a-dump-1 Info: Starting Domain s11-sru2a-dump-2 LDom s11-sru2a-dump-2 started Info: Setting CORE Constraints for Domain s11-sru2a-dump-3 Info: Setting COREs to 5,6,13,14,21,22,29,30 for Domain s11-sru2a-dump-3 Info: Setting Memory for Domain s11-sru2a-dump-3 LDom s11-sru2a-dump-3 started Info: The new SP Config is layout7_ML10222012031925 Info: Done with changes Info: CPU and Memory configuration successfully changed root@etc8cn06-app1:/opt/oracle.supercluster/bin#