C H A P T E R  5

Setting Up and Installing Software on Domains

This chapter contains the following instruction for installing the Solaris Operating System and additional software packages on Sun Fire high-end system domains:


Creating a Domain

This section describes the following procedures for creating a new domain:



Note - You must have a valid idprom.image file for the domain in the /var/opt/SUNWSMS/data/domain_id directory to create a domain. Contact your Sun service representative if this file is missing.




procedure icon  To Build a New Domain on the System Controller

The examples in this guide use the definitions in TABLE 5-1 for the various system prompts.


TABLE 5-1 SMS-Specific System Prompts

Prompt

Definition

sc0:#

Superuser on the main SC.

domain_id: #

Superuser on the domain.

sc_name:sms-user:>

User prompt on the SC.

sms-user is the user-name of an administrator, operator, configurator, or service person logged in to the SC.

domain_id:sms-user:>

User prompt on the domain.

sms-user is the user-name of the administrator, operator, configurator, or service person logged in to the domain.


The privileges allotted to the user are determined by the platform or domain groups to which the user belongs. In these examples, the sms-user is assumed to have both platform and domain administrator privileges, unless otherwise noted.



Note - In the following example, a platform administrator creates a domain by adding boards to the domain. The platform administrator must first run setupplatform(1M) and place the boards in the domain available component list before a domain administrator can run addboard(1M).



1. Log in as a user with platadmn privileges, and create a domain by adding boards.


sc0:sms-user:> addboard -d domain_id -c assign location [location] 

where:

For example, the following command adds CPU boards in slots 2, 4, and 7 to domain A.


sc0:sms-user:> addboard -d A -c assign SB2 SB4 SB7

The next example adds I/O boards in slots 3, 5, and 8 to domain A.


sc0:sms-user:> addboard -d A -c assign IO3 IO5 IO8

2. Use the deleteboard(1M) command if you need to remove boards from an inactive domain.


sc0:sms-user:> deleteboard -c unassign location [location]   

where location is the board location. The following location forms are accepted.


Valid Form for Sun Fire 15K/E25K

Valid Form for Sun Fire 12K/E20K

SB(0...17)

IO(0...17)

SB(0...8)

IO(0...8)


For example, the following command removes the CPU board in slot 2 from domain A.


sc0:sms-user:> deleteboard -c unassign SB2

The next example removes the I/O board in slot 3 from domain A.


sc0:sms-user:> deleteboard -c unassign IO3

3. Use the addtag(1M) command to add a tag for the domain.


sc0:sms-user:> addtag -d domain_id domain_tag

where:

For example, the following command adds the tag for domain A to the platform configuration database (PCD).


sc0:sms-user:> addtag -d A domainA

4. Use the deletetag(1M) command if you want to remove a tag.


sc0:sms-user:> deletetag -d domain_id

where domain_id is the ID of the domain from which you want to remove a tag (A through R).

For example, the following command deletes the tag for domain A from the PCD.


sc0:sms-user:> deletetag -d A


procedure icon  To Activate the Domain



Note - To install the Solaris OS and SMS on a domain, you must have a valid /var/opt/SUNWSMS/data/domain_id/idprom.image file, where domain_id is A through R. If you do not have this file already, contact your Sun service representative.



SMS contains a virtual key switch for each domain, which controls the states of the domain. The showkeyswitch(1M) command displays the position of the virtual key switch, and the setkeyswitch(1M) command changes the position of the virtual key switch. The valid positions of the virtual key switch are on, standby, off, diag, and secure. For more information, refer to the System Management Services (SMS) 1.6 Reference Manual.

1. Display the domain status.


sc0:sms-user:> showkeyswitch -d domain_id

where domain_id is the ID of the domain (A through R) for which you want to check status.

For example, the following command shows the status of domain A.


sc0:sms-user:> showkeyswitch -d A

2. Activate the domain as a user with domain administrator (dmnaadmn) privileges.


sc0:sms-user:> setkeyswitch -d domain_id  position

where:

For example, the following command activates domain A.


sc0:sms-user:> setkeyswitch -d A on

3. If you need to deactivate a domain, set the position of the virtual keyswitch to off.

For example, the following command deactivates domain A.


sc0:sms-user:> setkeyswitch -d A off


procedure icon  To Open a Console for the Domain

The conditions required for a network console are:

single-step bulletOpen an active console for the domain.


sc0:sms-user:> console -d domain_id

where domain_id is the ID of the domain (A through R) for which you want to open a console.

For example, the following command opens a console for domain A.


sc0:sms-user:> console -d A

In the domain console, vi(1) runs properly and the escape sequences (tilde commands) work as intended only if the environment variable TERM has the same setting as that of the console.

For example:


domain_id:sms-user:> setenv TERM xterm 

For more information on the domain console, refer to the System Management Services (SMS) 1.6 Administrator Guide and the console man page.


Setting Up and Installing the Solaris Operating System on the Domain

This section describes the recommended procedures for setting up and installing the Solaris OS for the domain

:



Note - If you had the Solaris OS preinstalled on your system or you have run the sys-unconfig(1M) command on the domain, see Configuring Domain Networks before proceeding.



To be most efficient, create an install server to install the Solaris OS software for a domain over the network. You should be familiar with setting up network install servers before beginning this procedure. Following are sources for more information.


procedure icon  To Set Up the Domain as an Install Client

After you have created an install server on sc0, you are ready to install the Solaris OS software for the domain over the network. The system needs to identify the name of the domain, and you add this information by using the add_install_client(1M) command.



caution icon

Caution - If you are installing the Solaris OS from more than one jumpstart server, be sure you have only one jumpstart boot server per subnet. If you have more than one jumpstart boot server per subnet, run the rm_install_client(1M) command on the extra servers and leave only the SC as the jumpstart boot server.



Refer to the reference manual for your version of the Solaris OS for more information about the add_install_client(1M) and rm_install_client(1M) commands.

1. Obtain the MAN Ethernet address at the OpenBoot PROM prompt by typing the following.


ok  banner
Sun Fire 15000, using IOSRAM based Console
Copyright 1998-2001 Sun Microsystems, Inc.  All rights reserved.
OpenBoot 4.5, 3072 MB memory installed, Serial ########.
Ethernet address 8:0:20:0:0:0, Host ID: 80200000.

The output displayed is an example only and does not reflect the specific information that appears on your system.

2. As superuser on SC0, set up the host domain as an install client.


sc0: # /install_dir_path/Solaris_9/Tools/add_install_client -e domain_man_etheraddr -s scI1_hostname:/install_dir_path   -c scI1_hostname:/install_dir_path  domain_hostname sun4u 

where:

You originally defined the domain host name (for example, SC I1) on the worksheet in the site planning guide for your Sun Fire system.


procedure icon  To Install the Solaris Operating System on the Domain

1. Display the functioning network interfaces.


ok watch-net-all



Note - If the system is using a Fast Ethernet board with Lucent PHY, an error message claiming the device failed the test might appear. Ignore the error message or set the OpenBoot PROM parameter diag-switch? to false. Changing the switch setting keeps the error message from reappearing.



If watch-net-all reports a failure on the device associated with man-net, contact your Sun representative.

2. Network boot the domain from the SC using the Management Network (MAN).


ok  boot man-net 

Install the Solaris OS for the domain.

Refer to the installation guide for your version of the Solaris OS for detailed installation instructions. Refer to the site planning guide for your Sun Fire high-end system for site-specific and system-dependent information when prompted during installation.



Note - You can choose any Solaris OS locale you want for the operating system on the domain. The SCs must have the English locale installed, but the domains do not have the same requirement.



3. Change the domain node name.

When using the SC as an install server for a domain, change the domain's node name after the installation is complete. This reduces the amount of network traffic generated between the domain and SC over the MAN. Change the node name of the domain to the node name of one of its external network interfaces (for example, qfe0).

To change the domain's node name, do the following.

a. Log in to the domain as superuser.

b. Type the following commands at the prompts, substituting the node name you chose for new_nodename.


domain_id:# uname -S new_nodename 
domain_id:# echo new_nodename > /etc/nodename  

c. Log out.

4. Remove the domain from the network install server list.

After installing the domain software, take these steps to remove the domain from the install server list.



caution icon

Caution - If you do not remove the domain from the install server list, the domain does not boot from the boot disk or from the network.



a. Log in to the SC as superuser.

b. Type the following.


sc0:#/install_dir_path/Solaris_9/Tools/rm_install_client domain_hostname 

c. In preparation for Step 4 of the next procedure, note the physical disk location.

For example, type the following.


sc0:#ls -la /dev/dsk/c0t17d0s0
lrwxrwxrwx   1 root     root          77 Oct 12 17:38 /dev/dsk/c0t17d0s0 -> 
../../devices/pci@3c,600000/pci@1/SUNW,qlc@4/fp@0,0/ssd@w21000020370dac0c,0:a 

d. Log out.


procedure icon  To Set OpenBoot PROM Environment Variables for the Domain

1. At the domain console's ok prompt, remove any duplicate entries in the devalias list.


ok nvunalias duplicate_alias

where duplicate_alias is the alias of the duplicate entry.



Note - This sequence must be repeated once per duplication. nvunalias removes only one device alias at a time; it removes the last entry in the list of device aliases.



2. Display the OpenBoot PROM device tree to use in creating the device aliases.


ok show-devs

3. Display the functioning network interfaces.


ok watch-net-all



Note - If the system is using a Fast Ethernet board with Lucent PHY, an error message claiming the device failed the test might appear. Ignore the error message or set the OpenBoot PROM parameter diag-switch? to false. Changing the switch setting keeps the error message from reappearing.



4. Set the bootdisk_alias so that it refers to the device on which you are installing the Solaris OS.


ok nvalias bootdisk_alias device_string

where:

For example:


nvalias disk /pci@3c,600000/pci@1/SUNW,qlc@4/fp@0,0/disk@w21000020370dac0c,0:a 



Note - Enter the nvalias command on a single line. In the preceding example, the ssd in the physical disk location changed to disk in the boot string.



5. Record the newly created NVRAM data.


ok nvstore 



Note - Make sure that the OpenBoot PROM parameter use-nvramrc is set to True so that the new user-defined bootdisk_alias is evaluated during startup.



6. Use the setenv command to set the default boot device to the correct alias.


ok setenv boot-device bootdisk_alias

where bootdisk_alias is the user-defined alias you established in Step 4. The boot device must correspond to the bootable disk on which you are installing the Solaris OS. Be sure you set this variable correctly, because it is used in case of a panic and autoboot.

7. Now that you have set up an alias for your boot device, boot the disk by typing the following.


ok boot


Configuring Domain Networks

If you had the Solaris OS preinstalled on a domain or if you ran the sys-unconfig(1M) command on a domain, you must manually configure the MAN information on that domain.



Note - Do not add the domain as an install client on the SC before booting the domain, as described in To Set Up the Domain as an Install Client.




procedure icon  To Configure Domain Networks

1. Log in to the domain as superuser.

2. Type the following.


domain_id:#ndd -get /dev/dman man_get_hostinfo

The following is an example of the output displayed.


manc_magic = 0x4d414e43
manc_version = 01
manc_csum = 0x0
manc_ip_type = AF_INET
manc_dom_ipaddr = 10.1.1.3
manc_dom_ip_netmask = 255.255.255.224
manc_dom_ip_netnum = 10.1.1.0
manc_sc_ipaddr = 10.1.1.1
manc_dom_eaddr = 0:0:be:a8:48:26
manc_sc_eaddr = 8:0:20:f9:e4:54
manc_iob_bitmap = 0x400 io boards = 10.1, 
manc_golden_iob = 10

3. Add or edit a network-i1 entry to /etc/netmasks, using the following format.


manc_dom_ip_netnum manc_dom_ip_netmask

For example:


10.1.1.0 255.255.255.224

4. Create an /etc/hostname.dman0 file with the following content.


manc_dom_ipaddr netmask + broadcast + private up

For example:


10.1.1.3 netmask + broadcast + private up 

5. Ensure that the manc_sc_ipaddr IP address matches the corresponding entry in /etc/syslog.conf.


domain_id:# cat /etc/syslog.conf

...
*.notice                @10.1.1.1

 

If the two entries do not match, edit the /etc/syslog.conf file. Save the file and exit.

6. Type the following.


domain_id:# ifconfig dman0 plumb
domain_id:# ifconfig dman0 manc_dom_ipaddr netmask + broadcast + private up

where manc_dom_ipaddr is the domain IP address listed in /etc/netmasks.

The domain is now configured.


Installing Additional Software Packages on Domains

The additional software packages are on separate media. Install the software packages to the domains one at a time.



Note - Do not install these additional software packages on the SCs; install them only on the domains. For information on installing software on the Sun Fire high-end system SCs, refer to the Sun Fire 15K Open System Controller (OpenSC) White Paper.



There is no particular order in which the packages must be installed. Following are additional packages that you might want to install:


procedure icon  To Install Additional Software Packages

Log in to the SC as superuser.

7. Insert the installation CD for the software you want to install into the CD-ROM drive on the SC.

8. Use the share(1M) command to share the CD across the network.

a. Verify that the nfsd server is running.


sc0:#ps -ef | grep nfsd

b. Add a CD-ROM entry to the /etc/dfs/dfstab file.


share -F nfs -o ro,anon=0 /cdrom/cdrom0 

c. Propagate the CD-ROM image to NFS.


sc0:# /etc/init.d/nfs.server start

9. Log in to the domain as superuser.

10. Create and mount the /cdrom directory for the domain.


domain_id: # mkdir /cdrom
domain_id: # mount SC-I1: /cdrom/cdrom0 /cdrom

where SC-I1: is the node name you specified for the SC I1 network.

11. Add the additional software package.


domain_id: # cd /cdrom/install_disk_name
domain_id: # pkgadd -d . software_package_name

where:

The pkgadd(1M) command might display several messages and ask several installation questions for each package, some relating to space, others asking whether it is OK to continue. Answer these questions, and when asked whether to proceed, answer yes.

12. Unmount the CD.


domain_id: # cd /
domain_id: # umount /cdrom

13. Log out of the domain and log in to the SC as superuser.

14. Eject the installation CD from the CD-ROM drive on the SC.


sc0: # cd /
sc0: # eject cdrom