|Oracle® Exalogic Elastic Cloud Machine Owner's Guide
Release EL X2-2 and EL X3-2
Part Number E18478-15
|PDF · Mobi · ePub|
It contains the following topics:
This following figure illustrates the process of installing an Exalogic machine at the site. Note that you must commission the Exalogic machine after installing it at the site.
This section contains the following topics:
Before installing the Exalogic machine, or installing any server or equipment into the rack, read the Important Safety Information for Sun Hardware Systems (816-7190) document included with the rack.
Observe all safety notices printed on the packaging and listed in the Sun Rack II Safety and Compliance Guide (820-4762) and the Sun Rack II Power Distribution Units Users Guide (820-4760). Go to
http://download.oracle.com/docs/cd/E19657-01/index.html to download these guides.
Exalogic machine cabinets can enclose a variety of rack-mountable Sun servers, storage products, and other third-party equipment.
Before the Exalogic machine arrives, the following safety precautions should be reviewed to ensure the site is safe, as well as ready for delivery. Failing to observe these precautions can result in injury, equipment damage, or malfunction.
Do not block ventilation openings.
Do not install the Exalogic machine in a location that is exposed to direct sunlight or near a device that may become hot.
Do not install the Exalogic machine in a location that is exposed to excessive dust, corrosive gases, or air with high salt concentrations.
Do not install the Exalogic machine in a location that is exposed to frequent vibrations. Install the Exalogic machine on a flat, level surface.
Use a power outlet that uses proper grounding. When using shared grounding, the grounding resistance must not be greater than 10 ohms. Ensure that your facility administrator or a qualified electrical engineer verifies the grounding method for the building, and performs the grounding work.
Be sure that each grounding wire used for the Exalogic machine is used exclusively for the Exalogic machine. Also be sure to observe the precautions, warnings, and notes about handling that appear on labels on the equipment.
Do not place cables under the equipment or stretch the cables too tightly.
Do not disconnect power cords from the equipment while its power is on.
If you cannot reach the connector lock when disconnecting LAN cables, then press the connector lock with a flathead screwdriver to disconnect the cable. You could damage the system board if you force your fingers into the gap rather than using a flathead screwdriver.
Do not place anything on top of the Exalogic machine or perform any work directly above it.
Do not let the room temperature rise sharply, especially in winter. Sudden temperature changes can cause condensation to form inside the Exalogic machine. Allow for a sufficient warm-up period prior to server operation.
Do not install the Exalogic machine near a photocopy machine, air conditioner, welding machine, or any other equipment that generates loud, electronic noises.
Avoid static electricity at the installation location. Static electricity transferred to the Exalogic machine can cause malfunctions. Static electricity is often generated on carpets.
Confirm that the supply voltage and frequency match the electrical ratings indicated on the Exalogic machine.
Do not insert anything into any Exalogic machine opening, unless doing so is part of a documented procedure. The Exalogic machine contains high-voltage parts. If a metal object or other electrically-conductive object enters an opening in the Exalogic machine, then it could cause a short circuit. This could result in personal injury, fire, electric shock, and equipment damage.
Important Safety Information for Sun Hardware Systems (816-7190) document that is included with the rack
All safety notices printed on the packaging and listed in Sun Rack II Safety and Compliance Guide (820-4762), and Sun Rack II Power Distribution Units Users Guide (820-4760)
Refer to the unpacking instructions included with the packaging when unpacking the rack from the shipping carton. After unpacking the rack, follow local laws and guidelines to recycle the packaging properly.
Carefully unpack the rack from the packaging and shipping pallet. Rocking or tilting the rack can cause it to fall over and cause serious injury or death. You should always use professional movers when unpacking and installing this rack.
After unpacking the rack from the packaging, save the mounting brackets used to secure the rack to the shipping pallet. You can use these mounting brackets to secure the rack permanently to the installation site floor. Do not dispose of these brackets, as you will not be able to order replacement brackets.
The following tools are required for installation:
Screwdriver handle (magnetic)
T-30 Torx wrench key
T-25 Torx wrench key
6-mm hexagon Allen wrench key
SW 12-mm single-headed wrench
Side panel removal tool
Keys to the front door, rear door, and side panel locks
Cage nut mounting tool
32 M6 cage nuts
32 M6 screws
The following procedure describes how to prepare the site prior to unpacking and situating the Exalogic machine:
Thoroughly clean and vacuum the area in preparation for the installation.
Note problems or peculiarities at the site that require special equipment.
Verify that the installation site flooring has a strength rating to withstand the combined weight of the Exalogic machine and any other installed equipment.
For more information, see Section 2.1, "Environmental Requirements".
Install all necessary electrical equipment and ensure that sufficient power is provided.
The Sun Rack II Power Distribution Units User's Guide for the Sun Rack II Power Distribution Unit (PDU) power requirements
Ensure that the installation site provides adequate air conditioning.
Operate the air conditioning system for 48 hours to bring the room temperature to the appropriate level.
This section contains the following topics:
The following procedure describes how to move an Exalogic machine:
Ensure the doors are closed and secured.
Ensure the leveling and stabilizing feet on the rack are raised and out of the way.
Push the Exalogic machine from behind to the installation site.
When moving the Exalogic machine to the installation site, the front casters do not roll; you must steer the unit by moving the rear casters. You can safely maneuver the Exalogic machine by carefully pushing it.
It is preferred to use two people to move the rack: one person in front and one person in back to help guide the rack. When transporting configured racks from one location to another, take care to move them slowly, 0.65 meters per second (2.13 feet per second) or slower.
Carefully examine the transportation path. Avoid obstacles such as doorways or elevator thresholds that can cause abrupt stops or shocks. Go around obstacles by using ramps or lifts to enable smooth transport.
Never attempt to move the Exalogic machine by pushing on the side panels. Pushing on the side panels can tip the rack over. This action can cause serious personal injury or death as well as damage to the equipment.
Never tip or rock the Exalogic machine because the rack can fall over.
After moving the Exalogic machine to the installation site, stabilize the rack to ensure that it does not move or tip over. You can stabilize the rack permanently by extending the rack leveling feet, using mounting brackets, or both. After installation, use feet and the brackets to stabilize the Exalogic machine.
The rack contains four leveling feet that can be lowered to stabilize the rack. The leveling feet can be used even when the rack is permanently secured to the floor. To adjust the leveling feet, do the following:
Locate the four leveling feet located at the bottom corners of the Exalogic machine. Figure 3-4 shows the location of the leveling feet on the bottom of the Exalogic machine.
1: Distance from the edge of the mounting feet to the side of the rack is 33.75 mm (1.33 inches)
2: Width from the outside edges of the leveling feet is 532.5 mm (20.96 inches)
3: Width from the inside edges of the leveling feet is 429 mm (16.89 inches)
4: Distance from the edge of the feet to the front rack surface is 73.75 m (2.90 inches)
5: Depth of the outside edges of the leveling feet is 1058.5 mm (41.67 inches)
6: Distance from the edge of the leveling feet to the rear rack surface is 32.5 mm (1.28 inches)
7: Distance from the center of front casters to the side of the rack is 86.7 mm (3.41 inches)
8: Width between the center of the front casters is 426.6 mm (16.80 inches)
9: Distance from the center of the rear casters to the rear of the rack is 173.7 mm (6.83 inches)
10: Depth between the front and rear casters is 828.6 mm (32.62 inches)
11: Distance between the rear casters and the rear of the rack is 162.4 mm (6.39 inches)
12: Distance from the center of rear casters to the side of the rack is 96.4 mm (3.80 inches)
13: Width between the center of the rear casters is 407.2 mm (16.03 inches)
Lower the leveling feet to the floor as shown in Figure 3-5 using the SW 12 mm wrench. When lowered correctly, the four leveling feet should support the full weight of the Exalogic machine.
The rack can be permanently mounted to the installation site floor using the same mounting brackets that secured the rack to the shipping pallet. The rack is secured to the pallet with four mounting brackets. Use the front and rear brackets to stabilize the rack to the installation floor. Prepare the installation site by drilling four holes into the floor. Before permanently stabilizing the Exalogic machine with the mounting brackets, pre-drill the mounting holes. Figure 3-6 shows the location and dimensions of the mounting brackets.
Obtain four bolts and washers to mount the Exalogic machine to the floor. The bolt holes in the mounting brackets have a 10.0 mm diameter. Oracle does not provide mounting bolts because different floors require different bolt types and strengths.
Position the Exalogic machine over the pre-drilled holes. Figure 3-7 shows the bottom view of the Exalogic machine, and the location for the mounting hole and floor cut dimensions.
1: Distance from mounting bracket to the edge of the rack is 113 mm (4.45 inches)
2: Width between the centers of the mounting hole slots is 374 mm (14.72 inches)
3: Distance between mounting bracket to the edge of the rack is 113 mm (4.45 inches)
4: Distance between the centers of the front and rear mounting hole slots is 1120 mm (44.1 inches)
5: Depth of cable-routing floor cutout is 330 mm (13 inches)
6: Distance between the floor cutout and the edge of the rack is 160 mm (6.3 inches)
7: Width of cable-routing floor cutout is 280 mm (11 inches)
If you plan to route data or PDU power cords down through the bottom of the rack, then you need to cut a hole in the installation floor site. Cut a rectangular hole below the rear portion of the rack, between the two rear casters and behind the rear RETMA (Radio Electronics Television Manufacturers Association) rails. Figure 3-8 shows the base positions of the rack from the bottom.
Do not create a hole where the rack casters or leveling feet brackets will be placed.
Open the front and rear Exalogic machine doors.
Install the mounting brackets to the rack as shown in Figure 3-9 using a 6 mm hexagon Allen wrench key.
Using bolts and washers that are appropriate for your installation site, permanently mount your system to the floor using the four mounting brackets as shown in Figure 3-9.
The bolts required for securing the Exalogic machine to the floor vary depending on the installation location. Select bolts that are appropriate for your location.
Firmly tighten all of the bolts that secure the mounting brackets to the Exalogic machine and to the floor.
The Exalogic machine power distribution units (PDUs) achieve earth ground through their power cords. Final chassis ground is achieved by way of the ground prong when you connect the power cord to a socket. For additional grounding, attach a chassis earth ground cable to the Exalogic machine. The additional ground point enables electrical current leakage to dissipate more efficiently.
The PDU power input lead cords and the ground cable must reference a common earth ground. If they do not, then a difference in ground potential can be introduced. If you are unsure of your facility's PDU receptacle grounding, then do not install a ground cable until you confirm that there is a proper PDU receptacle grounding. If a difference in ground potential is apparent, then you must take corrective action.
A grounding cable is not shipped with the system.
Ensure the installation site has properly grounded the power source in the data center. The facility PDU must have earth ground.
Ensure all grounding points, such as raised floors and power receptacles, reference the facility ground.
During manufacturing, the ground cable attachment area might be a painted or coated surface. Ensure that direct, metal-to-metal contact is made for this installation.
Attach the ground cable to one of the attachment points located at the bottom rear of the system frame as shown in Figure 3-10. The attachment point is an adjustable bolt that is inside the rear of the Exalogic machine cabinet on the right side.
Before powering on the system for the first time, it is necessary to inspect the machine, and connect the power cords. This section contains the following topics:
The following procedure describes how to visually examine the Exalogic machine physical system after it is in place, but before power is supplied:
Check the rack for damage.
Check the rack for loose or missing screws.
Check your Exalogic machine for the ordered configuration. Refer to the Customer Information Sheet (CIS) on the side of the packaging.
Check that all cable connections are secure and firmly in place as follows:
Check the power cables. Ensure that the correct connectors have been supplied for the data center facility power source.
Check the network data cables.
Check the site location tile arrangement for cable access and airflow.
Check the data center airflow that leads in to the front of the Exalogic machine.
Section 2.6, "Ventilation and Cooling Requirements"for more information
The following procedure describes how to connect power cords to the Exalogic machine:
Open the rear cabinet door.
Ensure that the correct power connectors have been supplied.
Unfasten the power cord cable ties. The ties are for shipping only and are no longer needed.
Secure the power cords in bundles, as shown in Figure 3-11.
Plug the PDU power cord connectors into the facility receptacles.
The following procedure describes how to power on the Exalogic machine:
Ensure that each of the three main power cords is connected.
Switch on the six power distribution unit (PDU) circuit breakers located on the rear of the main PDU (PDU A) inside the Exalogic machine. The circuit breakers are on the rear of the Exalogic machine cabinet as shown in Figure 3-13. Press the ON (|) side of the toggle switch.
The 24 kVA PDU has 4 plugs, and the 15 kVA PDU has 2 plugs. In either case, you can use the instructions described in this section to power on your Exalogic machine.
Wait 3 to 5 minutes for all Oracle Integrated Lights Out Manager (ILOM) service processors to boot.
Open the front cabinet door.
Verify that server standby power is on for compute nodes, InfiniBand gateway switches, and Sun ZFS Storage 7320 appliance in the Exalogic machine.
When power is delivered to the receptacles at the rear of the server chassis, standby power is made available by the power supplies. When standby power is distributed to the chassis, the service processor (SP) powers on and starts up to manage the system. The main power is supplied for the remainder of the chassis and fans when the power button on the front of the server chassis is pressed. The power button is disabled while the SP is starting. The start-up state is indicated by a steady one second on, one second off blinking pattern of the Power/OK LED on the front of the system. After the SP has started, the power button is enabled and the system is placed in standby power mode.
In standby power mode, the Power/OK LED on the front panel blinks green in a 0.1 second on, 2.9 seconds off pattern, as shown in Figure 3-14.
Verify that the main power is on for each compute node.
In main power mode, the Power/OK LED on the front panel blinks in a one second on, one second off pattern while the system BIOS starts. After BIOS initialization completes and the operating system begins to start, the Power/OK LED illuminates and remains a steady green.
Figure 3-16 shows the soft switch and LED lights on each of the server heads in the storage appliance.
Wait 3-5 minutes for the Sun ZFS Storage 7320 appliance to initiate NFS services, daemons, and basic services.
You can ping the IP address assigned to the Sun ZFS Storage 7320 appliance to verify whether the system is up and running. For the default
NET0 IP addresses, see Chapter 4, "Default IP Addresses and Ports Used in Exalogic Machine."
Alternatively, you can try to launch the administration console for the storage appliance. Before you can ping the IP address or launch the administration console, you must connect a laptop to the rack, as described in Connecting a Laptop to Exalogic Machine.
After making sure that the storage appliance is up and running, press the soft switches located on the front of the compute nodes in your Exalogic machine, as shown in Figure 3-15. After power-on, the LED indicators turn green, as shown in Figure 3-16.
If you are using an Exalogic machine full rack, you must switch on thirty compute nodes. If you are using an Exalogic machine half rack, you must switch on sixteen compute nodes. If you are using an Exalogic machine quarter rack, you must switch on eight compute nodes.
Verify that power is applied to the Cisco Ethernet switch.
The Ethernet switch is inside a vented filler panel in Unit 25 of the rack.
Verify that power is applied to the Sun Network QDR InfiniBand Gateway Switches.
The gateway switches are inside vented filler panels. If you are using an Exalogic machine full rack, verify that power is supplied to the four gateway switches included in the Exalogic machine. If you are using an Exalogic machine half rack, verify that power is supplied to the two gateway switches included in the Exalogic machine. If you are using an Exalogic machine quarter rack, verify that power is supplied to the two gateway switches included in the Exalogic machine.
Optional: Verify that power is supplied to the Sun Datacenter InfiniBand Switch 36.
The Sun Datacenter InfiniBand Switch 36 is inside a vented filler panel in Exalogic machine full rack and Exalogic machine half rack. This switch is not included in Exalogic machine quarter rack. This spine switch is used in multirack configuration scenarios (an Exalogic machine to another Exalogic machine, and an Exalogic machine to an Oracle Exadata Database Machine) only.
You can connect a laptop to the Exalogic machine as follows:
Ensure that you have a laptop with functional USB and network ports.
Ensure that you have a Category 5E patch cable of maximum length 25 feet and a serial cable of maximum length 15 feet.
Open the rear cabinet door of the rack.
Connect the network port of your laptop into an unused input port in the Cisco Ethernet switch. This switch is inside a vented filler panel in Unit 25 of your Exalogic machine rack. Note that you should not connect to any of the management or console ports on the switch. The ports are labeled on the switch.
If you require serial connectivity, you can use a USB-to-Serial adapter to connect from the USB port of your laptop to the Cisco switch.
A USB-to-Serial adapter is installed in the rack on all of the gateway switches (Sun Network QDR InfiniBand Gateway Switches).
An extra adapter is included in the shipping kit in the Exalogic machine full rack and half rack configurations.
If you have not booted the operating system on your laptop, start the operating system now.
If you are using the Windows operating system on your laptop, do the following:
Go to Control Panel > Network Connections. Select your wired network adapter in the list of network connections, right-click and select Properties. The network properties screen is displayed.
Click the General tab, and select Internet Protocol (TCP/IP). Click Properties. The Internet Protocol (TCP/IP) Properties screen is displayed.
Select the Use the following IP address: option, and enter a static IP address for your laptop. Although a default gateway is not necessary, enter the same IP address in the Default Gateway field. Click OK to exit the network connections screen.
This static IP should be on the same subnet and address range as the network on which the Cisco Ethernet switch resides. You can use the default
NET0 IP addresses of compute nodes assigned at the time of manufacturing or the custom IP address that you reconfigured using the Oracle
Exalogic Configuration Utility. For the list of default
NET0 IP addresses, see Chapter 4, "Default IP Addresses and Ports Used in Exalogic Machine."
If you are using a Linux operating system on your laptop, do the following:
Log in as a
At the command prompt, enter the following command to display the network devices, such as
ETH0, attached to the Exalogic machine:
# ifconfig -a
The list of network devices or adapters attached to the Exalogic machine is displayed.
To set up the desired network interface, run the
ifconfig command at the command prompt, as in the following example:
# ifconfig eth0 192.168.1.150 netmask 255.255.255.0 up
In this example, the
ifconfig command assigns the IPv4 address
192.168.1.150, with a network mask of
255.255.255.0, to the
For laptop connectivity, open any
ssh client program, such as PuTTY. Connect to one of the service processor IP addresses or to the IP address of a compute node, which is up and running.
After you cable your laptop to the Cisco Ethernet switch, you can use the
NET0 IP addresses of Exalogic machine components to communicate with them. For a list of default IP addresses assigned at the time of manufacturing, see Chapter 4, "Default IP Addresses and Ports Used in Exalogic Machine".
If you have not run the Oracle
Exalogic Configuration Utility set of tools and scripts to reconfigure IP addresses for the Exalogic machine, you can use a set of default IP addresses. If you have already run the Oracle
Exalogic Configuration Utility set of tools and scripts, you can use the network IP address that you provided as input to the Exalogic Configurator spreadsheet. For more information about Oracle
Exalogic Configuration Utility, see Appendix A, "Configuring Exalogic Machine Using ECU".
After powering on the Exalogic machine, including compute nodes and Sun ZFS Storage 7320 appliance, proceed to configure the Exalogic machine.