5.4 Initial Network Configuration of Exalogic Machine

After you connect your Exalogic machine to the external Ethernet network using cables and transceivers, you must configure the following Exalogic components to add them to the network:

  1. Mandatory: Cisco Ethernet Switch

  2. Optional: vNICs on Sun Network QDR InfiniBand Gateway Switches for Ethernet over InfiniBand (EoIB) connectivity, if necessary

  3. Mandatory: Compute nodes

  4. Mandatory: Storage heads

  5. Mandatory: Sun Network QDR InfiniBand Gateway Switches

  6. Optional: Sun Datacenter InfiniBand Switch 36, if you are connecting your Exalogic machine to another Exalogic machine rack or to an Oracle Exadata Database Machine rack

Note:

You can use the Oracle Exalogic Configuration Utility set of tools and scripts to configure the compute nodes, storage heads, and Sun Network QDR InfiniBand Gateway Switches. For more information about Exalogic Configuration Utility, see Configure the Exalogic Machine Using ECU.

You must configure the Cisco Ethernet Switch manually. For more information, see Configuring the Cisco Ethernet Switch.

For information about configuring VNICs for Ethernet connectivity, see Configure Ethernet Over InfiniBand.

For information about configuring the Sun Datacenter InfiniBand Switch 36 manually in multirack scenarios, see Use the Sun Datacenter InfiniBand Switch 36 in Multirack Configurations.

5.4.1 Configuring the Cisco Ethernet Switch

The host name, IP address, DNS and NTP configurations must be configured for the Cisco Ethernet switch. Before configuring the switch, note the following:

  • The Cisco Ethernet switch should not be connected until the running configuration has been verified, and any necessary changes have been made by the network administrator.

  • The Cisco Ethernet switch should not be connected to the network until the IP addresses on all components have been configured in the Exalogic machine. This is to prevent any duplicate IP address conflicts which are possible due to the default addresses set in the components when shipped.

The following procedure describes how to configure the Cisco Ethernet switch:

  1. Connect a serial cable from the Cisco switch console to a laptop or similar device. An RJ45 to DB9 serial cable is included in the Cisco documentation package.
  2. Ensure that the terminal session is logged on the laptop by scripting the output. The data can be used as a reference that the switch has been configured correctly. The default serial port speed is 9600 baud, 8 bits, no parity, 1 stop bit, and no handshake. 
    Switch con0 is now available
Press RETURN to get started.
  3. Change to enable mode using the following command. The Cisco switch prompts for the default password. For the default password, contact Oracle Support. 
    Switch> enable
  4. Configure the network for a single VLAN. The following is an example of the configuration: 
    Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# interface vlan 1
Switch(config-if)# ip address 10.7.7.34 255.255.255.0
Switch(config-if)# end
Switch# *Sep 15 14:12:06.309:%SYS-5-CONFIG_I:Configured from console by console
Switch# write memory
Building configuration...
Compressed configuration from 2474 bytes to 1066 bytes [OK ]
  5. (Optional) Disable the default IP routing setting, and configure the default gateway as follows. This step is required if IP routing will not be used on the switch. 
    Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# no ip routing
Switch(config)# ip default-gateway 10.7.7.1
Switch(config)# end 
*Sep 15 14:12:46.309:%SYS-5-CONFIG_I:Configured from console by console
Switch# write memory
Building configuration...
Compressed configuration from 2492 bytes to 1070 bytes [OK ]

    Note:

    If IP routing is required on the switch, then leave the IP routing setting as the default, and configure the default gateway as follows:

    Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# ip route 0.0.0.0 0.0.0.0 10.7.7.1
Switch(config)# end
*Sep 15 14:13:26.013:%SYS-5-CONFIG_I:Configured from console by console
Switch# write memory
Building configuration...
Compressed configuration from 2502 bytes to 1085 bytes [OK ]
  6. Set the host name of the switch as follows: 
    Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# hostname corxsw-ip
burxsw-ip(config)# end
burxsw-ip# write memory
Building configuration...
Compressed configuration from 3789 bytes to 1469 bytes [OK ]

    The system host name will be used as the prompt name.

  7. Set the password as follows: 
    Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# enable password Your_Password
Switch(config)# enable secret Your_Password 
The enable secret you have chosen is thesame as your enable password.
This is not recommended.Re-enter the enable secret.
Switch(config)# end
Switch#write memory 
*Sep 15 14:25:05.893:%SYS-5-CONFIG_I:Configured from console by console
Building configuration...
Compressed configuration from 2502 bytes to 1085 bytes [OK ]
  8. Set the password for telnet network access. The following is an example: 
    Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# line vty 0 15
Switch(config-line)# login
%Login disabled on line 1,until 'password'is set
%Login disabled on line 2,until 'password'is set
%Login disabled on line 3,until 'password'is set
...
%Login disabled on line 15,until 'password'is set
%Login disabled on line 16,until 'password'is set
Switch(config-line)# password Your_Password
Switch(config-line)# login
Switch(config-line)# end
Switch#write memory
Building configuration...
Compressed configuration from 3786 bytes to 1468 bytes [OK ]
Switch#

    In the preceding example, the first login output shows the password has not been set, and telnet access is disabled. If the login command returns nothing, then the password is set and telnet access is available.

  9. Configure up to three DNS servers. The following is an example: 
    Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# ip domain-name exdm.com
Switch(config)# ip name-server 10.7.7.3
Switch(config)# ip name-server 129.148.5.5
Switch(config)# ip name-server 10.8.160.1
Switch(config)# end 
*Sep 15 14:26:37.045:%SYS-5-CONFIG_I:Configured from console by console
Switch#write memory
Building configuration...
Compressed configuration from 2603 bytes to 1158 bytes [OK ]
  10. Set the clock and time zone as follows. The switch keeps internal time in Coordinated Universal Time (UTC) format.

    • To use UTC use the following command:

      no clock timezone global configuration

    • To use a time zone, use the following command:

      clock timezone zone hours-offset [minutes-offset]

      In the preceding command, zone is the time zone to display when standard time in effect, hours-offset is the hours offset from UTC, and minutes-offset is the minutes offset from UTC.

    • To set summer time hours, use the following command:

      clock summer-time zone recurring [week day month hh:mm week day month \
hh:mm [offset]]

      In the preceding command, zone is the time zone to be displayed when summer time is in effect, week is the week of the month (1 to 5 or last), day is the day of the week, month is the month, hh:mm is the time in 24-hour format, and offset is the number of minutes to add during summer time. The default offset is 60 minutes.

    • To manually set the clock to any time, use the following command:

      clock set hh:mm:ss month day year

      In the preceding command, hh:mm:ss is the time in 24-hour format, day is the day of the month, month is the month, and year is the year. The time specified is relative to the configured time zone.

    To set the local time and time zone, ordering is important. The following is an example of setting local time to US Eastern time:

    Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# clock timezone EST -5 
Switch(config)# clock summer-time EDT recurring
Switch(config)# end
Switch# clock set 21:00:00 December 09 2009
Switch#write memory
Building configuration...
Compressed configuration from 3784 bytes to 1465 bytes [OK ]
Switch# show clock
21:00:06.643 EST Wed Dec 9 2009
  11. Configure up to two NTP servers. The following is an example: 
    Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# ntp server 10.7.7.32 prefer
Switch(config)# ntp server 129.148.9.19
Switch(config)# end
*Sep 15 14:51:08.665:%SYS-5-CONFIG_I:Configured from console by
console
Switch# write memory
Building configuration...
Compressed configuration from 2654 bytes to 1163 bytes [OK ]
Switch# show ntp status
<output will vary per network>
Switch# show clock
20:59:06.643 EST Wed Dec 9 2009

    The preceding should show the NTP server synchronized to local time if the Cisco switch is connected to the network and has access to NTP.

  12. Verify the configuration using the following command: 
    Switch# show running-config

    The following is an example of the output:

    Building configuration...
Current configuration :2654 bytes
!
version 12.2
no service pad
service timestamps debug datetime msec
service timestamps log datetime msec
no service password-encryption
service compress-config
!
hostname Switch
!
boot-start-marker
boot-end-marker
!
enable secret 5 $1$mS8h$EaJrIECUxavfGH6vLZg1T.
enable password Your_Password
!
no aaa new-model
ip subnet-zero
ip domain-name sodm.com
ip name-server 10.7.7.3
ip name-server 172.16.5.5
ip name-server 10.8.160.1
!
ip vrf mgmtVrf
!
vtp mode transparent
!
power redundancy-mode redundant
!
!
spanning-tree mode pvst
spanning-tree extend system-id
no spanning-tree vlan 1
!
vlan internal allocation policy ascending
!
!
interface FastEthernet1
ip vrf forwarding mgmtVrf
no ip address
speed auto
duplex auto
!
interface GigabitEthernet1/1
!
interface GigabitEthernet1/2
!
...
!
interface GigabitEthernet1/44
!
interface GigabitEthernet1/45
media-type rj45
!
interface GigabitEthernet1/46
media-type rj45
!
interface GigabitEthernet1/47
media-type rj45
!
interface GigabitEthernet1/48
media-type rj45
!
interface Vlan1
ip address 10.7.7.34 255.255.255.0
!
interface Vlan48
no ip address
shutdown
!
ip default-gateway 10.7.7.1
ip http server
!
!
control-plane
!
!
line con 0
stopbits 1
line vty 0 4
password Your_Password
login
line vty 5 15
password Your_Password
login
!
ntp server 10.7.7.32 prefer
ntp server 172.16.9.1
end

    If any setting is incorrect, then repeat the appropriate step. To erase a setting, enter no in front of the same command. For example, to erase the default gateway, the following commands would be entered:

    no ip default-gateway 10.7.7.1
end
write memory
  13. Save the current configuration using the following command: 
    Switch# copy running-config startup-config
  14. Exit from the session using the following command: 
    Switch# exit
  15. Disconnect the cable from the Cisco console.

    Note:

    To check the configuration, attach a laptop computer to port 48, and ping the IP address of the internal management network.