Contents

List of Figures

List of Tables

Title and Copyright Information

Preface

• Audience
• Documentation Accessibility
• Related Documents
• Conventions

1 Planning the Installation

• 1.1 System Requirements
  • 1.1.1 Disk Space Requirements
  • 1.1.2 Supported Operating Platforms
• 1.2 Planning Checklist
• 1.3 Cluster Design
  • 1.3.1 Cells
  • 1.3.2 Cluster Name
• 1.4 Queue Structure
• 1.5 Host System Requirements
  • 1.5.1 Master Host
  • 1.5.2 Shadow Master Hosts
  • 1.5.3 Execution Hosts
  • 1.5.4 Administration Hosts
  • 1.5.5 Submit Hosts
• 1.6 User Account Considerations
  • 1.6.1 User Names
  • 1.6.2 Installation Accounts
  • 1.6.3 File Access Permissions
• 1.7 Network Services
• 1.8 Installation Methods
• 1.9 Directory Organization
  • 1.9.1 Spool Directories under the Root Directory
  • 1.9.2 Choosing Between Classic Spooling and Database Spooling
  • 1.9.3 $SGE_ROOT Directory
• 1.10 Spooling Options
  • 1.10.1 Database Server and Spooling Host
• 1.11 Scheduler Profiles
• 1.12 Getting the Software
  • 1.12.1 Electronic Download
  • 1.12.2 CD-ROM Distribution

2 Installing Grid Engine

• 2.1 Loading the Distribution Files on a Workstation
  • 2.1.1 How to Load the Distribution Files on a Workstation
  • 2.1.2 pkgadd Method
  • 2.1.3 tar Method
• 2.2 Installing the Software With the GUI Installer
  • 2.2.1 Requirements
• 2.3 Express Installation
  • 2.3.1 Using the Express Installation Mode
• 2.4 Custom Installation
  • 2.4.1 Using the Custom Installation Mode
• 2.5 How to Configure Password-less Access for the root User
  • 2.5.1 Configuring Password-less ssh Access for the root User
  • 2.5.2 Configuring Password-less rsh Access for the root User
• 2.6 Understanding Host and Installation States
  • 2.6.1 Host Resolving
  • 2.6.2 Host Validating
  • 2.6.3 Installation States
• 2.7 Tweaking start_gui_installer
  • 2.7.1 Description of start_gui_installer Options
• 2.8 Using start_gui_installer Options
  • 2.8.1 installing as a Different connect_user
  • 2.8.2 Installing Single Windows Execution Host
  • 2.8.3 Installing Multiple Windows Execution Hosts
• 2.9 Troubleshooting the GUI Installer
  • 2.9.1 FAQs
  • 2.9.2 Known issues and workarounds
• 2.10 Installing the Software From the Command Line
  • 2.10.1 Installation Overview
  • 2.10.2 Performing an Installation
• 2.11 How to Install the Master Host
  • 2.11.1 Installing the Master Host
• 2.12 Example Master Host Installation
• 2.13 How to Install Shadow Master Host
  • 2.13.1 Starting a Shadow Master Host Manually
  • 2.13.2 Configuring Shadow Master Host Environment Variables
  • 2.13.3 Example Shadow Master Host Installation
• 2.14 How to Install Execution Hosts
• 2.15 Example Execution Host Installation
• 2.16 How to Register Administration Hosts
• 2.17 How to Register Submit Hosts
• 2.18 How to Install the Berkeley DB Spooling Server
• 2.19 Installing the Increased Security Features
  • 2.19.1 Why Install the Increased Security Features?
  • 2.19.2 Additional Setup Required
• 2.20 How to Install a CSP-Secured System
• 2.21 How to Generate Certificates and Private Keys for Users
• 2.22 How to Renew Certificates
• 2.23 How to Check Certificates
  • 2.23.1 Displaying a Certificate
  • 2.23.2 Check Issuer
  • 2.23.3 Check Subject
  • 2.23.4 Show Email of Certificate
  • 2.23.5 Show Validity
  • 2.23.6 Show Fingerprint
• 2.24 Verifying the Installation
• 2.25 How to Verify That the Daemon is Running on the Master Host
• 2.26 How to Verify That the Daemons Are Running on the Execution Hosts
• 2.27 How to Run Simple Commands
• 2.28 How to Submit Test Jobs
• 2.29 Automating the Installation Process
• 2.30 Automatic Installation
  • 2.30.1 Special Considerations
  • 2.30.2 Using the inst_sge Utility and a Configuration Template
  • 2.30.3 How to Automate Installation With Increased Security (CSP)
  • 2.30.4 How to Automate Other Installations Through a Configuration File
  • 2.30.5 How to Automate the Master Host Installation
    • 2.30.5.1 Automating Other Installations Through a Configuration File
• 2.31 Automatic Uninstallation
  • 2.31.1 How to Uninstall Execution Hosts Automatically
  • 2.31.2 How to Uninstall the Master Host Automatically
  • 2.31.3 How to Uninstall the Shadow Master Host
• 2.32 How to Start the Automatic Backup
• 2.33 Troubleshooting Automatic Installation and Uninstallation
• 2.34 Installing SMF Services
  • 2.34.1 Why Install SMF Services?
  • 2.34.2 Additional Setup Required
  • 2.34.3 How Do SMF Services Compare to the Normal Services?
    • 2.34.3.1 qmaster Daemon
    • 2.34.3.2 shadowd Daemon
    • 2.34.3.3 execd Daemon
    • 2.34.3.4 Berkeley RPC Server
    • 2.34.3.5 dbwriter Software
• 2.35 Installing a JMX-Enabled System
  • 2.35.1 Additional Setup Required
• 2.36 How to Install a JMX Agent-Enabled System
• 2.37 How to Generate Certificates, Private Keys and Keystores for Users
• 2.38 How to Check Certificates, Private Keys and Keystores for Users
• 2.39 JMX Configuration Files
  • 2.39.1 jaas.config
  • 2.39.2 java.policy
  • 2.39.3 management.properties
  • 2.39.4 jmx.access
  • 2.39.5 jmx.password
  • 2.39.6 logging.properties
• 2.40 Testing and Troubleshooting
• 2.41 Removing the Software
• 2.42 How to Remove the Software Interactively
• 2.43 How to Remove the Software Using the inst_sge Utility and a Configuration Template
• 2.44 Additional Software for the Microsoft Operating System
  • 2.44.1 Additional Software
• 2.45 Microsoft Services for UNIX
  • 2.45.1 Unsupported Grid Engine Functionality
  • 2.45.2 Configuring User Name Mapping
• 2.46 How to Install Microsoft Services for Unix
  • 2.46.1 System Requirements
  • 2.46.2 Services for UNIX Installation
  • 2.46.3 Post SFU Installation Tasks
• 2.47 Troubleshooting SFU
• 2.48 Microsoft Subsystem for UNIX-based Applications
  • 2.48.1 Unsupported Grid Engine Functionality
• 2.49 How to Install a Microsoft Subsystem for UNIX-based Applications
  • 2.49.1 System Requirements
  • 2.49.2 Installing Subsystem for UNIX-based Applications
  • 2.49.3 Post Installation Tasks
• 2.50 Troubleshooting Microsoft Subsystem for UNIX-based Applications
• 2.51 Changing Default Behavior to Case Sensitivity
• 2.52 Disabling DEP
  • 2.52.1 How to Disable DEP for Windows XP Professional, Windows Server 2000 and Window Server 2003
  • 2.52.2 How to Disable DEP for Windows Vista (Enterprise and Ultimate) and Windows Server 2008
• 2.53 Enabling suid Behavior for Interix Programs
• 2.54 User Management on Windows Hosts
• 2.55 Managing Users on Windows Hosts
  • 2.55.1 Windows User Example
  • 2.55.2 UNIX User Management
• 2.56 Using Grid Engine in a Microsoft Windows Environment
  • 2.56.1 Registering Windows User Passwords
  • 2.56.2 Using the sgepasswd Command
  • 2.56.3 Adding Windows Hosts to Existing Grid Engine Systems
• 2.57 How to Add Windows Hosts Later
• 2.58 Other Installation Issues
• 2.59 How to Verify and Install Linux Motif Libraries
• 2.60 How to Install the Software on a System with IPMP
  • 2.60.1 What Is IP Multipathing?
  • 2.60.2 Issues Between IPMP and Grid Engine
  • 2.60.3 Installing the Grid Engine Master Node With IPMP
  • 2.60.4 Ignoring the Error Messages
  • 2.60.5 Temporarily Disabling IPMP
  • 2.60.6 Installing a Grid Engine on an Execution Host With IPMP
  • 2.60.7 Enabling Administrative and Submit Hosts With IPMP

3 Upgrading Grid Engine

• 3.1 About Upgrading the Software
• 3.2 Before You Upgrade
• 3.3 Constraints
• 3.4 How to Back Up the Configuration of the Old Cluster
  • 3.4.1 What the Backup Contains
  • 3.4.2 How to Back Up the Cluster
• 3.5 How to Install the 6.2 Software Using the Cloned Configuration Method
  • 3.5.1 Additional Constraints for the New 6.2 Installation with Cloned Configuration
• 3.6 Example Upgrade for Cloned Cluster Configuration
• 3.7 How to Upgrade the Original Cluster to the 6.2 Software (Real Upgrade)
• 3.8 How to Upgrade from 5.3 to 6.0

A Configuration File Templates

• A.1 Configuration File Template