Contents

List of Figures

List of Tables

Title and Copyright Information

Preface

• Audience
• Documentation Accessibility
• Related Documents
• Conventions

1 Getting Started

• 1.1 How the System Operates
• 1.2 How Resources Are Matched to Requests
• 1.3 A Banking Analogy
  • 1.3.1 Jobs and Queues
• 1.4 Usage Policies
  • 1.4.1 Using Tickets to Administer Policies
  • 1.4.2 Using the Urgency Policy to Assign Job Priority
• 1.5 Choosing a User Interface
  • 1.5.1 QMON - The Graphical User Interface
  • 1.5.2 The Command Line Interface
  • 1.5.3 The Distributed Resource Management Application API (DRMAA)
• 1.6 Users and User Categories

2 Using Grid Engine

• 2.1 Interacting With Grid Engine as a User
  • 2.1.1 Launching QMON From the Command Line
  • 2.1.2 Customizing QMON
  • 2.1.3 Using the Command-Line Interface
• 2.2 Displaying User Properties
  • 2.2.1 User Access Permissions
  • 2.2.2 Displaying Managers, Operators, Owners, and User Access Permissions
• 2.3 Displaying Host Properties
• 2.4 Displaying Queue Properties
  • 2.4.1 Interpreting Queue Property Information
• 2.5 Submitting Jobs
  • 2.5.1 How Jobs Are Scheduled
  • 2.5.2 Usage Policies
  • 2.5.3 Job Priorities
  • 2.5.4 Ticket Policies
  • 2.5.5 Queue Selection
  • 2.5.6 Defining Resource Requirements
  • 2.5.7 Requestable Attributes
• 2.6 Submitting Batch Jobs
  • 2.6.1 About Shell Scripts
  • 2.6.2 Extensions to Regular Shell Scripts
    • 2.6.2.1 How a Command Interpreter is Selected
    • 2.6.2.2 Output Redirection
    • 2.6.2.3 Active Comments
    • 2.6.2.4 Environment Variables
• 2.7 Submitting Array Jobs
  • 2.7.1 How to Configure Array Task Dependencies From the Command Line
  • 2.7.2 How to Submit an Array Job From the Command Line
  • 2.7.3 How to Submit an Array Job With QMON
• 2.8 Submitting Interactive Jobs
  • 2.8.1 How to Submit Interactive Jobs From the Command Line
    • 2.8.1.1 Using qrsh to Submit Interactive Jobs
    • 2.8.1.2 Using qsh to Submit Interactive Jobs
    • 2.8.1.3 Using qlogin to Submit Interactive Jobs
  • 2.8.2 How to Submit Interactive Jobs With QMON
• 2.9 Transparent Remote Execution
  • 2.9.1 Remote Execution With qrsh
    • 2.9.1.1 Invoking Transparent Remote Execution With qrsh
  • 2.9.2 Transparent Job Distribution With qtcsh
    • 2.9.2.1 qtcsh Usage
  • 2.9.3 Parallel Makefile Processing With qmake
    • 2.9.3.1 qmake Usage
• 2.10 How to Submit a Simple Job From the Command Line
• 2.11 How to Submit a Simple Job With QMON
• 2.12 How to Submit an Extended Job From the Command Line
• 2.13 How to Submit an Extended Job With QMON
• 2.14 How to Submit an Advanced Job From the Command Line
  • 2.14.1 Specifying the Use of a Script or a Binary
  • 2.14.2 Default Request Files
• 2.15 How to Submit an Advanced Job With QMON
• 2.16 How to Configure Job Dependencies From the Command Line
• 2.17 Monitoring Hosts from the Command Line
  • 2.17.1 Using qconf
  • 2.17.2 Using qhost
• 2.18 How to Monitor Hosts With QMON
  • 2.18.1 Hosts Status
• 2.19 Monitoring and Controlling Jobs
  • 2.19.1 How to Monitor Jobs From the Command Line
  • 2.19.2 How to Monitor Jobs With QMON
    • 2.19.2.1 How to Get Additional Information About Jobs With the QMON Object Browser
  • 2.19.3 How to Control Jobs From the Command Line
  • 2.19.4 How to Control Jobs With QMON
  • 2.19.5 How to Monitor Jobs by Email
  • 2.19.6 How to Monitor Jobs by Email With QMON
• 2.20 Monitoring and Controlling Queues
  • 2.20.1 How to Control Queues From the Command Line
  • 2.20.2 How to Monitor and Control Cluster Queues With QMON
    • 2.20.2.1 Cluster Queue Status
  • 2.20.3 How to Monitor Queues With QMON
• 2.21 Using Job Checkpointing
  • 2.21.1 Migrating Checkpointing Jobs
  • 2.21.2 File System Requirements for Checkpointing
  • 2.21.3 Writing a Checkpointing Job Script
  • 2.21.4 How to Submit a Checkpointing Job From the Command Line
  • 2.21.5 How to Submit a Checkpointing Job With QMON
• 2.22 Managing Core Binding
  • 2.22.1 Submit Simple Jobs with Core Binding
  • 2.22.2 Submit Array Jobs with Core Binding
  • 2.22.3 Submit Parallel Jobs with Core Binding
    • 2.22.3.1 Submit Tightly Integrated Parallel Jobs with Core Binding
• 2.23 Automating Grid Engine Functions Through DRMAA
  • 2.23.1 Developing With the C Language Binding
    • 2.23.1.1 Important Files for the C Language Binding
    • 2.23.1.2 Including the DRMAA Header File
    • 2.23.1.3 Compiling Your C Application
    • 2.23.1.4 Running Your C Application
    • 2.23.1.5 C Application Examples
  • 2.23.2 Developing With the Java Language Binding
    • 2.23.2.1 Important Files for the Java Language Binding
    • 2.23.2.2 Importing the DRMAA Java Classes and Packages
    • 2.23.2.3 Compiling Your Java Application
    • 2.23.2.4 How to Use DRMAA With NetBeans 5.x
    • 2.23.2.5 Running Your Java Application
    • 2.23.2.6 Java Application Examples
• 2.24 Using the Accounting and Reporting Console
• 2.25 Installing the Accounting and Reporting Console (ARCo)
  • 2.25.1 Configuring the Database Server
  • 2.25.2 How to Configure the ARCo Database on MySQL
  • 2.25.3 How to Configure the ARCo Database on PostgresSQL
  • 2.25.4 How to Configure the ARCo Database with Multiple Schemas on PostgresSQL
  • 2.25.5 How to Configure the MySQL Database Server
    • 2.25.5.1 MySQL Installation Tips
    • 2.25.5.2 Case Sensitivity in MySQL Database
  • 2.25.6 How to Configure the PostgresSQL Server
  • 2.25.7 Using the Oracle Database
  • 2.25.8 How to Add Authorized ARCo Users
  • 2.25.9 How to Install dbwriter
  • 2.25.10 Example dbwriter Installation
  • 2.25.11 How to Install Reporting
  • 2.25.12 Example Reporting Installation
  • 2.25.13 How to Install Sun Java Web Console
• 2.26 Planning the ARCo Installation
  • 2.26.1 Supported Operating Platforms
  • 2.26.2 Required Software
  • 2.26.3 Disk Space Recommendations
  • 2.26.4 Multi-Cluster Support Overview
  • 2.26.5 Database Configuration Illustrations
  • 2.26.6 Schema Overview
• 2.27 How to Start ARCo
  • 2.27.1 How to Start the Accounting and Reporting Console
  • 2.27.2 Creating and Modifying Simple Queries
  • 2.27.3 Creating and Modifying Advanced Queries
  • 2.27.4 Configuring the Query Results View
  • 2.27.5 Examples for Defining Graphical Views
• 2.28 ARCo Configuration Files and Scripts
  • 2.28.1 About dbwriter
    • 2.28.1.1 inst_dbwriter Command Options
    • 2.28.1.2 dbwriter Configuration Parameters
    • 2.28.1.3 sgedbwriter Command Options
  • 2.28.2 About Reporting
  • 2.28.3 Other ARCo Utilities
• 2.29 Creating Cross-Cluster Queries
• 2.30 Examples
  • 2.30.1 Example - arco_write_london.sge_user
  • 2.30.2 Example - arco_write_denver.sge_user
• 2.31 Derived Values and Deletion Rules
  • 2.31.1 Derived Values
    • 2.31.1.1 Derived Values Format
    • 2.31.1.2 Derived Values Examples
  • 2.31.2 Deleting Outdated Records
    • 2.31.2.1 Deletion Rules Format
    • 2.31.2.2 Deletion Rules Examples
• 2.32 ARCo Frequently-Asked Questions
• 2.33 ARCo Troubleshooting

3 Upgrading ARCO

• 3.1 How to Migrate a PostgreSQL Database to a Different Schema
• 3.2 How to Upgrade the ARCo Software

A Command Line Interface Ancillary Programs

• A.1 List of Ancillary Programs
• A.2 User Access to the Ancillary Program