Bookshelf v7.5: Performance Test Environment

Testing Siebel eBusiness Applications > Plan Testing Strategy > Test Environments >

Performance Test Environment

In general, the more closely the system test environment reflects the production configuration, the more applicable the test results will be. It is important that the system test environment include all of the relevant components to test all aspects of the system, including integration and third-party components. Often it is not feasible to build a full duplicate of the production configuration for testing purposes. In that case, the following scaled-down strategy should be employed for each tier:

Web Servers and Siebel Servers. To scale down the web and application server tiers, the individual servers should be maintained in the production configuration and the number of servers scaled down proportionately. The overall performance of a server depends on a number of factors besides number of CPUs, CPU speed, and memory size, so it is generally not accurate to try to map the capacity of one server to another even within a single vendor's product line.

The primary tier of interest from an application scalability perspective is the application server tier. Scalability issues are very rarely found on the web server tier. If further scale-down is required it is reasonable to maintain a single web server and continue to scale the application server tier down to a single server. The application server should still be of the same configuration as those used in the production environment, so that tuning activity can be accurately reflected in the system test and production environments.

Database Server. If a database server needs to be scaled down, there is generally little alternative but to use a system as close as possible to the production architecture, but with CPU, memory, and I/O resources scaled down as appropriate.

Network. The network configuration is one area in which it is particularly difficult to replicate the same topology and performance characteristics that exist in the production environment. It is important that system test include any active network devices such as proxy servers and firewalls. The nature of these devices can impact not only the performance of the system, but also the functionality, since in some cases these devices manipulate the content that passes through them. The performance of the network can often be simulated using bandwidth and latency simulation tools generally available from third-party vendors.