Load Testing
Load testing is the validation of system response under a predefined load. Load testing is encouraged to minimize risk associated with performance and scalability upon go-live or phased release. All load testing needs to conform with Oracle NetSuite Terms of Service. For restrictions regarding load testing, refer to General Restrictions section 3.1.1 of your NetSuite Subscription Services Agreement.
Stress testing is a form of deliberately intense testing used to determine the stability of a given system. It involves testing beyond normal operational capacity, often to a breaking point, to view the results. Stress testing is not supported in NetSuite.
Load Testing Considerations
Load tests should have a specific and realistic performance and load target.
Performance targets can be extrapolated from an individual action's execution time. For example, if saving a sales order performs at 10 seconds per save, and you are saving 1,000 sales orders, then 10,000 seconds or 2 hours and 45 minutes is an estimate for the duration of the test.
The number of concurrent threads should not exceed concurrency governance. To determine your available concurrency, refer to your tier of service and SuiteCloud licenses.
Concurrent threads may not increase throughput linearly. Concurrent access to resources may affect performance.
Test data should represent live data and use patterns. Test data should account for the normal variation in your expected production data. You should not use a single customer or item when testing. For example, if you are testing the process of a customer paying for an order, consider the following best practices:
-
The customer should vary.
-
The payment type should vary.
-
The number, type, and quantity of order lines should vary.
-
Order and order line customization should be tested.
The testing environment should mirror the production configuration to obtain representative results.
Load tests should be iterative. Test, analyze, make adjustments, and retest. Repeat.
You can use the Application Performance Monitor to evaluate your testing.
Notify NetSuite Customer Support of an upcoming load test by submitting a support case. Include the following information:
-
Authorized contact who should be notified about any questions or problems
-
Account type and ID where testing is being performed
-
Date, time, and duration of testing
-
Features or functionality being tested
-
Type of testing being performed:
-
New release testing
-
Web services or RESTlets
-
Web order processing
-
Bulk processing (revenue recognition, billing, costing, subscription billing, invoicing)
-
CSV imports
-