1. DSR Automated Test Suite Installation and User Guide
  2. Test Case Execution
  3. Test Case Execution Process

6.2 Test Case Execution Process

Perform the following procedure to run the test cases and check the VDSR health status.
Complete the tasks described in Prerequisites for Test Case Execution.
  1. Go to https://<ATS_IP>:8443/.
  2. Log in to the Jenkins GUI using your log in credentials.
    The system displays the Jenkins GUI.

    Figure 6-20 Jenkins GUI


    Jenkins GUI

  3. To run the required test cases, in the Fav column, click the corresponding
    button for the following suite:
    • vSTP_Regression: This suite runs vSTP related regression test cases. It has four in suites which are sets of features related to vSTP functionality. If a single feature must be run, it can be run only through CLI.
    • New-Features: This suite contains the following new features:
      • Rf_Routing
      • Radius_Routing
      • Rx_Gateway_MCPTT
      • Gy_S6b_Stateless_Routing
    • Performance: This suite checks whether the performance testcases are passed on the current DSR build. It runs the Relay and FABR traffic. This suite consists of Diameter_Traffic and Radius_Traffic execution suites.
    • Regression: This suite consists of all the Roaming and Core testcases. It contains all the testcases as per the requirement document.
    • VDSR-HealthCheck: This suite checks the status of VDSR. This suite checks whether all the prerequisites are complete or not.
    • Cleanup: This suite consists of cleanup feature to perform cleanup on SUT.
    • DSA: Contains two suites of DSA stateful and stateless test cases.

    Note:

    You can run these suites in any sequence, however, it is recommended to run the VDSR-HealthCheck suite first.
  4. To perform the VDSR health check, click the corresponding Perform the VDSR health check button.
    1. In the lower-left corner of the GUI, in the Build History area, click Successful Build or Failed Build to check the log in Console Output.

      If the build has failed, then the Successful Build icon appears red ( Failed Build). This indicates that the log contains DSR alarms.

      The following image provides an example of a console output:

      Figure 6-21 Console Output


      Console Output

    2. If the log contains DSR alarms, clear the alarm and then perform the VDSR health check again by clicking the corresponding health check button (
      Health check button

      ).
      If the build is successful, in the Build History area, the Failed Build turns Successful Build.
  5. To perform Regression, click the corresponding
    Perform regression

    button.
    The DSR - Automated Test Suite page appears.

    Figure 6-22 Regression Parameters

    Regression Parameters
    1. Configure the parameters as described in Regression Parameters.
      You can change the rerun count in the /var/lib/jenkins/workspace/Regression directory.
    2. Click Build.
    3. In the lower-left corner of the GUI, in the Build History area, click Successful Build or Failed Build to check the log in Console Output.
  6. To check the Performance, click the corresponding
    Performance

    button.
    The following image provides an example of a Performance build.

    Figure 6-23 Performance Build


    Performance Build

    1. In the lower-left corner of the GUI, in the Build History area, click Successful Build or Failed Build to check the log in Console Output.