Regression Testing Recommendations
As part of implementation, customers should use Utilities Testing Accelerator (UTA) in several testing phases and after go-live must have several established UTA process flows created to verify the business process in an automated way. Oracle recommends continuing using the UTA for any upgrade performed in their environment.
Upon receipt of any hot fix, new maintenance pack, or new release, UTA is the best way to perform regression testing on an upgraded environment. Aside from using UTA for regression testing, Oracle also recommends the following:
Customer taking new maintenance packs and or hot fixes are required to review the Product Fix Documents (PFDs) available on My Oracle Support. These documents contain changes included in the hot fix along with some testing scenario that you can create in the UTA as process flows.
Customers taking new releases are required to perform the following steps:
Review the Oracle Cloud Application Update Readiness portal.
Review the What’s New (under Essential Content - an Excel sheet is also available for further details)
Review the new feature details, as well as its impact and where it will be used.
Review the Database Changes feature to be aware about new database objects and changes made to existing objects
Review the Important Actions and Considerations sections for removed and replacement features with time frame.
Access the Extensions Dashboard portal in the cloud application to review your custom extensions to ensure that your testing includes your customizations. Refer to Extensions Dashboard in the Administrative User Guide for more information about this portal.
Review the new release videos demonstrating the new feature and how to configure your application to use it. Access these videos via the Videos link in the left navigation pane on Oracle Help Center.
Review the Utilities Testing Accelerator (UTA) documentation. If a UTA upgrade is needed, perform the UTA upgrade first.
Run the F1-CAGVY batch process in your application to recompile any custom groovy code. Make sure to review the batch run tree and resolve errors in custom code, if found.
Review the Application Services section in What’s New release readiness document. Determine if your implementation wants to opt in to any of the functionality related to the new features secured by the listed application services, and grant security access to the appropriate users.
Run the UTA process flows to verify that existing business processes are running as configured. That includes verification that new bills are being created correctly (for Customer Cloud Service, Billing Cloud Service, and Customer Care and Billing Cloud Service).
Configure new features (as required) and perform initial testing.
Create new UTA process flows for new features and/or processes.
Perform the regression testing multiple times in both isolation and with integrations enabled.
Make sure the batch job streams are executed in the same manner as in production. Review batch runs for any errors.
Function-Specific Regression Testing Recommendations
Oracle recommends testing the following functional areas of the following cloud services as part of regression testing with each release:
Oracle Utilities Customer Care and Billing Cloud Service
Bill Print
Start/Stop
Payment Integration
Oracle Utilities Customer Cloud Service
Bill Print
Start/Stop
Payment Integration
Smart Meter Commands
Oracle Utilities Meter Solution Cloud Service
Smart Meter Commands