Any publish event stops any A/B tests that are currently in progress and sets all A/B tests with an Active status to Inactive. This happens whether the Site is published by a user clicking the Publish button for a Site, or by an auto-publish event that occurs after certain related events.
The related events which cause an auto-publish event to occur are:
Evaluation of a Site is stopped or restarted.
The single-page application status is changed.
A change is made to the WebCare account settings screen for the account which is used to access Engagement Engine.
A change is made in WebCare Link Builder to a call or chat invite that is used in a Rule that is currently associated with the Site.
A change is made in WebCare Operating Hours to an operating hours set that is used in a Rule that is currently associated with the Site.
All active tests are affected by a publish event and their status changes in accordance with the following table:
Test status before publish event | Test status after publish event |
---|---|
Idle | Void |
In Progress | Incomplete and inactive |
Incomplete | Incomplete and inactive |
Complete | Complete and inactive |
If you try to publish a Site, stop or start evaluation of a Site or change the single-page application setting, a message is displayed warning you of the potential impact on your A/B tests. However, WebCare does not display any warning about the impact of making changes on your A/B tests, so it is important that anyone who might make changes via WebCare is aware of the potential impact on A/B tests.