AB Testing – Known Issues in Sitecore 8.2 update 5

Recently, I was working on implementing A/B testing for some of the web pages in one of my engagement. The Sitecore version was 8.2 update 5. During the implementation, I ran into lot of issues, which I was able to overcome and also there were some issues for which I reached out to Sitecore Support for help.

In this blog post, I wanted to highlight two issues which are informed as Known issue by Sitecore support while implementing A/B testing in Sitecore 8.2 update 5 and they have provided me a patch. Below are the issues,

  • Page level statistics were not shown in the Experience Optimization Dashboard Report
  • Unable to change the test variants in Experience Editor if the test is created in languages other than the default English language

Page level statistics were not shown in the Experience Optimization Dashboard Report

For an active test case, page level statistics like Top Goals Converted, Top Clicks to Pages, Site Usage were not displayed in the Experience Optimization Dashboard Report. However, the same can be seen in the respective page’s Experience Editor’s test result page.

AB Test-page level statics

Solution:

As confirmed by Sitecore support, this issue seems to be known issue on Sitecore 8.2 update 5 and they provided a patch to fix this issue. More information on this can be found on the following support tickets 502913, 503716.

And the patch to fix this issue can be found in the below URL.

https://sitecore.app.box.com/s/dd0ax70s4mzko2wf1ehrvmpsivfa1f7z

Unable to change the test variants in Experience Editor if the test is created in non-English languages

While performing component testing via Experience Editor, the Variant Preview floating bar is not displayed after the page is loaded fully. This happens, when we create the test case in languages other than the default English language.

Therefore we are not able to change the test variants in Experience Editor if the test case is created using languages other than English.

AB Test-Variant Preview floating bar

Solution:

As confirmed by Sitecore support, this issue seems to be known issue and has been fixed in Sitecore 9.0 Initial, see the Release Notes, search for 110468. For Sitecore 8.2 update 5, they provided a patch to fix this issue. More information on this can be found on the following support tickets 530610.

And the patch to fix this issue can be found in the below URL.

https://github.com/SitecoreSupport/Sitecore.Support.110468/releases

 

Note:

The above mentioned patch is created to fix a specific issue. Therefore, the patch might not work for your solution. So please reach out to Sitecore support and refer the above support tickets, for better or faster resolution of the issue.

And also applying several patches without verification may lead to inconsistent behavior.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s