Trouble running an A/B test from the experiment playbook

The user followed the Run an Experiment Playbook but cannot get the test running and wants guidance on setup and support.

5 replies 0 reactions
Alfie Gordon avatar

Hey team, I was trying to run an A/B test using the Run an Experiment Ploybook, but I'm having trouble getting it running. Is this functionality currently supported? Any guidance would be appreciated!

5 replies

01
darin avatar

Hey hey, could you share more?

02
Alfie Gordon avatar

Hey Darin, no problem. Here's a summary of where we've got to on the A/B test.
Goal: split-test the hero copy on hexis.live/athlete-triathlon. We'd change the headline and subhead only and leave everything else on the page alone. The primary metric is hero "Get started" clicks per hero view.

Where we are:

  • We want to use Ploy's built-in experiment feature, on the same URL with Ploy assigning visitors server side.
  • The agent says the helper that the feature needs isn't set up on our site, and it isn't allowed to add it itself. It filed a bug report.
  • We couldn't find anything about experiments on docs.ploy.ai.
PNG
PNG
03
darin avatar

Hey @Alfie Gordon, seems like we're not fully done with Experiments and the feature is currently not widely available. I'll let you know when this changes.

05
Alfie Gordon avatar

great job you guys are doing btw. Phenomenal platform