Inside an award-winning experimentation team | Stewart Ehoff (RS Components)

Ecommerce Experimenters

What does it look like inside an award-winning experimentation team?
As Stewart Ehoff reflects on that, you hear familiar aspects: people, vision, team spirit, rituals and ceremonies. But he also talks about challenges, the battle to convince others, experimentation being "a lonely place" and imposter syndrome.
Stewart is the Head of Experimentation at RS Components. They recently won the Experimentation Team Of The Year award at Experimentation Elite in London.
It's an inspirational story about their journey from an "optimisation" team to a Centre of Excellence, from client-side to server-side testing. The 5-year journey started with a clear vision and a focused campaign to get buy-in from leadership.
Some highlights are:

• Creating a culture of experimentation
• ROI of experimentation, a "contentious" topic
• Personalization, a "spicy" topic
• Transformation into a Centre of Excellence
• The significant shift from client-side to server-side testing
• ... and of course Generative AI

Kapitler

1. Inside an award-winning experimentation team | Stewart Ehoff (RS Components) (00:00:00)

2. Introduction (00:00:17)

3. About RS Components (00:00:42)

4. Experimentation at RS (00:02:14)

5. ROI in Experimentation (00:03:47)

6. Imposter syndrome? (00:08:16)

7. The journey to experimentation maturity (00:11:19)

8. Inside an award-winning experimentation team (00:16:57)

9. From client-side to server-side testing (00:22:31)

10. Fake Door and MVP Tests (00:25:47)

11. Personalisation, a spicy question (00:28:09)

12. VOC and Qualitative Feedback (00:31:37)

13. Generative AI in Experimentation (00:33:52)

14. Stewart, the classically-trained metal drummer (00:37:01)