Experiment Nation: The Podcast Podcast By Rommil from Experiment Nation cover art

Experiment Nation: The Podcast

Experiment Nation: The Podcast

By: Rommil from Experiment Nation
Listen for free

Every week we share: - Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world - Conference sessions / Tutorials Recent recognition: - Top 10% of most followed Podcasts on Spotify

experimentnation.substack.comExperiment Nation
Economics Marketing Marketing & Sales
Episodes
  • S6E7 - Ways to destroy an experimentation culture
    Apr 1 2026

    In this episode, we dive into the realities of CRO (Conversion Rate Optimization) today — from AI anxiety to experimentation culture and how teams should actually be structured.

    We start with a surprisingly philosophical take on photography and overthinking, then quickly shift into what’s really happening in the CRO and AI space right now.

    We discuss:

    * Why AI might be making everything look the same

    * The growing fear (and noise) around AI in CRO

    * How to structure CRO teams: centralized vs hybrid vs embedded

    * Why experimentation still struggles with a “nice-to-have” perception

    * What actually builds a strong experimentation culture

    * How individual contributors can influence culture without authority

    * And how to position CRO as a true growth engine, not just testing

    If you work in growth, product, or experimentation, this is a candid look at what’s changing and what actually matters.

    Chapters

    0:00 – Photography, overthinking, and creative process1:26 – Back to CRO: what’s happening in the industry2:07 – AI concerns and job market anxiety2:45 – The “everything looks the same” AI problem4:00 – Too many AI tools, no real differentiation5:38 – What people are really asking about AI6:23 – AI fear vs reality (and layoffs)7:08 – Fear-mongering vs signal8:00 – Fear and decision-making9:00 – CRO team structures: centralized, hybrid, embedded9:31 – Why centralized works early10:08 – When to move to hybrid10:29 – Why embedded is hard11:04 – The role of leadership buy-in12:13 – Why experimentation gets cut first13:00 – CRO’s “nice-to-have” branding problem14:00 – Why CRO is easy to underestimate15:45 – Future-proofing: combine CRO with other skills16:54 – Building experimentation culture (the “laundry” analogy)18:19 – How to destroy experimentation culture19:23 – Why authority and buy-in matter20:25 – How ICs can influence culture21:34 – Reframing experimentation as empowerment23:09 – Becoming a catalyst across teams24:46 – Confidence and presence in CRO roles25:59 – CRO vs Growth: what’s the difference?27:24 – Where CRO fits inside growth teams28:02 – Moving CRO upstream into systems thinking29:00 – Closing thoughts



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com
    Show more Show less
    30 mins
  • S6E6 - The Uncomfortable Truth About AI, ROI, and CRO Careers
    Mar 27 2026

    In this episode, we answer real, unfiltered questions from the CRO and experimentation community. We dig into how far AI can realistically help with experimentation, why revenue metrics like ARPU are a nightmare for MDE calculations, how to handle sketchy interview “audits,” and why ROI conversations never seem to end.No hype. No magic bullets. Just honest perspectives from people actually doing the work.Topics include:

    * Where AI helps (and quietly breaks) CRO workflows

    * How to think about MDEs for continuous metrics like ARPU

    * Making time for research when you’re already drowning

    * When “auditing a site” crosses into spec work

    * Volume hiring for CRO roles

    * Escaping (or not) the endless ROI loop

    * Why some CRO agencies don’t have designers

    Drop your own questions in the comments or check the links below to submit anonymously.- Ask us a question here: https://docs.google.com/forms/d/e/1FAIpQLSd8P5yCsO5NB6WPe204k1WExhH1Bs8w6nZxPRRn-BiAGozpaQ/viewform- Visit Koalatative here: https://www.youtube.com/@koalatative⏱️ Chapters00:00 – Intro & warm-up04:34 – How far can AI actually help in delivering CRO?11:19 – How do experimentation experts estimate MDE for continuous metrics like ARPU?15:28 – How do you make the most of research time when there’s no time to do anything?19:29 – How do you handle being asked to audit a site as part of a CRO interview?24:20 – How do you approach CRO in volume recruitment?28:21 – How do you get out of the endless ROI loop with stakeholders (and stop saying “CRO”)?31:46 – Why do some CRO agencies not have designers on the team?33:47 – Outro & announcements#cro #experimentation #abtesting #aiincro #growth #productmanagement #conversionrateoptimization #experimentationculture #careerintech #experimentationnation



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com
    Show more Show less
    35 mins
  • S6E5 - The Biggest Myths in A/B Testing (Why CRO Fails)
    Mar 23 2026

    A real conversation about why A/B testing doesn’t magically fix broken businesses.We break down the biggest CRO myths, why copying case studies fails, how experimentation tools really get chosen, and what actually causes friction between CRO, UX, and research teams.For CROs, experimenters, product, growth, UX, and analytics leaders.1:38 The biggest myth in A/B testing3:00 The one-person CRO team fallacy4:34 Why copying tests never works10:44 Choosing an experimentation platform14:39 Working with “difficult” clients



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com
    Show more Show less
    32 mins
No reviews yet