Ben talks with Lyndsi Lee, UX Manager at Turnitin, about moving beyond traditional metrics like NPS and CSAT to measure user experiences more effectively. 

The conversation centers on outcome-based assessment, a framework that breaks user experiences into atomic outcomes. Rather than asking broad satisfaction questions, this approach focuses on specific user goals like "users can complete repetitive tasks without friction." Lyndsi explains how teams can identify these outcomes through existing research and customer feedback, then prioritize them using methods like card sorting with actual users. 

The framework helps product teams move away from vague directives and toward specific, measurable improvements that directly impact user success. This episode offers practical guidance for researchers and product teams struggling to demonstrate impact beyond traditional satisfaction scores.

• Amazon Prime article

Highlights

• 13:49 Complicated Opinion on NPS and CSAT
• 18:51 Outcome Based Assessment Framework
• 27:36 Getting Strategic with Stakeholder Buy-in
• 32:00 Traffic Light System for Stakeholders
• 38:57 Revisiting Outcome Statements Timeline
• 41:40 AI's Role in Quantitative Research

About Lyndsi
Lyndsi is a Senior Manager of UX Research at Turnitin, where she leads efforts to make the student and educator experience more meaningful, measurable, and user-centered. She started her career in public education as a school counselor and School Psychological Examiner, working alongside educators to support students’ learning needs. Eventually, she found her way into UX research, where she combined her love of psychology, education, and technology. Lyndsi is passionate about helping teams stay focused on what truly matters to users, and firmly believes that good research is part art, part science, and part really well-organized sticky notes.

Resources

• Defining UX Success Metrics
• UX ROI Calculator
• Getting Started with Analytics

Ben is joined by Shalin Pei, Head of Design and Research and Natalie Golub, Head of UXR , both from Coinbase's Base product. Base is part of the crypto space, functioning as a network that offers secure and low cost ways to build decentralized apps, essentially helping create what they call the new internet.

The conversation reveals how their small but mighty teams operate in one of the fastest moving industries. Shalin and Natalie share how they've weaved internal stakeholders with customers, played with their structure to maximize visibility and effectiveness, and enabled partners to get more involved. It's a practical conversation on the value of experimentation, cooperation, and building influence.

Highlights

• 14:00 Overcoming Impostor Syndrome in New Industries
• 25:37 Embedded Research in Live Design Sprints
• 32:33 The Power of Cross-Functional Collaboration
• 36:21 Documentation Challenges in Fast-Moving Industries
• 40:39 Partner-Led Research Methodology
• 43:33 Future of AI in Design and Research

Resources

• The Designer's Guide to Research
• Aligning Research for More ROI
• Effective Product <> Research Collaboration

Erin is joined by Samira Jain, Serena Hillman, and Jackie Ianni from Microsoft Azure Data to discuss how they built the Swift Research Lab over the past two years. The team shares their systematic five-step approach for creating research programs that result in stakeholder satisfaction while delivering insights every 1.5 weeks.

The Azure Data team also break down their method for fostering relationships, building infrastructure and templates, measuring success, and continuously iterating. The discussion reveals how clear branding, stakeholder collaboration, and systematic infrastructure helped them action on high priority research requests while spotting cross cutting insights across Microsoft's product ecosystem.

About Our Guests
Dr. Serena Hillman is a Principal UX Research Manager in Azure Data at Microsoft. Her work focuses on Human-Data and Human-AI-Data Interaction, leading a team that explores how people engage with data and intelligent systems. She has studied user behavior across domains like video games, e-commerce, edTech, and enterprise cloud tools, and has published 40+ peer-reviewed papers presented at leading conferences and organizations including CHI, CSCW, Grace Hopper, Yahoo!, and Google.

Samira Jain is a Senior UX Researcher on the Azure Data UX Team, where she has been for over five years. She leads SWIFT, a cross-team research program, which encompasses several key initiatives. With a foundation in product design, she brings dual fluency to her research practice—understanding why things matter from a user perspective and how they can be shaped from a design perspective. With extensive experience in both non-profit and enterprise research, Samira is dedicated to enhancing experiences for data professionals.

Jackie Ianni is a UX Researcher on the Azure Data team at Microsoft, specializing in rapid evaluative and programmatic research. Before joining Microsoft, she worked as a researcher at both an agency and in-house, conducting global financial services research. Jackie is passionate about advancing UX research practice, exploring AI tools, and sparking conversations about the evolving role of research.

Highlights

• 05:47 Five Step Program Development Method
• 09:02 Building Stakeholder Relationships
• 15:39 Continuously Improving Research Programs
• 18:37 Cross Product Insights and Breaking Silos
• 23:24 Collaborative Team Success Formula
• 33:58 AI Tools in Heuristic Reviews

Resources

1. Building a UX Research Team from Scratch
2. Create Long Term Impact with Strong Relationships
3. The Ultimate Guide to UX Research Strategy

Ben sits down with Jake Burghardt from Integrating Research to discuss his new book Stop Wasting Research and how organizations can maximize the product impact of their customer insights. Jake breaks down the critical problem of research waste, where valuable insights from studies get left behind instead of informing future decisions and planning cycles.

Jake introduces his framework of three root causes driving research waste: preparation, motivation, and integration. He emphasizes practical solutions like creating insight summaries with stakeholders, building cross-silo research communities, and establishing recurring touchpoints beyond traditional study deliverables. The conversation covers actionable strategies for researchers at all levels, from individual contributors looking to extend their impact to research leaders building organizational initiatives that elevate research as a collective stakeholder voice.

Highlights

• 08:15 Defining research waste and value
• 14:48 Identifying research waste in organizations
• 21:36 Breaking down research silos
• 30:21 Creating insight summary statements
• 37:38 Integration and recurring stakeholder touchpoints
• 42:52 Building research initiatives not individual efforts

Resources

1. Conducting Better Stakeholder Interviews
2. The 2025 State of Research Strategy Report
3. The Research ROI & Impact Calculator

The popularity of AI moderation tools, increased attention on "big" data sets (and streams), and the ongoing uncertainty in the research job market have (understandably) led some to wonder about the future of qualitative research. Our guest today, however, is bullish, and explains why.

Nancy Baum leads the qualitative research practice at C+R Research. She has nearly 20 years' experience in the field, exposing her to many ebbs and flows. Nancy believes that qualitative practitioners are vital to sifting through the mounds of data, information, and competing interests flooding many companies' attention. Focusing on and uncovering the "Why?" and "How?" still matters today.

Listen to learn ways to advocate for qual research, what Nancy thinks of AI-moderation, and how she's developing new researchers.

Highlights

• 09:19 How stakeholders misunderstand qualitative research
• 22:46 AI moderation complements quantitative surveys
• 32:32 Customizing deliverables for stakeholder impact
• 41:09 Flexibility navigates unpredictable human conversations
• 47:49 Deep listening trumps active listening
• 50:26 Early stakeholder conversations secure research value

Resources

• Try our qualitative sample size calculator
• The best qualitative research tools in 2025
• Qual vs. quant vs. mixed method approaches

In just ten years, ResearchOps has transformed from an obscure Silicon Valley speciality into a vibrant global profession. Despite economic headwinds, ResearchOps roles are emerging across industries far beyond tech, and the field is evolving at breathtaking speed. But where have we come from, and where are we going?

In this five-part audio documentary, we’re exploring the past, present, and future of ResearchOps—and it’s exciting, fascinating, and, at times, pretty mindblowing stuff! Each episode features the voices of Cha Cha Club members, senior research leaders, and the smart minds behind User Interviews.

In this fifth and final—”awwww”, we hear you say—episode of ResearchOps 2.0, we’re turning the spotlight on the people of ResearchOps: the curious minds, problem-solvers, and system-builders who’ve made this profession what it is today. We’ll explore who they are, where they’ve come from, and what drives them to transform how organisations learn from their users.

If you’re a ResearchOps professional, this episode will make you feel seen and heard. If you’re a leader looking to hire a ResearchOps role, this episode will help you think differently about who might hire. And if you’re looking to transition into a ResearchOps career, this episode will give you a great sense of the skills you need and the incredible profession you’ll become a part of.

In just ten years, ResearchOps has transformed from an obscure Silicon Valley speciality into a vibrant global profession. Despite economic headwinds, ResearchOps roles are emerging across industries far beyond tech, and the field is evolving at breathtaking speed. But where have we come from, and where are we going?

In this five-part audio documentary, we’re exploring the past, present, and future of ResearchOps—and it’s exciting, fascinating, and, at times, pretty mindblowing stuff! Each episode features the voices of Cha Cha Club members, senior research leaders, and the smart minds behind User Interviews.

In this fourth and penultimate episode of ResearchOps 2.0, we’re exploring a timely topic: how to build enduring research systems even when change seems to be the order of the day—every day. You’ll hear top tips from experts who’ve managed to ride the winds of change to deliver successful, responsive research operations.

In just ten years, ResearchOps has transformed from an obscure Silicon Valley speciality into a vibrant global profession. Despite economic headwinds, ResearchOps roles are emerging across industries far beyond tech, and the field is evolving at breathtaking speed. But where have we come from, and where are we going?

In this five-part audio documentary, we’re exploring the past, present, and future of ResearchOps—and it’s exciting, fascinating, and, at times, pretty mindblowing stuff! Each episode features the voices of Cha Cha Club members, senior research leaders, and the smart minds behind User Interviews—the only solution you need to recruit high-quality participants for any kind of research.

In this third episode, we’re diving deep into what taking a platform approach to ResearchOps means and why research platforms are a pivotal part of the future of ResearchOps.

To scale up; tune in.

Erin May sits down with Larry Becker and Gavin Lew of Bold Insight to explore how researchers can prototype AI experiences that don't exist yet. They're joined by Katie Johnson, Global Head of Research for Panasonic Well. All share their methods for testing everything from voice interfaces for blind users to family wellness bots using low fidelity simulation techniques.

⭐️ Larry, Katie, and Gavin are presenting their work at EPIC 2025 in Helsinki ⭐️

The conversation reveals how AI research requires new approaches beyond traditional usability testing. Katie explains her work simulating family interactions with AI assistants, where researchers act as human filters for LLM responses to study relationship building over time. The team demonstrates how even small changes in AI personality can be detected by users, highlighting the sensitivity of human-AI relationships.

Gavin emphasizes the critical importance of getting AI right from the first interaction, unlike traditional MVP approaches. When AI fails to understand or respond appropriately, users often abandon it permanently, making prototype research essential for building trust before launch. The discussion provides practical frameworks for researchers working with emerging AI technologies and the evolving methods needed to understand human-AI interactions.

Highlights

• [06:25] Prototyping AI experiences mindset
• [20:53] Human simulation in AI prototyping
• [31:15] Human vs bot detection challenges
• [38:52] Context interaction and trust framework
• [49:33] Team collaboration in groundbreaking research
• [51:27] Trust themes in AI development

Resources

1. The State of User Research 2025
2. AI For User Research 101 Course
3. 20+ AI Tools for User Researchers

In just 10 years, ResearchOps has transformed from an obscure Silicon Valley speciality into a vibrant global profession. Despite economic headwinds, ResearchOps roles are emerging across industries far beyond tech, and the field is evolving at breathtaking speed. But where has it come from, and where is it going?

In this five-part audio documentary series, Kate Towsey of Cha Cha Club explores the past, present, and, most important of all, the future of ResearchOps. Each episode features the voices of Cha Cha Club members, senior research leaders, and the smart minds behind User Interviews.

In this episode, we’ll explore how ResearchOps professionals are approaching AI today and what the future holds. Expect several unique case studies, as well as mind-blowing, not-so-futurist concepts. (Hint: Never mind AI research moderators. What about AI as genuine research participants?)

Credits
Production, narration, and audio engineering by Kate Towsey. Co-produced with Cha Cha Club manager, Glenn Familton, and ResearchOps experts, Jenna Lombardo and Renato Venter. Aria, the robotic voice, was generated by Soundly. Music and (most) sound effects featured in this episode were sourced from Epidemic Sound. Explore music and sounds via this playlist.

In just 10 years, ResearchOps has transformed from an obscure Silicon Valley speciality into a vibrant global profession. Despite economic headwinds, ResearchOps roles are emerging across industries far beyond tech, and the field is evolving at breathtaking speed. But where has it come from, and where is it going?

In this five-part audio documentary series, Kate Towsey of Cha Cha Club explores the past, present, and, most important of all, the future of ResearchOps. Each episode features the voices of Cha Cha Club members, senior research leaders, and the smart minds behind User Interviews. This episode features insights from User Interviews Co-Founders Basel Fakhoury and Dennis Meng, as well as CMO Erin May.

Credits
Production, narration, and audio engineering by Kate Towsey. Co-produced with Cha Cha Club manager, Glenn Familton, and ResearchOps experts, Jenna Lombardo and Renato Venter. Aria, the robotic voice, was generated by Soundly. Music and (most) sound effects featured in this episode were sourced from Epidemic Sound. Explore music and sounds via this playlist.