May 14

How to Experiment on Your Product

You probably know by now that you should run experiments to test your product ideas early and often. But you may still be wondering exactly how to actually do the experiments. Here are some resources to help you structure your product experiments, from approaches that do not require coding to others that are an 11 on the rigorous scale.

A product manager’s guide to experimentation. Product Managers develop hypotheses on an almost daily basis. They develop hypotheses about new features, changes to UX, even the specific copy that best conveys to a customer what the customer should do next. Developing hypotheses without validating them can lead to some undesirable consequences. Alex Mitchell provides this guide to experimentation to explain:

  • why you should test
  • how to know the difference between a good test and a bad test
  • how to establish a testing culture in your organization.

(via @Amitch5903)

How to design high-impact product experiments. Running experiments is a valuable tool for product managers to validate ideas, de-risk releases and measure the impact of their work. Many good product teams still struggle with running experiments that are impactful to the business’ key results and help them advance their understanding of their users. To help you make better use of experiments, Negar Mokhtarnia tackles the principles that successful teams use to maximize their outcomes.

(via @pro_coalition)

Why you need to do more product experiments (and how to do them right). Product experiments can and will improve your customer activation rates, engagement levels, and ultimately user retention – so if you’re not doing them, you’re leaving money on the table.

In this blog, the folks from Userpilot show how product managers can design and run product experiments – without coding – to enhance user experience in a data-driven way.

(via @teamuserpilot)

The amazing value of early and cheap product experiments. It’s important to test your new product idea long before you feel ready. It’s also easy to feel uncomfortable about running experiments until you’ve done all the necessary due diligence. However the longer you wait to run tests, the more invested you are in the idea. Caroline Parnell describes some ways to test early product ideas cheaply and quickly.

(via @caroline8425)

A practical guide to product experimentation. You’ve seen all the explanations as to why you should do product experiments and some explanations of how product experiments work. Hungry for more details that would make your data scientist proud? Yifei Huang has your back. He provides this in-depth guide to structuring your product experiments including some specific procedures to analyze the results.

(via yifeihuangdatascience)

Kent J McDonald

About the author

Kent J McDonald writes about and practices software product management. He has product development experience in a variety of industries including financial services, health insurance, nonprofit, and automotive. Kent practices his craft with a variety of product teams and provides just in time resources for product people at and Product Collective. When not writing or product managing, Kent is his family’s #ubersherpa, listens to jazz and podcasts (but not necessarily podcasts about jazz), and collects national parks.


You may also like