Feature and Web Experiment Use Cases

This article helps you:

Understand the differences between Feature and Web Experiment

You can create experiments using either Feature Experiment or Web Experiment. Depending on your needs for any particular experiment and the results you want to generate, you'll select Feature or Web Experiment to design your experiment.

Feature Experiment use cases

Feature Experiment is most useful for Product experts, Data Engineering and Operations, and Data Analysts. These roles focus on deep knowledge of specific products or data repositories. Their goals are to:

Launch new products
Reduce risk
Analyze and report on data
Adhere to security and compliance requirements
Monitor performance
Ship code
Run complex models

Feature experimentation uses feature flags to create the variants you want. Flags are switches that let you modify your product's experience without having to change code. Use them to set up experiments in your product or to stage and roll out new features to your users. Your code uses the Amplitude Experiment SDK or APIs to communicate with Experiment. Typically, feature flags need a little more advanced knowledge of your code to successfully use them for experimentation. For more information on feature flags, go to Feature Flags.

Web Experiment use cases

Web Experiment is most useful for digital marketers and growth marketing. These roles focus on strategic changes to the existing functionality and design of your website. Their goals are to:

Optimize the website or the lifecycle of the product
Drive adoption
Personalization
Test hypotheses
Track key product insights (KPIs)
Upsell or cross-sell products

Web experimentation uses a visual editor to create variations of your web site. With the visual editor, you can select directly alter content or element properties. Web experiment lets less technical users, or users with fewer permissions in your system, create experiments without engineering resources. Web experiments use pages to control where your experiments variants apply on your website. This lets you scope experiments to specific URLs without affecting unrelated parts of your site. For more information on how to create experiments with the web editor, go to Setting up a Web Experiment.

For a full description of the functional differences between Feature and Web Experiment, go to Feature and Web Experiment Functional Comparison.