Dimensional Analysis

To exclude QA users or internal traffic that doesn't represent your customer base and may skew results, use Dimensional Analysis. Amplitude's Dimensional Analysis capabilities let you exclude defined user groups from analysis on a per-experiment basis.

Define your testers

In Feature Experiment, use the Inclusions section to define your test users.

Add users by User ID or Device ID, or by using a cohort. Amplitude assigns each test user a variant, and that variant determines the experience when the user interacts with the experiment.

Filter test users

To remove QA users or internal traffic from analysis, filter them out before reviewing results.

Select the All exposed users dropdown and choose Exclude testers.

If you select multiple targeting segments, analyze each segment individually, because one segment may show a lift that others don't. Select the segment name in the All Users dropdown. Selecting a segment also filters test users from your analysis.

Investigating specific user segments can reveal additional insight. Experiments that aren't statistically significant overall can contain a small group of users for which the result is statistically significant. Likewise, for statistically significant results, small user segments can drive the performance of the experiment.