Overview

Amazon updated Manage Your Experiments with pre-selected settings, automatic test conclusion based on statistical significance, and auto-publishing of winning content. These changes streamline A/B testing setup and eliminate manual result application steps for brand-registered sellers.

Key Points

• Pre-Selected Optimal Settings — Default experiment configurations apply automatically, eliminating manual parameter configuration before test launch.
• Automatic Conclusion at Significance — Experiments end when statistical confidence is reached, rather than running for fixed duration regardless of results.
• Auto-Publish Winning Content — Winning listing content applies to product detail page automatically after test conclusion without manual intervention.
• Advanced Settings Toggle — Sellers can override defaults to manually adjust duration, traffic allocation, and other experiment parameters.

Setup and Duration Changes

• Simplified Test Creation — Sellers enter B-version content and click start without configuring duration, sample sizes, or conclusion criteria.
• Adaptive Test Duration — High-traffic listings may see results in days when clear winner emerges, low-traffic listings run longer for statistical confidence.
• Reduced Operational Bottleneck — Sellers running experiments across large catalogs no longer monitor each test individually to manually apply winning content.
• Two-Tier Approach — New users launch experiments immediately while power users retain full configuration flexibility via advanced toggle.

Seller Impact

• Start testing listing elements — Launch A/B tests on main images, titles, and A+ Content for your top 20 ASINs using the new defaults.
• Review auto-published content — Check MYE for experiments that concluded in past 30 days and verify winning variants went live correctly.
• Test more frequently — Run 2-3 experiments per ASIN per quarter on high-traffic listings instead of single fixed-duration test.