Feature flags and A/B testing

A/B testing on the server: the page doesn't flicker like with client-side testing tools, and visitors without JavaScript take part as well.

A guard gives each visitor a random id in a signed cookie. A hash of this id decides which variant of the experiment the visitor sees and which features are turned on.

Variant A

A coffee grinder for every kitchen

Conical burrs, 40 grind settings and a quiet motor.

Your assignment

Visitor id VWXmvLZjy01K998LpaTWMA sees variant A. to get a new id, and maybe another variant.

FlagRolloutYour bucketStatePreview
banner
Shows a banner about a new feature.
50%
82offTurn on
reviews
Shows customer reviews below the product.
20%
26offTurn on
checkout
A new checkout which isn't finished yet.
0%
78offTurn on

A flag is on if your bucket (0 to 99) is below its rollout. Raising the rollout from 20% to 50% keeps it on for everyone who had it before. Preview links turn a flag on for one request, e.g. for testers.

Results

VariantHeadlineVisitorsBoughtRate
AA coffee grinder for every kitchen100.0%
BFresh coffee, ground in seconds000.0%

Each visitor counts once per column. The counts live in memory and start over when the server restarts.