Yesterday Paywall A was showing a P2BB of 100%, meaning there is literally zero chance of it losing. Today Paywall B is showing a P2BB of 83%. How can a 100% probability flip to 17% like that overnight? Seems like it shouldn't display 100% until it gets enough data to be statistically accurate. I almost turned off the A/B test yesterday when I saw 100%. Glad I didn't.