Statistics - A/B (Test|Testing)

Card Puncher Data Processing


A/B Null Hypothesis test

  • set up multiple copies of the website,
  • redirect users randomly to each copies via 307 status
  • measure which design improves the target the most.


  1. Gather Samples
  2. Assign Buckets
  3. Apply Treatments
  4. Measure Outcomes
  5. Make Comparisons.


Documentation / Reference

Recommended Pages
Card Puncher Data Processing
Ad - Urchin Tracking Module (UTM) - or Campaign Parameters

Urchin Tracking Module (UTM) are tracking information added to an URL and are also known as campaign parameters. Tag your ads, emails and social media posts with UTM tags and analyze your ecommerce...
Chrome Cookies
HTTP - Cookie (Set-Cookie Header )

A cookie is a key-value data and some associated It is: set: by the server side with a HTTP response and the Set-Cookie header and eventually on a client side with the browser web api stored...
Http Status 304 Chrome Devtool
HTTP - Redirect (status codes 3xx) - Client must take additional action

The HTTP 3xx class of status code indicates that the client (user or user agent) must take additional action to complete the request. The redirect url is defined by the location header. A user agent...
Card Puncher Data Processing
Software Design - (Fault Tolerance|Resilience)

Fault tolerance (or resilience) is the ability to recover from errors (fault), regardless of whether those errors resulted from: hardware issues, software issues, general systems issues (network...
Statistics Uniform Distribution Groups
Statistics - (Scientific) Control (Group)

Controls would show you things that have happened that should have not happened or things that didn't happened that should have happened. The first is called negative controls and the second is called...
Time Series - Breakout detection

Breakout occurs in time series data and have two characteristics: A Mean shift: A sudden jump in the time series corresponds to a mean shift. A sudden jump in CPU utilization from 40% to 60% would exemplify...
Basket Analysis Joke
Web Analytics - Page views (PV)

id The unique ID of the page or screen call itself received_at When the page or screen call was received sent_at When the page or screen call was triggered by the user a collaborative recommandation...

Share this page:
Follow us:
Task Runner