Skip to content
This repository was archived by the owner on Jul 28, 2025. It is now read-only.

Latest commit

History

28 Commits

Folders and files

NameName
Last commit message
Last commit date

Repository files navigation

Documentation Status

MIXpanel Bayesian AB test Analysis tool (MixBABA)

This tool is intended to consume a JSON file containing details about a Mixpanel funnel and output the results of the analysis made whithin a Bayesian framework.

You can find details about the data processing here.

Installation

From PyPi

Just easy as:

pip install mixbaba

From sources

To install this package you have to clone the repository:

git clone https://github.com/NaturalCycles/MixBABA.git

You can run the unit tests, to ensure the tool will work:

cd MixBABA python setup.py test

And then you can install the tool via PIP:

pip install .

Usage

You can find the full documentation here, but if you want a short guide read the following.

To use MixBABA you have need:

  • a JSON file containing a list of the funnels together with the details about them (an example is in this repository)
  • the "API secret" to connect to Mixpanel; You can find your one in the settings dialog of the Mixpanel web application.

Then you can launch the analysis via command line:

mixbaba -f [funnel_file.json] -k [API secret]

The tool will extract the data relative to the funnel from Mixpanel, and the output will be put in the same directory as CSV files, as many as the funnels specified in the JSON file given in input.

By default no output will be sent to the console. If you want a CSV file as output you can ask it with

mixbaba -f [funnel_file.json] -k [API secret] -o csv

Example result

This is the standard output format for the analysis of a funnel

GroupControl ImpressionsControl Conversionstest Impressionstest Conversionstest CR improvementtest Probability
All.All34164253311052840.2323870.992551
goal.PREVENT6175256016370.5001530.947624
goal.PLAN15615141150.1061570.568093
$country_code.US16631224154382420.1634480.95048
$country_code.SE8024237275350.6543910.974175

Or, if you specify the option -of long at the command launch:

DiscriminantCohortCommentControl ImpressionsControl Conversionstest Impressionstest Conversionstest CR improvementtest Probability
NoneAllResult for test is OK!34164253311052840.2323870.992551
user.goalPREVENTResult for test is uncertain.6175256016370.5001530.947624
user.goalPLANResult for test is uncertain.15615141150.1061570.568093
user.$country_codeUSResult for test is OK!16631224154382420.1634480.95048
user.$country_codeSEResult for test is OK!8024237275350.6543910.974175

About

A tool for making AB tests with Mixpanel API

Topics

Resources

Stars

12 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages