btyd.fitters#

btyd.fitters.beta_geo_beta_binom_fitter module#

Beta Geo Beta BinomFitter.

class btyd.fitters.beta_geo_beta_binom_fitter.BetaGeoBetaBinomFitter(penalizer_coef=0.0)#

Bases: BaseFitter

Also known as the Beta-Geometric/Beta-Binomial Model [1].

Future purchases opportunities are treated as discrete points in time. In the literature, the model provides a better fit than the Pareto/NBD model for a nonprofit organization with regular giving patterns.

The model is estimated with a recency-frequency matrix with n transaction opportunities.

Parameters:

penalizer_coef (float) – The coefficient applied to an l2 norm on the parameters

penalizer_coef#

The coefficient applied to an l2 norm on the parameters

Type:

float

params_#

The fitted parameters of the model

Type:
obj:

Series

data#

A DataFrame with the values given in the call to fit

Type:
obj:

DataFrame

variance_matrix_#

A DataFrame with the variance matrix of the parameters.

Type:
obj:

DataFrame

confidence_intervals_#

A DataFrame 95% confidence intervals of the parameters

Type:
obj:

DataFrame

standard_errors_#

A Series with the standard errors of the parameters

Type:
obj:

Series

summary#

A DataFrame containing information about the fitted parameters

Type:
obj:

DataFrame

References

conditional_expected_number_of_purchases_up_to_time(m_periods_in_future, frequency, recency, n_periods)#

Conditional expected purchases in future time period.

The expected number of future transactions across the next m_periods_in_future transaction opportunities by a customer with purchase history (x, tx, n).

\[E(X(n_{periods}, n_{periods}+m_{periods_in_future})| \alpha, \beta, \gamma, \delta, frequency, recency, n_{periods})\]

See (13) in Fader & Hardie 2010.

Parameters:

t (array_like) – time n_periods (n+t)

Returns:

predicted transactions

Return type:

array_like

conditional_probability_alive(m_periods_in_future, frequency, recency, n_periods)#

Conditional probability alive.

Conditional probability customer is alive at transaction opportunity n_periods + m_periods_in_future.

\[P(alive at n_periods + m_periods_in_future|alpha, beta, gamma, delta, frequency, recency, n_periods)\]

See (A10) in Fader and Hardie 2010.

Parameters:

m (array_like) – transaction opportunities

Returns:

alive probabilities

Return type:

array_like

expected_number_of_transactions_in_first_n_periods(n)#

Return expected number of transactions in first n n_periods.

Expected number of transactions occurring across first n transaction opportunities. Used by Fader and Hardie to assess in-sample fit.

\[Pr(X(n) = x| \alpha, \beta, \gamma, \delta)\]

See (7) in Fader & Hardie 2010.

Parameters:

n (float) – number of transaction opportunities

Returns:

Predicted values, indexed by x

Return type:

DataFrame

fit(frequency, recency, n_periods, weights=None, initial_params=None, verbose=False, tol=1e-07, index=None, **kwargs)#

Fit the BG/BB model.

Parameters:
  • frequency (array_like) – Total periods with observed transactions

  • recency (array_like) – Period of most recent transaction

  • n_periods (array_like) – Number of transaction opportunities. Previously called n.

  • weights (None or array_like) – Number of customers with given frequency/recency/T, defaults to 1 if not specified. Fader and Hardie condense the individual RFM matrix into all observed combinations of frequency/recency/T. This parameter represents the count of customers with a given purchase pattern. Instead of calculating individual log-likelihood, the log-likelihood is calculated for each pattern and multiplied by the number of customers with that pattern. Previously called n_custs.

  • verbose (boolean, optional) – Set to true to print out convergence diagnostics.

  • tol (float, optional) – Tolerance for termination of the function minimization process.

  • index (array_like, optional) – Index for resulted DataFrame which is accessible via self.data

  • kwargs – Key word arguments to pass to the scipy.optimize.minimize function as options dict

Returns:

fitted and with parameters estimated

Return type:

BetaGeoBetaBinomFitter

generate_new_data(size=1)#

btyd.fitters.beta_geo_fitter module#

Beta Geo Fitter, also known as BG/NBD model.

class btyd.fitters.beta_geo_fitter.BetaGeoFitter(penalizer_coef=0.0)#

Bases: BaseFitter

Also known as the BG/NBD model.

Based on [2]_, this model has the following assumptions:

  1. Each individual, i, has a hidden lambda_i and p_i parameter

  2. These come from a population wide Gamma and a Beta distribution respectively.

  3. Individuals purchases follow a Poisson process with rate lambda_i*t .

  4. After each purchase, an individual has a p_i probability of dieing (never buying again).

Parameters:

penalizer_coef (float) – The coefficient applied to an l2 norm on the parameters

penalizer_coef#

The coefficient applied to an l2 norm on the parameters

Type:

float

params_#

The fitted parameters of the model

Type:
obj:

Series

data#

A DataFrame with the values given in the call to fit

Type:
obj:

DataFrame

variance_matrix_#

A DataFrame with the variance matrix of the parameters.

Type:
obj:

DataFrame

confidence_intervals_#

A DataFrame 95% confidence intervals of the parameters

Type:
obj:

DataFrame

standard_errors_#

A Series with the standard errors of the parameters

Type:
obj:

Series

summary#

A DataFrame containing information about the fitted parameters

Type:
obj:

DataFrame

References

conditional_expected_number_of_purchases_up_to_time(t, frequency, recency, T)#

Conditional expected number of purchases up to time.

Calculate the expected number of repeat purchases up to time t for a randomly chosen individual from the population, given they have purchase history (frequency, recency, T).

This function uses equation (10) from [2]_.

Parameters:
  • t (array_like) – times to calculate the expectation for.

  • frequency (array_like) – historical frequency of customer.

  • recency (array_like) – historical recency of customer.

  • T (array_like) – age of the customer.

Return type:

array_like

References

“Counting Your Customers the Easy Way: An Alternative to the Pareto/NBD Model,” Marketing Science, 24 (2), 275-84.

conditional_probability_alive(frequency, recency, T)#

Compute conditional probability alive.

Compute the probability that a customer with history (frequency, recency, T) is currently alive.

From http://www.brucehardie.com/notes/021/palive_for_BGNBD.pdf

Parameters:
  • frequency (array or scalar) – historical frequency of customer.

  • recency (array or scalar) – historical recency of customer.

  • T (array or scalar) – age of the customer.

Returns:

value representing a probability

Return type:

array

conditional_probability_alive_matrix(max_frequency=None, max_recency=None)#

Compute the probability alive matrix.

Uses the conditional_probability_alive() method to get calculate the matrix.

Parameters:
  • max_frequency (float, optional) – the maximum frequency to plot. Default is max observed frequency.

  • max_recency (float, optional) – the maximum recency to plot. This also determines the age of the customer. Default to max observed age.

Returns:

A matrix of the form [t_x: historical recency, x: historical frequency]

Return type:

matrix

expected_number_of_purchases_up_to_time(t)#

Calculate the expected number of repeat purchases up to time t.

Calculate repeat purchases for a randomly chosen individual from the population.

Equivalent to equation (9) of [2]_.

Parameters:

t (array_like) – times to calculate the expection for

Return type:

array_like

References

“Counting Your Customers the Easy Way: An Alternative to the Pareto/NBD Model,” Marketing Science, 24 (2), 275-84.

fit(frequency, recency, T, weights=None, initial_params=None, verbose=False, tol=1e-07, index=None, **kwargs)#

Fit a dataset to the BG/NBD model.

Parameters:
  • frequency (array_like) – the frequency vector of customers’ purchases (denoted x in literature).

  • recency (array_like) – the recency vector of customers’ purchases (denoted t_x in literature).

  • T (array_like) – customers’ age (time units since first purchase)

  • weights (None or array_like) – Number of customers with given frequency/recency/T, defaults to 1 if not specified. Fader and Hardie condense the individual RFM matrix into all observed combinations of frequency/recency/T. This parameter represents the count of customers with a given purchase pattern. Instead of calculating individual loglikelihood, the loglikelihood is calculated for each pattern and multiplied by the number of customers with that pattern.

  • initial_params (array_like, optional) – set the initial parameters for the fitter.

  • verbose (bool, optional) – set to true to print out convergence diagnostics.

  • tol (float, optional) – tolerance for termination of the function minimization process.

  • index (array_like, optional) – index for resulted DataFrame which is accessible via self.data

  • kwargs – key word arguments to pass to the scipy.optimize.minimize function as options dict

Returns:

with additional properties like params_ and methods like predict

Return type:

BetaGeoFitter

generate_new_data(size=1)#
probability_of_n_purchases_up_to_time(t, n)#

Compute the probability of n purchases.

\[P( N(t) = n | \text{model} )\]

where N(t) is the number of repeat purchases a customer makes in t units of time.

Comes from equation (8) of [2]_.

Parameters:
  • t (float) – number units of time

  • n (int) – number of purchases

Returns:

Probability to have n purchases up to t units of time

Return type:

float

References

“Counting Your Customers the Easy Way: An Alternative to the Pareto/NBD Model,” Marketing Science, 24 (2), 275-84.

btyd.fitters.gamma_gamma_fitter module#

Gamma-Gamma Model.

class btyd.fitters.gamma_gamma_fitter.GammaGammaFitter(penalizer_coef=0.0)#

Bases: BaseFitter

Fitter for the gamma-gamma model.

It is used to estimate the average monetary value of customer transactions.

This implementation is based on the Excel spreadsheet found in [3]. More details on the derivation and evaluation can be found in [4].

Parameters:

penalizer_coef (float) – The coefficient applied to an l2 norm on the parameters

penalizer_coef#

The coefficient applied to an l2 norm on the parameters

Type:

float

params_#

The fitted parameters of the model

Type:
obj:

OrderedDict

data#

A DataFrame with the columns given in the call to fit

Type:
obj:

DataFrame

References

penalizer_coef#

The coefficient applied to an l2 norm on the parameters

Type:

float

params_#

The fitted parameters of the model

Type:
obj:

Series

data#

A DataFrame with the values given in the call to fit

Type:
obj:

DataFrame

variance_matrix_#

A DataFrame with the variance matrix of the parameters.

Type:
obj:

DataFrame

confidence_intervals_#

A DataFrame 95% confidence intervals of the parameters

Type:
obj:

DataFrame

standard_errors_#

A Series with the standard errors of the parameters

Type:
obj:

Series

summary#

A DataFrame containing information about the fitted parameters

Type:
obj:

DataFrame

conditional_expected_average_profit(frequency=None, monetary_value=None)#

Conditional expectation of the average profit.

This method computes the conditional expectation of the average profit per transaction for a group of one or more customers.

Equation (5) from: http://www.brucehardie.com/notes/025/

Parameters:
  • frequency (array_like, optional) – a vector containing the customers’ frequencies. Defaults to the whole set of frequencies used for fitting the model.

  • monetary_value (array_like, optional) – a vector containing the customers’ monetary values. Defaults to the whole set of monetary values used for fitting the model.

Returns:

The conditional expectation of the average profit per transaction

Return type:

array_like

customer_lifetime_value(transaction_prediction_model, frequency, recency, T, monetary_value, time=12, discount_rate=0.01, freq='D')#

Return customer lifetime value.

This method computes the average lifetime value for a group of one or more customers.

Parameters:
  • transaction_prediction_model (model) – the model to predict future transactions, literature uses pareto/ndb models but we can also use a different model like beta-geo models

  • frequency (array_like) – the frequency vector of customers’ purchases (denoted x in literature).

  • recency (the recency vector of customers' purchases) – (denoted t_x in literature).

  • T (array_like) – customers’ age (time units since first purchase)

  • monetary_value (array_like) – the monetary value vector of customer’s purchases (denoted m in literature).

  • time (float, optional) – the lifetime expected for the user in months. Default: 12

  • discount_rate (float, optional) – the monthly adjusted discount rate. Default: 0.01

  • freq (string, optional) – {“D”, “H”, “M”, “W”} for day, hour, month, week. This represents what unit of time your T is measure in.

Returns:

Series object with customer ids as index and the estimated customer lifetime values as values

Return type:

Series

fit(frequency, monetary_value, weights=None, initial_params=None, verbose=False, tol=1e-07, index=None, q_constraint=False, **kwargs)#

Fit the data to the Gamma/Gamma model.

Parameters:
  • frequency (array_like) – the frequency vector of customers’ purchases (denoted x in literature).

  • monetary_value (array_like) – the monetary value vector of customer’s purchases (denoted m in literature).

  • weights (None or array_like) – Number of customers with given frequency/monetary_value, defaults to 1 if not specified. Fader and Hardie condense the individual RFM matrix into all observed combinations of frequency/monetary_value. This parameter represents the count of customers with a given purchase pattern. Instead of calculating individual loglikelihood, the loglikelihood is calculated for each pattern and multiplied by the number of customers with that pattern.

  • initial_params (array_like, optional) – set the initial parameters for the fitter.

  • verbose (bool, optional) – set to true to print out convergence diagnostics.

  • tol (float, optional) – tolerance for termination of the function minimization process.

  • index (array_like, optional) – index for resulted DataFrame which is accessible via self.data

  • q_constraint (bool, optional) – when q < 1, population mean will result in a negative value leading to negative CLV outputs. If True, we penalize negative values of q to avoid this issue.

  • kwargs – key word arguments to pass to the scipy.optimize.minimize function as options dict

Returns:

fitted and with parameters estimated

Return type:

GammaGammaFitter

btyd.fitters.modified_beta_geo_fitter module#

class btyd.fitters.modified_beta_geo_fitter.ModifiedBetaGeoFitter(penalizer_coef=0.0)#

Bases: BetaGeoFitter

Also known as the MBG/NBD model.

Based on [5], [6], this model has the following assumptions: 1) Each individual, i, has a hidden lambda_i and p_i parameter 2) These come from a population wide Gamma and a Beta distribution

respectively.

  1. Individuals purchases follow a Poisson process with rate \(\lambda_i*t\) .

  2. At the beginning of their lifetime and after each purchase, an individual has a p_i probability of dieing (never buying again).

References

penalizer_coef#

The coefficient applied to an l2 norm on the parameters

Type:

float

params_#

The fitted parameters of the model

Type:
obj:

Series

data#

A DataFrame with the values given in the call to fit

Type:
obj:

DataFrame

variance_matrix_#

A DataFrame with the variance matrix of the parameters.

Type:
obj:

DataFrame

confidence_intervals_#

A DataFrame 95% confidence intervals of the parameters

Type:
obj:

DataFrame

standard_errors_#

A Series with the standard errors of the parameters

Type:
obj:

Series

summary#

A DataFrame containing information about the fitted parameters

Type:
obj:

DataFrame

conditional_expected_number_of_purchases_up_to_time(t, frequency, recency, T)#

Conditional expected number of repeat purchases up to time t.

Calculate the expected number of repeat purchases up to time t for a randomly choose individual from the population, given they have purchase history (frequency, recency, T) See Wagner, U. and Hoppe D. (2008).

Parameters:
  • t (array_like) – times to calculate the expectation for.

  • frequency (array_like) – historical frequency of customer.

  • recency (array_like) – historical recency of customer.

  • T (array_like) – age of the customer.

Return type:

array_like

conditional_probability_alive(frequency, recency, T)#

Conditional probability alive.

Compute the probability that a customer with history (frequency, recency, T) is currently alive. From https://www.researchgate.net/publication/247219660_Empirical_validation_and_comparison_of_models_for_customer_base_analysis Appendix A, eq. (5)

Parameters:
  • frequency (array or float) – historical frequency of customer.

  • recency (array or float) – historical recency of customer.

  • T (array or float) – age of the customer.

Returns:

value representing probability of being alive

Return type:

array

expected_number_of_purchases_up_to_time(t)#

Return expected number of repeat purchases up to time t.

Calculate the expected number of repeat purchases up to time t for a randomly choose individual from the population.

Parameters:

t (array_like) – times to calculate the expectation for

Return type:

array_like

fit(frequency, recency, T, weights=None, initial_params=None, verbose=False, tol=1e-07, index=None, **kwargs)#

Fit the data to the MBG/NBD model.

Parameters:
  • frequency (array_like) – the frequency vector of customers’ purchases (denoted x in literature).

  • recency (array_like) – the recency vector of customers’ purchases (denoted t_x in literature).

  • T (array_like) – customers’ age (time units since first purchase)

  • weights (None or array_like) – Number of customers with given frequency/recency/T, defaults to 1 if not specified. Fader and Hardie condense the individual RFM matrix into all observed combinations of frequency/recency/T. This parameter represents the count of customers with a given purchase pattern. Instead of calculating individual log-likelihood, the log-likelihood is calculated for each pattern and multiplied by the number of customers with that pattern.

  • verbose (bool, optional) – set to true to print out convergence diagnostics.

  • tol (float, optional) – tolerance for termination of the function minimization process.

  • index (array_like, optional) – index for resulted DataFrame which is accessible via self.data

  • kwargs – key word arguments to pass to the scipy.optimize.minimize function as options dict

Returns:

With additional properties and methods like params_ and predict

Return type:

ModifiedBetaGeoFitter

generate_new_data(size=1)#
probability_of_n_purchases_up_to_time(t, n)#

Compute the probability of n purchases up to time t.

\[P( N(t) = n | \text{model} )\]

where N(t) is the number of repeat purchases a customer makes in t units of time.

Parameters:
  • t (float) – number units of time

  • n (int) – number of purchases

Returns:

Probability to have n purchases up to t units of time

Return type:

float

btyd.fitters.pareto_nbd_fitter module#

Pareto/NBD model.

class btyd.fitters.pareto_nbd_fitter.ParetoNBDFitter(penalizer_coef=0.0)#

Bases: BaseFitter

Pareto NBD fitter [7].

Parameters:

penalizer_coef (float) – The coefficient applied to an l2 norm on the parameters

penalizer_coef#

The coefficient applied to an l2 norm on the parameters

Type:

float

params_#

The fitted parameters of the model

Type:
obj:

OrderedDict

data#

A DataFrame with the columns given in the call to fit

Type:
obj:

DataFrame

References

conditional_expected_number_of_purchases_up_to_time(t, frequency, recency, T)#

Conditional expected number of purchases up to time.

Calculate the expected number of repeat purchases up to time t for a randomly choose individual from the population, given they have purchase history (frequency, recency, T).

This is equation (41) from: http://brucehardie.com/notes/009/pareto_nbd_derivations_2005-11-05.pdf

Parameters:
  • t (array_like) – times to calculate the expectation for.

  • frequency (array_like) – historical frequency of customer.

  • recency (array_like) – historical recency of customer.

  • T (array_like) – age of the customer.

Return type:

array_like

conditional_probability_alive(frequency, recency, T)#

Conditional probability alive.

Compute the probability that a customer with history (frequency, recency, T) is currently alive.

Section 5.1 from (equations (36) and (37)): http://brucehardie.com/notes/009/pareto_nbd_derivations_2005-11-05.pdf

Parameters:
  • frequency (float) – historical frequency of customer.

  • recency (float) – historical recency of customer.

  • T (float) – age of the customer.

Returns:

value representing a probability

Return type:

float

conditional_probability_alive_matrix(max_frequency=None, max_recency=None)#

Compute the probability alive matrix.

Builds on the conditional_probability_alive() method.

Parameters:
  • max_frequency (float, optional) – the maximum frequency to plot. Default is max observed frequency.

  • max_recency (float, optional) – the maximum recency to plot. This also determines the age of the customer. Default to max observed age.

Returns:

A matrix of the form [t_x: historical recency, x: historical frequency]

Return type:

matrix

conditional_probability_of_being_alive_up_to_time(t, frequency, recency, T)#

Conditional probability of being alive up to time T+t.

Compute the probability that a customer with history (frequency, recency, T) is still alive up to time T+t, given they have

purchase history (frequency, recency, T).

From paper: http://www.brucehardie.com/notes/015/additional_pareto_nbd_results.pdf

Parameters:
  • t (int) – time up to which probability should be calculated.

  • frequency (float) – historical frequency of customer.

  • recency (float) – historical recency of customer.

  • T (float) – age of the customer.

Returns:

value representing a probability

Return type:

float

conditional_probability_of_n_purchases_up_to_time(n, t, frequency, recency, T)#

Return conditional probability of n purchases up to time t.

Calculate the probability of n purchases up to time t for an individual with history frequency, recency and T (age).

The main equation being implemented is (16) from: http://www.brucehardie.com/notes/028/pareto_nbd_conditional_pmf.pdf

Parameters:
  • n (int) – number of purchases.

  • t (a scalar) – time up to which probability should be calculated.

  • frequency (float) – historical frequency of customer.

  • recency (float) – historical recency of customer.

  • T (float) – age of the customer.

Return type:

array_like

expected_number_of_purchases_up_to_time(t)#

Return expected number of repeat purchases up to time t.

Calculate the expected number of repeat purchases up to time t for a randomly choose individual from the population.

Equation (27) from: http://brucehardie.com/notes/009/pareto_nbd_derivations_2005-11-05.pdf

Parameters:

t (array_like) – times to calculate the expectation for.

Return type:

array_like

fit(frequency, recency, T, weights=None, iterative_fitting=1, initial_params=None, verbose=False, tol=0.0001, index=None, fit_method='Nelder-Mead', maxiter=2000, **kwargs)#

Pareto/NBD model fitter.

Parameters:
  • frequency (array_like) – the frequency vector of customers’ purchases (denoted x in literature).

  • recency (array_like) – the recency vector of customers’ purchases (denoted t_x in literature).

  • T (array_like) – customers’ age (time units since first purchase)

  • weights (None or array_like) – Number of customers with given frequency/recency/T, defaults to 1 if not specified. Fader and Hardie condense the individual RFM matrix into all observed combinations of frequency/recency/T. This parameter represents the count of customers with a given purchase pattern. Instead of calculating individual log-likelihood, the log-likelihood is calculated for each pattern and multiplied by the number of customers with that pattern.

  • iterative_fitting (int, optional) – perform iterative_fitting fits over random/warm-started initial params

  • initial_params (array_like, optional) – set the initial parameters for the fitter.

  • verbose (bool, optional) – set to true to print out convergence diagnostics.

  • tol (float, optional) – tolerance for termination of the function minimization process.

  • index (array_like, optional) – index for resulted DataFrame which is accessible via self.data

  • fit_method (string, optional) – fit_method to passing to scipy.optimize.minimize

  • maxiter (int, optional) – max iterations for optimizer in scipy.optimize.minimize will be overwritten if set in kwargs.

  • kwargs – key word arguments to pass to the scipy.optimize.minimize function as options dict

Returns:

with additional properties like params_ and methods like predict

Return type:

ParetoNBDFitter

generate_new_data(size=1)#

Base fitter for other classes.

class btyd.fitters.BaseFitter#

Bases: object

Base class for fitters.

load_model(path)#

Load model with dill package.

Parameters:

path (str) – From what path load model.

save_model(path, save_data=True, values_to_save=None)#

Save model with dill package.

Parameters:
  • path (str) – Path where to save model.

  • save_data (bool, optional) – Whether to save data from fitter.data to pickle object

  • values_to_save (list, optional) – Placeholders for original attributes for saving object. If None will be extended to attr_list length like [None] * len(attr_list)

property summary#

Summary statistics describing the fit.

Returns:

df – Contains columns coef, se(coef), lower, upper

Return type:

pd.DataFrame

See also

print_summary