11

There are 2 types of Generalized Linear Models:
1. Log-Linear Regression, also known as Poisson Regression
2. Logistic Regression

How to implement the Poisson Regression in Python for Price Elasticity prediction?

11
  • 1
    Is this somewhat what you're looking for statsmodels.sourceforge.net/devel/glm.html? Also, way too broad. Jun 21, 2016 at 10:29
  • The link you shared has the "Poisson distribution". I was looking for "Poisson Regression". It is there in R, but how to implement it in Python ?
    – User456898
    Jun 21, 2016 at 10:33
  • 1
    I am not looking for Logistic Regression. Wanted to know about Log-Linear (Poisson) Regression in Python.
    – User456898
    Jun 21, 2016 at 10:37
  • @IljaEverilä sure logistic regression will help a lot in a poisson regression problem. Don't add comments that make no sense. Better stay silent
    – Altons
    Jun 21, 2016 at 10:46
  • @Altons that's true, removed. Jun 21, 2016 at 10:47

2 Answers 2

20

Have a look at the statmodels package in python.

Here is an example

A bit more of input to avoid the link only answer

Assumming you know python here is an extract of the example I mentioned earlier.

import numpy as np
import pandas as pd
from statsmodels.genmod.generalized_estimating_equations import GEE
from statsmodels.genmod.cov_struct import (Exchangeable,
    Independence,Autoregressive)
from statsmodels.genmod.families import Poisson

pandas will hold the data frame with the data you want to use to feed your poisson model. statsmodels package contains large family of statistical models such as Linear, probit, poisson etc. from here you will import the Poisson family model (hint: see last import)

The way you fit your model is as follow (assuming your dependent variable is called y and your IV are age, trt and base):

fam = Poisson()
ind = Independence()
model1 = GEE.from_formula("y ~ age + trt + base", "subject", data, cov_struct=ind, family=fam)
result1 = model1.fit()
print(result1.summary())

As I am not familiar with the nature of your problem I would suggest to have a look at negative binomial regression if you need to count data is well overdispersed. with High overdispersion your poisson assumptions may not hold.

Plethora of info for poisson regression in R - just google it.

Hope now this answer helps.

3
  • 2
    Sorry what is "subject" here?
    – famargar
    Mar 19, 2017 at 20:32
  • Is "subject" the dependent variable? Aug 16, 2017 at 12:05
  • Sorry I did not see these comments. "Subject" is a grouping variable. dependent variable is 'y'
    – Altons
    Mar 2, 2018 at 9:59
6

If I am not mistaken, @Altons' answer is for GEEs, which assume some sort of grouped structure. The common Poisson Regression (without a need for a group, such as "subject") is implemented as General Linear Model in statsmodels:

import patsy
import statsmodels as sm
from statsmodels.genmod.families import Poisson


fam = Poisson()
f = 'some_count ~ some_numeric_variable + C(some_categorical_variable)'
y, X = patsy.dmatrices(f, data, return_type='matrix')

p_model = sm.GLM(y, X, family=fam)

result = p_model.fit()
print(result.summary())

The variables used in the formula are just placeholders for variables in the DataFrame data.

4
  • when to use "C" and when not? is it to be used on label-encoded and one-hot encoded columns too? Nov 24, 2022 at 13:28
  • 1
    C should be used if the variable type is categorical. This is usually the case for label-encoded and one-hot variables.
    – Ben
    Nov 25, 2022 at 16:06
  • Thanks @Ben, can you point me to some documentation to learn more on writing these formulaes please?! Nov 28, 2022 at 7:14
  • For anyone new to the statsmodels package, make sure you change line 2 to "import statsmodels.api as sm". It will error without the ".api".
    – Sam
    Dec 5, 2022 at 22:22

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.