I have a column in python pandas
DataFrame that has boolean True
/False
values, but for further calculations I need 1
/0
representation. Is there a quick pandas
/numpy
way to do that?
-
2What further calculations are required?– Jon ClementsJun 29, 2013 at 17:58
-
1To parrot @JonClements, why do you need to convert bool to int to use in calculation? bool works with arithmetic directly (since it is internally an int).– cs95Jul 14, 2020 at 2:09
-
2@cs95 - Pandas uses numpy bools internally, and they can behave a little differently. In plain Python, True + True = 2, but in Pandas, numpy.bool_(True) + numpy.bool_(True) = True, which may not be the desired behavior on your particular calculation.– sql_knievelJan 19, 2022 at 19:57
-
1I needed it because statsmodels would not allow boolean data for logistic regression.– Peter BAug 18, 2022 at 2:12
9 Answers
A succinct way to convert a single column of boolean values to a column of integers 1 or 0:
df["somecolumn"] = df["somecolumn"].astype(int)
-
31The corner case is if there are NaN values in
somecolumn
. Usingastype(int)
will then fail. Another approach, which convertsTrue
to 1.0 andFalse
to 0.0 (floats) while preserving NaN-values is to do:df.somecolumn = df.somecolumn.replace({True: 1, False: 0})
– DustByteJan 10, 2020 at 11:29 -
-
1
-
if the value is text and a lowercase "true" or "false" then first do a astype(bool].astype(int) and the conversion will work. Sas outputs is bools as lowercase true and false. Sep 29, 2020 at 11:03
-
Just multiply your Dataframe by 1 (int)
[1]: data = pd.DataFrame([[True, False, True], [False, False, True]])
[2]: print data
0 1 2
0 True False True
1 False False True
[3]: print data*1
0 1 2
0 1 0 1
1 0 0 1
-
1
-
6
-
2@AMC if your dataframe has
float
types beside booleans this method won't ruin them,df.astype(int)
does. And since it's hacky it's probably a good idea to make intention clear with comment like# bool -> int
. Feb 17, 2021 at 18:42 -
2There is an advantage of using
data * 1
againstdata + 0
with mixed types – it works on strings as well, wheredata + 0
throws an error. Equivalent performance-wise. Feb 17, 2021 at 18:56 -
True
is 1
in Python, and likewise False
is 0
*:
>>> True == 1
True
>>> False == 0
True
You should be able to perform any operations you want on them by just treating them as though they were numbers, as they are numbers:
>>> issubclass(bool, int)
True
>>> True * 5
5
So to answer your question, no work necessary - you already have what you are looking for.
* Note I use is as an English word, not the Python keyword is
- True
will not be the same object as any random 1
.
-
2Just be careful with data types if doing floating point math:
np.sin(True).dtype
is float16 for me.– jorgecaJun 29, 2013 at 18:09 -
9I've got a dataframe with a boolean column, and I can call
df.my_column.mean()
just fine (as you imply), but when I try:df.groupby("some_other_column").agg({"my_column":"mean"})
I getDataError: No numeric types to aggregate
, so it appears they are NOT always the same. Just FYI. Dec 15, 2016 at 21:10 -
In pandas version 24 (and maybe earlier) you can aggregate
bool
columns just fine. Feb 11, 2019 at 22:09 -
1It looks like numpy also throws errors with boolean types:
TypeError: numpy boolean subtract, the
-` operator, is deprecated, use the bitwise_xor, the^
operator, or the logical_xor function instead.` Using @User's answer fixes this. Mar 13, 2019 at 16:01 -
1Another reason it's not the same: df.col1 + df.col2 + df.col3 doesn't work for
bool
columns as it does forint
columns May 24, 2019 at 21:55
This question specifically mentions a single column, so the currently accepted answer works. However, it doesn't generalize to multiple columns. For those interested in a general solution, use the following:
df.replace({False: 0, True: 1}, inplace=True)
This works for a DataFrame that contains columns of many different types, regardless of how many are boolean.
You also can do this directly on Frames
In [104]: df = DataFrame(dict(A = True, B = False),index=range(3))
In [105]: df
Out[105]:
A B
0 True False
1 True False
2 True False
In [106]: df.dtypes
Out[106]:
A bool
B bool
dtype: object
In [107]: df.astype(int)
Out[107]:
A B
0 1 0
1 1 0
2 1 0
In [108]: df.astype(int).dtypes
Out[108]:
A int64
B int64
dtype: object
Use Series.view
for convert boolean to integers:
df["somecolumn"] = df["somecolumn"].view('i1')
You can use a transformation for your data frame:
df = pd.DataFrame(my_data condition)
transforming True/False in 1/0
df = df*1
-
1
I had to map FAKE/REAL to 0/1 but couldn't find proper answer.
Please find below how to map column name 'type' which has values FAKE/REAL to 0/1
(Note: similar can be applied to any column name and values)
df.loc[df['type'] == 'FAKE', 'type'] = 0
df.loc[df['type'] == 'REAL', 'type'] = 1
-
1Much simpler:
df['type'] = df['type'].map({'REAL': 1, 'FAKE': 0})
. In any case, I'm not sure it's too relevant to this question.– AMCNov 18, 2020 at 1:29 -
Thanks for providing simpler solution. As I mentioned in answer, I was trying to find solution for slightly different question, and only similar questions like this were available. Hope my answer and your solution will help someone in future.– kaishuNov 26, 2020 at 15:59
-
There are other questions which already cover that, though, like stackoverflow.com/q/20250771.– AMCNov 26, 2020 at 21:27
This is a reproducible example based on some of the existing answers:
import pandas as pd
def bool_to_int(s: pd.Series) -> pd.Series:
"""Convert the boolean to binary representation, maintain NaN values."""
return s.replace({True: 1, False: 0})
# generate a random dataframe
df = pd.DataFrame({"a": range(10), "b": range(10, 0, -1)}).assign(
a_bool=lambda df: df["a"] > 5,
b_bool=lambda df: df["b"] % 2 == 0,
)
# select all bool columns (or specify which cols to use)
bool_cols = [c for c, d in df.dtypes.items() if d == "bool"]
# apply the new coding to a new dataframe (or can replace the existing one)
df_new = df.assign(**{c: lambda df: df[c].pipe(bool_to_int) for c in bool_cols})