20

I am trying to create a dataframe in pandas using a CSV that is semicolon-delimited, and uses commas for the thousands separator on numeric data. Is there a way to read this in so that the type of the column is float and not string?

3 Answers 3

33

Pass param thousands=',' to read_csv to read those values as thousands:

In [27]:
import pandas as pd
import io

t="""id;value
0;123,123
1;221,323,330
2;32,001"""
pd.read_csv(io.StringIO(t), thousands=r',', sep=';')

Out[27]:
   id      value
0   0     123123
1   1  221323330
2   2      32001
2
  • 1
    What does the r stand for, in the thousands field?
    – kotchwane
    Apr 26, 2021 at 18:36
  • 1
    @kotchwane the r makes it a raw string literal (and is not actually necessary in this case)
    – tdy
    Jun 27, 2022 at 3:09
10

The answer to this question should be short:

df=pd.read_csv('filename.csv', thousands=',')
1
  • 1
    with ; separator df=pd.read_csv('filename.csv', sep=";", thousands=',') Jul 6 at 6:42
2

Take a look at the read_csv documentation there is a keyword argument 'thousands' that you can pass the ',' into. Likewise if you had European data containing a '.' for the separator you could do the same.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.