120

I have a pandas data frame where the first 3 columns are strings:

         ID        text1    text 2
0       2345656     blah      blah
1          3456     blah      blah
2        541304     blah      blah        
3        201306       hi      blah        
4   12313201308    hello      blah         

I want to add leading zeros to the ID:

                ID    text1    text 2
0  000000002345656     blah      blah
1  000000000003456     blah      blah
2  000000000541304     blah      blah        
3  000000000201306       hi      blah        
4  000012313201308    hello      blah 

I have tried:

df['ID'] = df.ID.zfill(15)
df['ID'] = '{0:0>15}'.format(df['ID'])
1
  • can you please explain how '{0:0>15}'.format(df['ID']) works.
    – spd
    Mar 25, 2022 at 4:04

7 Answers 7

145

str attribute contains most of the methods in string.

df['ID'] = df['ID'].str.zfill(15)

See more: http://pandas.pydata.org/pandas-docs/stable/text.html

2
  • 4
    added df['ID'] = df['ID'].astype(str) to handle when ID is numeric, the run df['ID'] = df['ID'].str.zfill(15)
    – Je Je
    Mar 14, 2021 at 12:29
  • For a more general and customizable solution, one can use str.pad; you can have a look at this answer
    – Ric S
    Jul 15, 2021 at 10:27
121

Try:

df['ID'] = df['ID'].apply(lambda x: '{0:0>15}'.format(x))

or even

df['ID'] = df['ID'].apply(lambda x: x.zfill(15))
6
  • 32
    No need for the lambda on the first one: apply('{:0>15}'.format) should work too.
    – DSM
    May 23, 2014 at 18:58
  • 1
    @DSM Nice. Did not know that.
    – Rohit
    May 23, 2014 at 19:41
  • It can be achieved with single line while initialization, see my answer below.
    – Danil
    May 2, 2018 at 15:27
  • 1
    @Rohit how would the code change if the string had decimals or letters in it? i.e. what is required for converting 2.0a to 02.0a using a lambda x: x.zfill(2)?
    – Andreuccio
    Apr 10, 2019 at 9:31
  • Can you explain why you use 15 , what is the significance of the number, what if I only want to add one 0? Jun 4, 2020 at 2:30
19

With Python 3.6+, you can also use f-strings:

df['ID'] = df['ID'].map(lambda x: f'{x:0>15}')

Performance is comparable or slightly worse versus df['ID'].map('{:0>15}'.format). On the other hand, f-strings permit more complex output, and you can use them more efficiently via a list comprehension.

Performance benchmarking

# Python 3.6.0, Pandas 0.19.2

df = pd.concat([df]*1000)

%timeit df['ID'].map('{:0>15}'.format)                  # 4.06 ms per loop
%timeit df['ID'].map(lambda x: f'{x:0>15}')             # 5.46 ms per loop
%timeit df['ID'].astype(str).str.zfill(15)              # 18.6 ms per loop

%timeit list(map('{:0>15}'.format, df['ID'].values))    # 7.91 ms per loop
%timeit ['{:0>15}'.format(x) for x in df['ID'].values]  # 7.63 ms per loop
%timeit [f'{x:0>15}' for x in df['ID'].values]          # 4.87 ms per loop
%timeit [str(x).zfill(15) for x in df['ID'].values]     # 21.2 ms per loop

# check results are the same
x = df['ID'].map('{:0>15}'.format)
y = df['ID'].map(lambda x: f'{x:0>15}')
z = df['ID'].astype(str).str.zfill(15)

assert (x == y).all() and (x == z).all()
9
  • 1
    tried this with a 6gb file, works way faster than other methods, also more efficient. thanks @jpp
    – anky
    Oct 24, 2018 at 19:22
  • You can even use .map instead of .apply
    – rpanai
    Nov 21, 2018 at 13:04
  • @user32185, I believe they are interchangeable here and perform equally. Do you have a reason to think otherwise?
    – jpp
    Nov 21, 2018 at 13:05
  • 1
    In some examples it's faster. Try df['text1'].map('{:015}'.format).
    – rpanai
    Nov 21, 2018 at 13:15
  • 1
    @user32185, Thank you, I see a very marginal improvement changing apply vs map, I'm not sure if that's setup dependent. I've updated timings and advice in my answer as str.format without lambda seems to win.
    – jpp
    Nov 21, 2018 at 13:47
19

It can be achieved with a single line while initialization. Just use converters argument.

df = pd.read_excel('filename.xlsx', converters={'ID': '{:0>15}'.format})

so you'll reduce the code length by half :)

PS: read_csv have this argument as well.

0
13

If you are encountering the error:

Pandas error: Can only use .str accessor with string values, which use np.object_ dtype in pandas

df['ID'] = df['ID'].astype(str).str.zfill(15)
9

If you want a more customizable solution to this problem, you can try pandas.Series.str.pad

df['ID'] = df['ID'].astype(str).str.pad(15, side='left', fillchar='0')

str.zfill(n) is a special case equivalent to str.pad(n, side='left', fillchar='0')

1

rjust worked for me:

df['ID']= df['ID'].str.rjust(15,'0')

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.