158

I want to subtract dates in 'A' from dates in 'B' and add a new column with the difference.

df
          A        B
one 2014-01-01  2014-02-28 
two 2014-02-03  2014-03-01

I've tried the following, but get an error when I try to include this in a for loop...

import datetime
date1=df['A'][0]
date2=df['B'][0]
mdate1 = datetime.datetime.strptime(date1, "%Y-%m-%d").date()
rdate1 = datetime.datetime.strptime(date2, "%Y-%m-%d").date()
delta =  (mdate1 - rdate1).days
print delta

What should I do?

5 Answers 5

194

To remove the 'days' text element, you can also make use of the dt() accessor for series: https://pandas.pydata.org/pandas-docs/stable/generated/pandas.Series.dt.html

So,

df[['A','B']] = df[['A','B']].apply(pd.to_datetime) #if conversion required
df['C'] = (df['B'] - df['A']).dt.days

which returns:

             A          B   C
one 2014-01-01 2014-02-28  58
two 2014-02-03 2014-03-01  26
5
  • 5
    Great answer. In my case, df['C'] = (df['B'] - df['A']).dt.days did not work and I had to use df['C'] = (df['B'] - df['A']).days. Any idea why mine did not give the number of days as expected?
    – Samuel Nde
    Sep 21, 2018 at 18:44
  • Nde - how exactly did it not work? Error or wrong values? Did you convert both A and B columns to datetime successfully? Sep 24, 2018 at 6:56
  • 3
    Both my columns are datetime (or datetime64[ns] to be precise). When I did df['C'] = (df['B'] - df['A']).dt.days, I got an attribute error that said AttributeError: 'Timedelta' object has no attribute 'dt', so I tried df['C'] = (df['B'] - df['A']).days which gave me the desired answer. (Of course I am using my own dataframe not the one in the example above. Or could it be because I also have time in my date and not as in 2018-09-24 10:17:18.800277)
    – Samuel Nde
    Sep 24, 2018 at 17:20
  • How does this function rounds, if my original dataframe is with Hours:Minutes:Seconds?
    – PV8
    Jun 27, 2019 at 8:35
  • 1
    one small suggestion, use df['A'] = pd.to_datetime(df['A']) is much faster than using apply function,
    – Jacob2309
    Mar 11 at 2:25
123

Assuming these were datetime columns (if they're not apply to_datetime) you can just subtract them:

df['A'] = pd.to_datetime(df['A'])
df['B'] = pd.to_datetime(df['B'])

In [11]: df.dtypes  # if already datetime64 you don't need to use to_datetime
Out[11]:
A    datetime64[ns]
B    datetime64[ns]
dtype: object

In [12]: df['A'] - df['B']
Out[12]:
one   -58 days
two   -26 days
dtype: timedelta64[ns]

In [13]: df['C'] = df['A'] - df['B']

In [14]: df
Out[14]:
             A          B        C
one 2014-01-01 2014-02-28 -58 days
two 2014-02-03 2014-03-01 -26 days

Note: ensure you're using a new of pandas (e.g. 0.13.1), this may not work in older versions.

7
  • 32
    Do can we get rid of the "days" portion in the result incase we just need to see the numeric value ie. -58, -26 in this case.
    – 0nir
    Oct 22, 2014 at 17:24
  • 7
    to expand on @AndyHayden comment, that works but it should pd.offsets.Day(1) (with an 's'). I also usually negate it, so you get (df['A'] - df['B']) / pd.offsets.Day(-1)
    – dirkjot
    Oct 14, 2015 at 18:54
  • 12
    However, if you want to do this on a whole Series you need (df['A'] - df['B']) / np.timedelta64(-1, 'D') for reasons that I don't fully understand.
    – dirkjot
    Oct 14, 2015 at 19:05
  • @dirkjot Thanks for spotting the typo! IIRC this was fix in recent pandas, are you using 0.16.2 / 0.17? Oct 14, 2015 at 19:27
  • 5
    @webelo the DatetimeIndex/Series itself should have a .dt.days attribute which should be strongly preferred. Apr 26, 2017 at 23:33
14

A list comprehension is your best bet for the most Pythonic (and fastest) way to do this:

[int(i.days) for i in (df.B - df.A)]
  1. i will return the timedelta(e.g. '-58 days')
  2. i.days will return this value as a long integer value(e.g. -58L)
  3. int(i.days) will give you the -58 you seek.

If your columns aren't in datetime format. The shorter syntax would be: df.A = pd.to_datetime(df.A)

0
1

How about this:

times['days_since'] = max(list(df.index.values))  
times['days_since'] = times['days_since'] - times['months']  
times
0

Solution above did not work for me. If you are using a simple pd.to_datetime() to first convert it, later you can just use:

import numpy as np

df['C'] = df['A'] - df['B'] / np.timedelta64(1, 'D')

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.