107

This works (using Pandas 12 dev)

table2=table[table['SUBDIVISION'] =='INVERNESS']

Then I realized I needed to select the field using "starts with" Since I was missing a bunch. So per the Pandas doc as near as I could follow I tried

criteria = table['SUBDIVISION'].map(lambda x: x.startswith('INVERNESS'))
table2 = table[criteria]

And got AttributeError: 'float' object has no attribute 'startswith'

So I tried an alternate syntax with the same result

table[[x.startswith('INVERNESS') for x in table['SUBDIVISION']]]

Reference http://pandas.pydata.org/pandas-docs/stable/indexing.html#boolean-indexing Section 4: List comprehensions and map method of Series can also be used to produce more complex criteria:

What am I missing?

1
  • Could you give a small example which demonstrates this, I'm surprised that the list comprehension wouldn't raise in the same way as the map... Commented Jul 30, 2013 at 22:21

5 Answers 5

135

You can use the str.startswith DataFrame method to give more consistent results:

In [11]: s = pd.Series(['a', 'ab', 'c', 11, np.nan])

In [12]: s
Out[12]:
0      a
1     ab
2      c
3     11
4    NaN
dtype: object

In [13]: s.str.startswith('a', na=False)
Out[13]:
0     True
1     True
2    False
3    False
4    False
dtype: bool

and the boolean indexing will work just fine (I prefer to use loc, but it works just the same without):

In [14]: s.loc[s.str.startswith('a', na=False)]
Out[14]:
0     a
1    ab
dtype: object

.

It looks least one of your elements in the Series/column is a float, which doesn't have a startswith method hence the AttributeError, the list comprehension should raise the same error...

10
  • Thank you for your reply...Don't seem to be getting there Tried table['SUBDIVISION']str.startswith('INVERNESS', na=False) and got table['SUBDIVISION']str.startswith('INVERNESS', na=False) ^ SyntaxError: invalid syntax Wondering if I did not import something essential? I don't get it since my straight == condition works fine
    – dartdog
    Commented Jul 31, 2013 at 2:01
  • 1
    And if I try table.loc[table['SUBDIVISION'].str.startswith('INVERNESS', na=False)] I get a good result!! But I still don't get what is wrong with the prior attempts?
    – dartdog
    Commented Jul 31, 2013 at 2:16
  • 1
    @dartdog you were missing a dot. please include a small subset of the data which demonstrates the problem (it seems hard to believe :s) Commented Jul 31, 2013 at 8:12
  • Sorry the data is 27 cols long, kind of unwieldy even to post a clip. I tried this> table['SUBDIVISION'].str.startswith('INVERNESS',na='False') with another '.' and the comparison came out bad (all selected false) I still don't get why my original syntax failed since I thought I was following the documentation.
    – dartdog
    Commented Jul 31, 2013 at 11:39
  • @dartdog presumably it's only the SUBDIVISION column which is relevant, so just paste that. Commented Jul 31, 2013 at 11:43
35

To retrieve all the rows which startwith required string

dataFrameOut = dataFrame[dataFrame['column name'].str.match('string')]

To retrieve all the rows which contains required string

dataFrameOut = dataFrame[dataFrame['column name'].str.contains('string')]
1
  • 13
    Why use the str.match() function to determine whether a value starts with a specific string when you could use str.startswith()? str.match() is for matching a value against a regular expression. If you don't need a regular expression, using that function may make your code slower than necessary. Commented Jul 1, 2018 at 1:16
17

Using startswith for a particular column value

df  = df.loc[df["SUBDIVISION"].str.startswith('INVERNESS', na=False)]
6

You can use apply to easily apply any string matching function to your column elementwise.

table2=table[table['SUBDIVISION'].apply(lambda x: x.startswith('INVERNESS'))]

this assuming that your "SUBDIVISION" column is of the correct type (string)

Edit: fixed missing parenthesis

1
  • This worked for me once I added another closing bracket table2=table[table['SUBDIVISION'].apply(lambda x: x.startswith('INVERNESS')]]
    – avirr
    Commented Oct 17, 2019 at 2:43
3

This can also be achieved using query:

table.query('SUBDIVISION.str.startswith("INVERNESS").values')

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.