Python's list.index(x)
throws an exception if the item doesn't exist. Is there a better way to do this that doesn't require handling exceptions?
9 Answers
If you don't care where the matching element is, then use:
found = x in somelist
If you do care, then use a LBYL style with a conditional expression:
i = somelist.index(x) if x in somelist else None
-
2Thanks Raymond, found this to be the most concise answer (Again, changed the default from -1 to None, as -1 is a valid list index)– YarinNov 19, 2011 at 22:00
-
2
-
31But isn't that approach much slower than with just running
index()
? After all you have to look twice: once for the existence and once for the index. This is why C++ containers don't have aexists()
, onlyfind()
.– fransJan 13, 2016 at 11:09 -
13As @frans said this requires two look-ups, but here is another way that can do the job in one pass:
i = next((i for i, t in enumerate(somelist) if x == t), None)
– AXOOct 10, 2016 at 10:18 -
3@AXO Even though it's one pass, it's going to be slower for built-in types because the lookup is performed by Python rather than C code. Apr 8, 2020 at 18:40
implement your own index for list?
class mylist(list):
def index_withoutexception(self,i):
try:
return self.index(i)
except:
return -1
So, you can use list, and with your index2, return what you want in case of error.
You can use it like this:
l = mylist([1,2,3,4,5]) # This is the only difference with a real list
l.append(4) # l is a list.
l.index_withoutexception(19) # return -1 or what you want
-
Beware as this can break some code:
type(l) == list
isFalse
here. Jun 19, 2014 at 13:37 -
2Also - I'm not positive, but it seems to me that if the goal is to avoid raising exception (which is costly if it happens often), then this doesn't achieve it. It will return -1, but internally an exception will still be raised that will still be costly. Jun 8, 2018 at 14:47
TL;DR: Exceptions are your friend, and the best approach for the question as stated.
It's easier to ask for forgiveness than permission (EAFP)
The OP clarified in a comment that for their use case, it wasn't actually important to know what the index was. As the accepted answer notes, using x in somelist
is the best answer if you don't care.
But I'll assume, as the original question suggests, that you do care what the index is. In that case, I'll note that all the other solutions require scanning the list twice, which can bring a large performance penalty.
Furthermore, as the venerable Raymond Hettinger wrote in a comment
Even if we had list.find that returned a -1 you would still need to test to see if the i == -1 and take some action.
So I'll push back on the assumption in the original question that exceptions should be avoided. I suggest that exceptions are your friend. They're nothing to be scared of, they aren't inefficient, and in fact you need to be conversant with them to write good code.
So I think the best answer is to simply use a try-except approach:
try:
i = somelist.index(x)
except ValueError:
# deal with it
"deal with it" just means do what you need to do: set i to a sentinel value, raise an exception of your own, follow a different code branch, etc.
This is an example of why the Python principle Easier to ask for forgiveness than permission (EAFP) makes sense, in contrast to the if-then-else style of Look before you leap (LBYL)
-
3So true! I thought I had this problem, and at first thought one of the other solutions was good. Then I looked at my code again, and realized that using a try...except would be more quick and natural, since of course I still have to deal with it....– nealmcbDec 8, 2019 at 17:44
-
20I'm laughing out loud. Sometimes insights don't last. I just made the comment above, not noticing that I had written the answer in the first place 2 years ago. Only when I tried to vote up my own answer did SO clue me in.– nealmcbDec 8, 2019 at 17:47
-
5
-
@AndrewScottEvans Can you quantify the performance of exceptions, and compare the use of exceptions with other answers here? It is often said that premature optimization is a significant problem. So the inefficiency would have to be significant to warrant using an approach that was worse in other ways, unless the context is an inner loop.– nealmcbFeb 16, 2021 at 23:25
-
4@AndrewScottEvans You might be thinking of some other language. Python is not running native machine code, so it would not be necessary to implement exceptions as hardware interrupts. In the C API, an exception is a NULL return value and a globally set (per thread) exception object: docs.python.org/3/c-api/exceptions.html Arguably, the whole concept of a dynamically typed virtual machine is itself a performance hit, but given that, there's no reason for a Python exception to be fundamentally slower or faster than any other Python statement. Mar 15, 2021 at 23:22
Write a function that does what you need:
def find_in_iterable(x, iterable):
for i, item in enumerate(iterable):
if item == x:
return i
return None
If you only need to know whether the item exists, but not the index, you can use in
:
x in yourlist
-
4
-
@Yarin: The reason I chose -1 was to be consistent with existing Python idioms, for example
'abc'.find('x') == -1
, butNone
would work too. I'll update my answer. Nov 19, 2011 at 21:11 -
1Yeah, that's odd that .find() does that- seems inconsistent with Python's negative indexes.– YarinNov 19, 2011 at 21:15
Yes, there is. You can eg. do something similar to this:
test = lambda l, e: l.index(e) if e in l else None
which works like that:
>>> a = ['a', 'b', 'c', 'g', 'c']
>>> test(a, 'b')
1
>>> test(a, 'c')
2
>>> test(a, 't')
None
So, basically, test()
will return index of the element (second parameter) within given list (first parameter), unless it has not been found (in this case it will return None
, but it can be anything you find suitable).
If you don't care where it is in the sequence, only its presence, then use the in
operator. Otherwise, write a function that refactors out the exception handling.
def inlist(needle, haystack):
try:
return haystack.index(needle)
except ...:
return -1
-
I have posted an answer that checks for existence using
in
and eventually returns the index, but I see you are aware of that method and decided to use handling exceptions that may be thrown. My question is: why did you chose catching exception instead of first checkinghaystack
for existence ofneedle
? Is there any reason for that?– TadeckNov 19, 2011 at 21:27 -
@Tadeck: Because of the unwritten Python rule, "It is easier to ask forgiveness than permission". Nov 19, 2011 at 21:29
-
3Thanks :) I have just found it on Python glossary, where EAFP (Easier to Ask for Forgiveness than for Permission) is shown as something opposite to LBYL (Look Before You Leap). And indeed EAFP has been named as common Python coding style, so it is not so unwritten :) Thanks again!– TadeckNov 19, 2011 at 21:41
-
I like to use Web2py's List class, found in the storage module of its gluon package. The storage module offers list-like (List) and dictionary-like (Storage) data structures that do not raise errors when an element is not found.
First download web2py's source, then copy-paste the gluon package folder into your python installation's site-packages.
Now try it out:
>>> from gluon.storage import List
>>> L = List(['a','b','c'])
>>> print L(2)
c
>>> print L(3) #No IndexError!
None
Note, it can also behave like a regular list as well:
>>> print L[3]
Traceback (most recent call last):
File "<pyshell#4>", line 1, in <module>
l[3]
IndexError: list index out of range
-
good idea, thanks.)
def __call__(self, idx, df=None): return self[idx] if 0<=idx<len(self) else df
– WinandJan 28, 2015 at 11:39
There is no built-in way to do what you want to do.
Here is a good post that may help you: Why list doesn't have safe "get" method like dictionary?
-
That post is about array indexing, with the
IndexError: list index out of range
problem, not theindex()
method withValueError: <value> is not in list
issue described here.– nealmcbDec 17, 2017 at 18:00
hope this helps
lst= ','.join('qwerty').split(',') # create list
i='a' #srch string
lst.index(i) if i in lst else None
i == -1
and take some action.None
. It's often useful for a missing index to throw, yes, but if[][0]
throws, I would also like[].index(0)
to returnNone
, or at least allow[].index(0, default=None)
. It's 1 line instead of 4.