140

When implementing a class with multiple properties (like in the toy example below), what is the best way to handle hashing?

I guess that the __eq__ and __hash__ should be consistent, but how to implement a proper hash function that is capable of handling all the properties?

class AClass:
  def __init__(self):
      self.a = None
      self.b = None

  def __eq__(self, other):
      return other and self.a == other.a and self.b == other.b

  def __ne__(self, other):
    return not self.__eq__(other)

  def __hash__(self):
      return hash((self.a, self.b))

I read on this question that tuples are hashable, so I was wondering if something like the example above was sensible. Is it?

1
  • 5
    Just make sure to use hash() on a tuple with exactly the elements that are compared in __eq__() and friends (exactly as you did) and you're good to go. Commented Apr 22, 2014 at 20:52

3 Answers 3

106

__hash__ should return the same value for objects that are equal. It also shouldn't change over the lifetime of the object; generally you only implement it for immutable objects.

A trivial implementation would be to just return 0. This is always correct, but performs badly.

Your solution, returning the hash of a tuple of properties, is good. But note that you don't need to list all properties that you compare in __eq__ in the tuple. If some property usually has the same value for inequal objects, just leave it out. Don't make the hash computation any more expensive than it needs to be.

Edit: I would recommend against using xor to mix hashes in general. When two different properties have the same value, they will have the same hash, and with xor these will cancel eachother out. Tuples use a more complex calculation to mix hashes, see tuplehash in tupleobject.c.

11
  • 5
    As you said hash functions usually only make sense for immutable objects. Hence it is possible to calculate the hash-value once in __init__. Commented Oct 23, 2010 at 19:20
  • 7
    +1 for the return 0 hash function - I've always thought that anything else is premature optimisation :-). (I'm only half kidding). Commented Oct 23, 2010 at 20:38
  • 7
    @BjörnPollex Rather than doing it in __init__, you can just cache the value in __hash__. That way if __hash__ is never called, you didn't waste either time or memory. I assume checking whether the value has been already cached isn't expensive is it? (Not sure if it's best through exception or explicit if).
    – max
    Commented Apr 22, 2012 at 5:59
  • 1
    It's unfortunate that Python does not make a combine_hashes function available.
    – Fred Foo
    Commented Sep 20, 2012 at 11:34
  • 3
    It's not implemented in things like dict or list, the justification being that changing the hash of an object that already belongs to, e.g., a set wreaks havoc on the set's internal data structures.
    – javawizard
    Commented Sep 5, 2013 at 22:03
31

Documentation for object.__hash__(self)

The only required property is that objects which compare equal have the same hash value; it is advised to mix together the hash values of the components of the object that also play a part in comparison of objects by packing them into a tuple and hashing the tuple. Example

def __hash__(self):
    return hash((self.name, self.nick, self.color))
8
  • 5
    It will work, but it's bad that if you exchange self.a and self.b then you'll get the same hash while it will be the other "object".
    – eigenein
    Commented Jun 20, 2011 at 21:16
  • 1
    "somehow mix together (e.g. using exclusive or" is a pretty flexible set of requirements. If it actually matters, then (hash(self.a)<<1) ^ hash(self.b) might be better. There's no general answer, just a general guideline that has to be modified based on the specific application.
    – S.Lott
    Commented Jun 20, 2011 at 21:18
  • 26
    why not just hash a tuple value? hash((self.a, self.b))
    – nightpool
    Commented Feb 20, 2016 at 20:38
  • 8
    Note that (fortunately) the suggestion to use xor is no longer present in the Python 3 or Python 2 docs.
    – PM 2Ring
    Commented Jan 17, 2017 at 12:05
  • 12
    For those whom are interested, here is the bug that led to removal of XOR recommendation: bugs.python.org/issue28383
    – AXO
    Commented Aug 21, 2017 at 16:16
22

It's dangerous to write

def __eq__(self, other):
  return other and self.a == other.a and self.b == other.b

because if your rhs (i.e., other) object evaluates to boolean False, it will never compare as equal to anything!

In addition, you might want to double check if other belongs to the class or subclass of AClass. If it doesn't, you'll either get exception AttributeError or a false positive (if the other class happens to have the same-named attributes with matching values). So I would recommend to rewrite __eq__ as:

def __eq__(self, other):
  return isinstance(other, self.__class__) and self.a == other.a and self.b == other.b

If by any chance you want an unusually flexible comparison, which compares across unrelated classes as long as attributes match by name, you'd still want to at least avoid AttributeError and check that other doesn't have any additional attributes. How you do it depends on the situation (since there's no standard way to find all attributes of an object).

4
  • 9
    Useful info, but unrelated to the primary question about hashing. Commented Jan 4, 2018 at 17:19
  • 1
    Not related, but thank you for posting this never the less. +1. Commented May 31, 2019 at 16:39
  • 1
    This is a bad __eq__ implementation, as it does not delegate to the right hand side's __eq__ if the left hand does not know how to do the comparison. If int had a __eq__ like this, 1 == MyNumericType(1) would always be False, even if MyNumericType(1) == 1 would return True. If you don't recognize the type of other, always return NotImplemented, don't just return False. Commented Nov 4, 2019 at 23:03
  • @ShadowRanger Agreed.
    – max
    Commented Nov 5, 2019 at 8:31

Not the answer you're looking for? Browse other questions tagged or ask your own question.