107

I'm getting lots of warnings like this in Python:

DeprecationWarning: invalid escape sequence \A
  orcid_regex = '\A[0-9]{4}-[0-9]{4}-[0-9]{4}-[0-9]{3}[0-9X]\Z'

DeprecationWarning: invalid escape sequence \/
  AUTH_TOKEN_PATH_PATTERN = '^\/api\/groups'

DeprecationWarning: invalid escape sequence \
  """

DeprecationWarning: invalid escape sequence \.
  DOI_PATTERN = re.compile('(https?://(dx\.)?doi\.org/)?10\.[0-9]{4,}[.0-9]*/.*')

<unknown>:20: DeprecationWarning: invalid escape sequence \(

<unknown>:21: DeprecationWarning: invalid escape sequence \(

What do they mean? And how can I fix them?

In Python 3.12+ the error message is changed from a DeprecationWarning to a SyntaxWarning (changelog):

SyntaxWarning: invalid escape sequence '\A'
1
  • Sometimes it's a bug, e.g. insert '''' I'm stupid: r'$\Delta$' ''' in your code. The checker doesn't see $\Delta$ is latex, it doesn't see r prevents escaping anything, and it doesn't see anyway this is a comment enclosed in '''.
    – mins
    Commented Nov 24 at 11:19

1 Answer 1

166

\ is the escape character in Python string literals.

For example if you want to put a tab character in a string you may use:

>>> print("foo \t bar")
foo      bar

If you want to put a literal \ in a string you may use \\:

>>> print("foo \\ bar")
foo \ bar

Or you may use a "raw string":

>>> print(r"foo \ bar")
foo \ bar

You can't just go putting backslashes in string literals whenever you want one. A backslash is only allowed when part of one of the valid escape sequences, and it will cause a DeprecationWarning (< 3.12) or a SyntaxWarning (3.12+) otherwise. For example \A isn't a valid escape sequence:

$ python3.6 -Wd -c '"\A"'
<string>:1: DeprecationWarning: invalid escape sequence \A
$ python3.12 -c '"\A"'
<string>:1: SyntaxWarning: invalid escape sequence '\A'

If your backslash sequence does accidentally match one of Python's escape sequences, but you didn't mean it to, that's even worse because the data is just corrupted without any error or warning.

So you should always use raw strings or \\.

It's important to remember that a string literal is still a string literal even if that string is intended to be used as a regular expression. Python's regular expression syntax supports many special sequences that begin with \. For example \A matches the start of a string. But \A is not valid in a Python string literal! This is invalid:

my_regex = "\Afoo"

Instead you should do this:

my_regex = r"\Afoo"

Docstrings are another one to remember: docstrings are string literals too, and invalid \ sequences are invalid in docstrings too! Use r"""raw strings""" for docstrings if they must contain \.

3
  • 2
    If you have a variable that contains the string, though, how do you convert it to a raw string so it isn't misinterpreted? This isn't working for me: r"{}".format(my_variable)
    – HaPsantran
    Commented Apr 10, 2019 at 0:28
  • A raw string is not a different type to a regular string, its is just a different way of writing a string literal in your source code. Once you have a variable containing the string, is a string. There is no difference or distinction between regular or raw Commented Dec 2, 2019 at 5:26
  • 4
    Escaping the backslash applies to regular expressions where you are escaping the dot. This is where it came up for me. See my answer here to "Regular expression to match a dot". So, you must do "\\." or r"\." instead of "\.". Took me a while to figure out. Your answer helped. Thanks. Commented Mar 20, 2021 at 21:11

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.