196

A third-party library (written in C) that I use in my python code is issuing warnings. I want to be able to use the try except syntax to properly handle these warnings. Is there a way to do this?

5
  • 2
    Are those warning just text messages written do stderr?
    – Fenikso
    Apr 13, 2011 at 5:40
  • 1
    Fenikso: I don't know for sure, seems like real warnings Apr 13, 2011 at 5:52
  • 1
    How do you recognize "real warning"? I thought that in C you get real warning during compile.
    – Fenikso
    Apr 13, 2011 at 6:06
  • warnings.filterwarnings does exactly what you want, I don't understand what your issue with it is? Apr 13, 2011 at 6:19
  • 4
    @Fenikso, @Rosh Oxymoron you were right. My mistake. warnings.filterwarnigns('error') does the job. I can't find the original answer that proposed this solution Apr 13, 2011 at 6:37

8 Answers 8

235

To handle warnings as errors simply use this:

import warnings
warnings.filterwarnings("error")

After this you will be able to catch warnings same as errors, e.g. this will work:

try:
    some_heavy_calculations()
except RuntimeWarning:
    breakpoint()

You can also reset the behaviour of warnings by running:

warnings.resetwarnings()

P.S. Added this answer because the best answer in comments contains misspelling: filterwarnigns instead of filterwarnings.

7
  • 9
    And if you just want to see a stack trace, the first two lines are all you need.
    – z0r
    Feb 23, 2017 at 0:59
  • 7
    This is perfect. I just wanted my script to stop execution as soon as the warning was issued, so that I could print relevant debug information and fix the issue.
    – Praveen
    Apr 26, 2017 at 15:53
  • 2
    You don't need the filterwarnings call in order to catch Warnings, at least in python 3. it just works.
    – naught101
    Apr 3, 2019 at 6:37
  • 1
    The accepted answer does not answer the OP's question. This answer does. This is the answer I was looking for when my search found this question.
    – Biggsy
    Jan 24, 2020 at 10:39
  • 2
    Use warnings.resetwarnings() to reset when you're done Dec 13, 2022 at 22:57
72

To quote from the python handbook (27.6.4. Testing Warnings):

import warnings

def fxn():
    warnings.warn("deprecated", DeprecationWarning)

with warnings.catch_warnings(record=True) as w:
    # Cause all warnings to always be triggered.
    warnings.simplefilter("always")
    # Trigger a warning.
    fxn()
    # Verify some things
    assert len(w) == 1
    assert issubclass(w[-1].category, DeprecationWarning)
    assert "deprecated" in str(w[-1].message)
5
  • 11
    Here is an answer, that tells you how to use the try except syntax.
    – Unapiedra
    Oct 10, 2014 at 13:12
  • 2
    This has the advantage, over niekas's answer, that if fnx returns something, you keep that result (and still can manage the warning). Mar 22, 2019 at 18:22
  • This does not answer the OP's question, which was about handling wanrings, not testing them. However, the answer by niekas below does show how to handle warnings.
    – Biggsy
    Jan 24, 2020 at 10:42
  • Just a note that the above function will not work if your function only intermittently returns a warning because in the event that fxn() does not return a warning, then w will be an empty list. If w is an empty list (i.e. []), then running the code will give you the following error: IndexError: list index out of range. If you're just looking to format or check properties of the captured warnings, then it's better to use a for-loop: for x in w: print(f'{x.category.__name__}: {str(x.message)}') Jun 14, 2020 at 21:29
  • 1
    This approach is useful if one wants to handle warnings without interrupting program execution.
    – normanius
    Mar 23, 2021 at 12:01
38

If you just want your script to fail on warnings you can invoke python with the -W argument:

python -W error foobar.py
1
  • 8
    To catch a specific warning type, e.g.: python -W error::RuntimeWarning foobar.py
    – Paul Price
    Dec 6, 2021 at 20:50
24

Here's a variation that makes it clearer how to work with only your custom warnings.

import warnings
with warnings.catch_warnings(record=True) as w:
    # Cause all warnings to always be triggered.
    warnings.simplefilter("always")

    # Call some code that triggers a custom warning.
    functionThatRaisesWarning()

    # ignore any non-custom warnings that may be in the list
    w = filter(lambda i: issubclass(i.category, UserWarning), w)

    if len(w):
        # do something with the first warning
        email_admins(w[0].message)
11

Expanding on niekas answer, but using the catch_warnings context manager that resets the warnings behavior to default after context exit:

import warnings

with warnings.catch_warnings():
     warnings.simplefilter("error")
     # Code in this block will raise exception for a warning
# Code in this block will have default warning behaviour
6

In some cases, you need use ctypes to turn warnings into errors. For example:

str(b'test')  # no error
import warnings
warnings.simplefilter('error', BytesWarning)
str(b'test')  # still no error
import ctypes
ctypes.c_int.in_dll(ctypes.pythonapi, 'Py_BytesWarningFlag').value = 2
str(b'test')  # this raises an error
1
  • This answer is constructive simply for showing how to error only in certain warning types. For almost any large software project, if you do warnings.simplefilter('error') you won't get the traceback for the warning you saw in the logs, but instead get tracebacks from previously-filtered warnings. Using simplefilter is also the quickest way to arrive at your answer if you have some CLI invocation.
    – AlanSE
    Apr 12, 2019 at 14:08
3

Catching all warnings can be problematic. You can catch specific warnings. For example, I needed to catch a Pillow warning:

import warnings
warnings.filterwarnings("error", category=Image.DecompressionBombWarning)

def process_images():
  try:
    some_process()

  except Image.DecompressionBombWarning as e:
    print(e)
0
1

Just for completeness, you can also export an env variable:

PYTHONWARNINGS=error /usr/bin/run_my_python_utility

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.