51

The python threading documentation states that "...threading is still an appropriate model if you want to run multiple I/O-bound tasks simultaneously", apparently because I/O-bound processes can avoid the GIL that prevents threads from concurrent execution in CPU-bound tasks.

But what I dont understand is that an I/O task still uses the CPU. So how could it not encounter the same issues? Is it because the I/O bound task will not require memory management?

1
  • 11
    " I/O task still uses the CPU" ... in general, this is typically not the case. Instead of PIO, many/most modern peripherals have direct memory access not requiring CPU cycles to move data.
    – Brian Cain
    Mar 26, 2015 at 4:01

2 Answers 2

56

All of Python's blocking I/O primitives release the GIL while waiting for the I/O block to resolve -- it's as simple as that! They will of course need to acquire the GIL again before going on to execute further Python code, but for the long-in-terms-of-machine-cycles intervals in which they're just waiting for some I/O syscall, they don't need the GIL, so they don't hold on to it!

10
  • 4
    @Shashank, nah -- I've got benchmarks of "naturally coded" Python vs C++ I/O bound code with Python absolutely running circles around C++ -- two, three times faster. Dropping the GIL is always super-fast and acquiring it again pretty fast unless you have more threads active that's good for you! Mar 26, 2015 at 4:30
  • (With IO the biggest bottlenecks I've run into are usually not suitable buffers and repeated "each byte" system-IO calls. Pretty much universal across languages; some hide it better / by default.) Mar 26, 2015 at 4:35
  • @Shashank I'm not sure that's is related to the GIL so much as the output buffering. There is an implicit 'flush' at the end of each print (thanks to the newline) when in 'interactive mode' - at the very least a more fair comparison would write directly to a non-interactive stream. (Writing many lines to the console is relatively slow, even in "plain C".) See stackoverflow.com/questions/1716296 Mar 26, 2015 at 4:47
  • @user2864740 You are right, there is a a huge boost in performance in the first method when writing to a non-interactive stream. However, the second way is still consistently faster by a noticable margin.
    – Shashank
    Mar 26, 2015 at 4:52
  • @Shashank That I can believe for a simple case, as 1 "context switch" is faster than N - and assuming no benefit from concurrency. I haven't been bit by such though for my work (read: if there is a difference I've never had reason to worry about it), when watching the buffering. Mar 26, 2015 at 4:54
39

The GIL in CPython1 is only concerned with Python code being executed. A thread-safe C extension that uses a lot of CPU might release the GIL as long as it doesn't need to interact with the Python runtime.

As soon as the C code needs to 'talk' to Python (read: call back into the Python runtime) then it needs to acquire the GIL again - that is, the GIL is to establish protection/atomic behavior for the "interpreter" (and I use the term loosely) and is not to prevent native/non-Python code from running concurrently.

Releasing the GIL around I/O (blocking or not, using CPU or not) is the same thing - until the data is moved into Python there is no reason to acquire the GIL.


1 The GIL is controversial because it prevents multithreaded CPython programs from taking full advantage of multiprocessor systems in certain situations. Note that potentially blocking or long-running operations, such as I/O, image processing, and NumPy number crunching, happen outside the GIL. Therefore it is only in multithreaded programs that spend a lot of time inside the GIL, interpreting CPython bytecode, that the GIL becomes a bottleneck.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.