What is the difference between subprocess.Popen()
and os.system()
?
5 Answers
If you check out the subprocess section of the Python docs, you'll notice there is an example of how to replace os.system()
with subprocess.Popen()
:
sts = os.system("mycmd" + " myarg")
...does the same thing as...
sts = Popen("mycmd" + " myarg", shell=True).wait()
The "improved" code looks more complicated, but it's better because once you know subprocess.Popen()
, you don't need anything else. subprocess.Popen()
replaces several other tools (os.system()
is just one of those) that were scattered throughout three other Python modules.
If it helps, think of subprocess.Popen()
as a very flexible os.system()
.
-
1You can also use
sts = p.wait()
instead of the last line. Commented Jan 27, 2011 at 8:10 -
1@JacobMarble so suppose I am calling a selenium scraping script from another python script, which of these would allow me to complete the scraping script and then and only then execute the next line of code? As in, my scraping should complete before the execution can continue.– praxmonCommented Mar 27, 2015 at 13:15
-
Maybe also mention stackoverflow.com/questions/3172470/… to point out that you ought to avoid the
shell=True
if you can. Having this option is one of the benefits ofsubprocess.Popen()
and its helper functions.– tripleeeCommented Feb 16, 2017 at 5:50 -
1@PrakharMohanSrivastava If you want to block the flow and wait for command to complete its work check out: stackoverflow.com/a/2837319/5252192 Commented Aug 1, 2017 at 6:59
-
@PrakharMohanSrivastava, in general both
os.system
andsubprocess.call/popen/run
does block/wait for the command to finish: stackoverflow.com/a/14059648/4752883 Commented Mar 10, 2018 at 0:54
subprocess.Popen()
is strict super-set of os.system()
.
-
14
-
49It's elegant, but it's not complete, because it doesn't describe what
os.system
is missing, or why you might needPopen
. Commented Dec 21, 2020 at 3:56 -
Not really enough to understand the solution. could have more elaborated with examples.– ktaCommented May 10, 2023 at 5:03
os.system
is equivalent to Unix system
command, while subprocess
was a helper module created to provide many of the facilities provided by the Popen
commands with an easier and controllable interface. Those were designed similar to the Unix Popen command.
system()
executes a command specified in command by calling/bin/sh -c command
, and returns after the command has been completed
Whereas:
The
popen()
function opens a process by creating a pipe, forking, and invoking the shell.
If you are thinking which one to use, then use subprocess
definitely because you have all the facilities for execution, plus additional control over the process.
-
okay..then is there any way i can execute both os.system and popen in windows env ? i am a newbie and need to dig deeper..– ArovitCommented Jan 27, 2011 at 8:15
-
Yes, you can use both os.system and subprocess in Windows Environment. Have a look at basic tutorials from effbot.org (Python Standard Library online book) Commented Jan 27, 2011 at 8:40
Subprocess is based on popen2, and as such has a number of advantages - there's a full list in the PEP here, but some are:
- using pipe in the shell
- better newline support
- better handling of exceptions
When running python (cpython) on windows the <built-in function system>
os.system will execute under the curtains _wsystem while if you're using a non-windows os, it'll use system.
On contrary, Popen should use CreateProcess on windows and _posixsubprocess.fork_exec in posix-based operating-systems.
That said, an important piece of advice comes from os.system docs, which says:
The subprocess module provides more powerful facilities for spawning new processes and retrieving their results; using that module is preferable to using this function. See the Replacing Older Functions with the subprocess Module section in the subprocess documentation for some helpful recipes.