62

How can I call an external program with a python script and retrieve the output and return code?

3

5 Answers 5

88

Look at the subprocess module: a simple example follows...

from subprocess import Popen, PIPE

process = Popen(["ls", "-la", "."], stdout=PIPE)
(output, err) = process.communicate()
exit_code = process.wait()
5
  • 11
    I've edited the answer above to reflect Ambroz's suggestion in case someone does not read the comments and uses the previously incorrect code.
    – Ben McCann
    Commented Oct 24, 2013 at 17:30
  • if this does not for some reason work, you might want to add shell=True to the params ( when in windows? )
    – ntg
    Commented Oct 31, 2016 at 10:05
  • 2
    It seems that the above solution can be replaced by simple call subprocess.run() (Python >= 3.5 is required). Commented Jun 24, 2017 at 12:56
  • 1
    can I get the line number of error line like a line has error and the function returns me the line number like 1.0? so that I can add a tag and highlight the error. Commented May 15, 2019 at 16:19
  • 1
    In order to grab the error outputs "stderr=PIPE" should also be added: process = Popen(["ls", "-la", "."], stdout=PIPE, stderr=PIPE)
    – HmT
    Commented May 31, 2019 at 7:18
19

Following Ambroz Bizjak's previous comment, here is a solution that worked for me:

import shlex
from subprocess import Popen, PIPE

cmd = "..."
process = Popen(shlex.split(cmd), stdout=PIPE)
process.communicate()
exit_code = process.wait()
2
  • 5
    This is by far the best answer.
    – dotancohen
    Commented Aug 22, 2013 at 9:43
  • 4
    I have a similar post here that shows how to get three things from a process: exitcode, stdout, stderr.
    – Jabba
    Commented Mar 18, 2014 at 20:58
5

After some research, I have the following code which works very well for me. It basically prints both stdout and stderr in real time. Hope it helps someone else who needs it.

stdout_result = 1
stderr_result = 1


def stdout_thread(pipe):
    global stdout_result
    while True:
        out = pipe.stdout.read(1)
        stdout_result = pipe.poll()
        if out == '' and stdout_result is not None:
            break

        if out != '':
            sys.stdout.write(out)
            sys.stdout.flush()


def stderr_thread(pipe):
    global stderr_result
    while True:
        err = pipe.stderr.read(1)
        stderr_result = pipe.poll()
        if err == '' and stderr_result is not None:
            break

        if err != '':
            sys.stdout.write(err)
            sys.stdout.flush()


def exec_command(command, cwd=None):
    if cwd is not None:
        print '[' + ' '.join(command) + '] in ' + cwd
    else:
        print '[' + ' '.join(command) + ']'

    p = subprocess.Popen(
        command, stdout=subprocess.PIPE, stderr=subprocess.PIPE, cwd=cwd
    )

    out_thread = threading.Thread(name='stdout_thread', target=stdout_thread, args=(p,))
    err_thread = threading.Thread(name='stderr_thread', target=stderr_thread, args=(p,))

    err_thread.start()
    out_thread.start()

    out_thread.join()
    err_thread.join()

    return stdout_result + stderr_result
1
  • I only copy pasted the code to see if it works and I got an error that out is of type bytes so it cannot be used in the write method. Also, it prints the characters, but never stops.
    – ashrasmun
    Commented Jan 10, 2022 at 22:10
3

Check out the subprocess module here: http://docs.python.org/library/subprocess.html#module-subprocess. It should get what you need done.

3

I've developed a little library (py-execute) that allows you to execute external programs, retrieve the output and the retcode and, at the same time get output in console in real time:

>>> from py_execute.process_executor import execute
>>> ret = execute('echo "Hello"')
Hello
>>> ret
(0, 'Hello\n')

You can avoid printing to console passing a mock user_io:

>>> from mock import Mock
>>> execute('echo "Hello"', ui=Mock())
(0, 'Hello\n')

I wrote it because with plain Popen (In Python 2.7) I was having trouble executing commands with a long output

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.