I need to install a package from PyPi straight within my script.
Maybe there's some module or distutils (distribute, pip etc.) feature which allows me to just execute something like pypi.install('requests') and requests will be installed into my virtualenv.
The officially recommended way to install packages from a script is by calling pip's command-line interface via a subprocess. Most other answers presented here are not supported by pip. Furthermore since pip v10, all code has been moved to pip._internal precisely in order to make it clear to users that programmatic use of pip is not allowed.
Use sys.executable to ensure that you will call the same pip associated with the current runtime.
import subprocess
import sys
def install(package):
subprocess.check_call([sys.executable, "-m", "pip", "install", package])
-
2One issue with this is that, for novice users on Windows, python and pip are not always on their PATH, and so a .py file that could be double-clicked would be quite convenient, whereas a "pip install xxx" comment can be quite tricky.– jdpipeApr 17 '20 at 1:27
-
8CalledProcessError: Command '['C:\\ProgramData\\Anaconda3\\pythonw.exe', '-m', 'pip', 'install', 'googleapiclient']' returned non-zero exit status 1.– parvijMay 13 '20 at 18:30
-
I'm trying to use this approach, but my python is embedded/started from another executable, so "sys.executable" doesn't return the right path. Is there an alternative that would work for python that's started by some other process? Dec 26 '20 at 23:56
You can also use something like:
import pip
def install(package):
if hasattr(pip, 'main'):
pip.main(['install', package])
else:
pip._internal.main(['install', package])
# Example
if __name__ == '__main__':
install('argh')
-
3@nbro you pass options to
pip.main()as you would on the command line (but with each option as a separate entry in the list, instead of a single string). And to specify which version of the package you want, do the same as on the command line.. ex:pip.main(['install', 'pip==7.1.0'])– KaosJul 20 '15 at 10:18 -
3See also stackoverflow.com/questions/6457794/…, which shows how to handle the case where an install fails.– MyerJul 20 '15 at 11:21
-
28
from pip._internal import main as pipmainthen you can usepipmain()just like the deprecatedpip.main()see stackoverflow.com/questions/43398961/…– 3pittMay 30 '18 at 15:48 -
19
-
11It's deprecated for a reason & not recommended anymore. see pip.pypa.io/en/latest/user_guide/#using-pip-from-your-program– N.B.KJul 28 '19 at 16:56
If you want to use pip to install required package and import it after installation, you can use this code:
def install_and_import(package):
import importlib
try:
importlib.import_module(package)
except ImportError:
import pip
pip.main(['install', package])
finally:
globals()[package] = importlib.import_module(package)
install_and_import('transliterate')
If you installed a package as a user you can encounter the problem that you cannot just import the package. See How to refresh sys.path? for additional information.
-
4Any idea how to do that on Python 3?
imp.reload(site)gets meRuntimeError: dictionary changed size during iteration– kgadekAug 3 '15 at 16:35 -
where does this install the package, after i did this, i was not able to do
pip uninstall <package_name>. I can still uninstall it usingpip.mainbut just wanted to know where does it install the package? Apr 26 '16 at 12:20 -
Was curious. would this work properly if i do:
pip install requests[security]? I wasnt sure if it would properly define the globals correctly. May 8 '17 at 16:47 -
6Outdated.
pip.mainno longer works. pip.pypa.io/en/latest/user_guide/#using-pip-from-your-program– wimDec 5 '19 at 16:10 -
Does importing within a function really import into the main namespace, or just the namespace of that
install_and_importfunction?– sh37211Mar 31 '21 at 0:26
This should work:
import subprocess
def install(name):
subprocess.call(['pip', 'install', name])
-
2Yes it's definitely should work. But I thought there is more elegant way;) I'll be waiting a little bit, may be there is.– chuwySep 8 '12 at 18:03
-
2@Downvoter: What exactly is wrong with my answer? This answer has all the OP wanted. It doesn't even use a shell.– quantumSep 8 '12 at 18:09
-
13It depends on the right version of pip being first on the path. If the user is running an alternate python installation, pip will install into the first one instead of the current one. The import approach above will install in the right place. I upvoted anyway to counter the down vote. Jan 17 '14 at 11:57
-
6
-
7Calling
[sys.executable, '-m', 'pip', 'install', name]is making sure to get the "right" pip here.– wimDec 5 '19 at 16:11
i added some exception handling to @Aaron's answer.
import subprocess
import sys
try:
import pandas as pd
except ImportError:
subprocess.check_call([sys.executable, "-m", "pip", "install", 'pandas'])
finally:
import pandas as pd
-
2nice implementation of subprocess and pip, better than most solutions here Sep 23 '19 at 11:30
-
4You're not checking the retunr value of
subprocess.callso the code might fail. Dec 7 '19 at 13:42 -
1
-
Ok, running "import pandas as pd" brings no problem, but... logically isn't it ugly? Oct 4 '21 at 13:14
for installing multiple packages, i am using a setup.py file with following code:
import sys
import subprocess
import pkg_resources
required = {'numpy','pandas','<etc>'}
installed = {pkg.key for pkg in pkg_resources.working_set}
missing = required - installed
if missing:
# implement pip as a subprocess:
subprocess.check_call([sys.executable, '-m', 'pip', 'install',*missing])
You define the dependent module inside the setup.py of your own package with the "install_requires" option.
If your package needs to have some console script generated then you can use the "console_scripts" entry point in order to generate a wrapper script that will be placed within the 'bin' folder (e.g. of your virtualenv environment).
-
1This is the correct answer and the only sensible way to manage a Python projects' dependencies. It will work with virtualenv, Fabric, buildout, you name it. The method described by @xiaomao, even though answering exactly what the OP asked, is pure madness. Sep 8 '12 at 20:48
-
7while this is proper advice, it doesn't answer the question asked Jan 20 '17 at 16:29
-
4While packaging is a topic, there are a lot of other use cases, for example a deployment script written in python.– hoeflingFeb 2 '17 at 18:58
import os
os.system('pip install requests')
I tried above for temporary solution instead of changing docker file. Hope these might be useful to some
-
this is so easy and simple to understand for beginners as compared to all the other answers. Thank you very much. Nov 3 '21 at 9:17
If you want a more efficient answer that expands on subprocess.check_call. You can first check if the requirement has already been met using pkg_resources.
This works for different requirment specifiers which is nice. e.g. >=, ==
import sys
import subprocess
import pkg_resources
from pkg_resources import DistributionNotFound, VersionConflict
def should_install_requirement(requirement):
should_install = False
try:
pkg_resources.require(requirement)
except (DistributionNotFound, VersionConflict):
should_install = True
return should_install
def install_packages(requirement_list):
try:
requirements = [
requirement
for requirement in requirement_list
if should_install_requirement(requirement)
]
if len(requirements) > 0:
subprocess.check_call([sys.executable, "-m", "pip", "install", *requirements])
else:
print("Requirements already satisfied.")
except Exception as e:
print(e)
Example usage:
requirement_list = ['requests', 'httpx==0.18.2']
install_packages(requirement_list)
Relevant Info Stackoverflow Question: 58612272
Try the below. So far the best that worked for me Install the 4 ones first and then Mention the new ones in the REQUIRED list
import pkg_resources
import subprocess
import sys
import os
REQUIRED = {
'spacy', 'scikit-learn', 'numpy', 'pandas', 'torch',
'pyfunctional', 'textblob', 'seaborn', 'matplotlib'
}
installed = {pkg.key for pkg in pkg_resources.working_set}
missing = REQUIRED - installed
if missing:
python = sys.executable
subprocess.check_call([python, '-m', 'pip', 'install', *missing], stdout=subprocess.DEVNULL)
To conditionally install multiple packages with exact version, I've been using this pattern basing on @Tanmay Shrivastava's answer:
import sys
from subprocess import run, PIPE, STDOUT
import pkg_resources
def run_cmd(cmd):
ps = run(cmd, stdout=PIPE, stderr=STDOUT, shell=True, text=True)
print(ps.stdout)
# packages to be conditionally installed with exact version
required = {"click==8.0.1", "semver==3.0.0.dev2"}
installed = {f"{pkg.key}=={pkg.version}" for pkg in pkg_resources.working_set}
missing = required - installed
if missing:
run_cmd(f'pip install --ignore-installed {" ".join([*missing])}')

pipis never a good idea - the mere fact that all of its contents are in_internalstarting from version 10...pip._internalis not designed to be importable, it can do absolutely random things when imported in another program.