1893

I am trying to build a shared library using a C extension file but first I have to generate the output file using the command below:

gcc -Wall utilsmodule.c -o Utilc

After executing the command, I get this error message:

> utilsmodule.c:1:20: fatal error: Python.h: No such file or directory
compilation terminated.

I have tried all the suggested solutions over the internet but the problem still exists. I have no problem with Python.h. I managed to locate the file on my machine.

37 Answers 37

3529

Looks like you haven't properly installed the header files and static libraries for python dev. Use your package manager to install them system-wide.

For apt (Ubuntu, Debian...):

sudo apt-get install python-dev   # for python2.x installs
sudo apt-get install python3-dev  # for python3.x installs

For yum (CentOS, RHEL...):

sudo yum install python-devel    # for python2.x installs
sudo yum install python3-devel   # for python3.x installs

For dnf (Fedora...):

sudo dnf install python2-devel  # for python2.x installs
sudo dnf install python3-devel  # for python3.x installs

For zypper (openSUSE...):

sudo zypper in python-devel   # for python2.x installs
sudo zypper in python3-devel  # for python3.x installs

For apk (Alpine...):

# This is a departure from the normal Alpine naming
# scheme, which uses py2- and py3- prefixes
sudo apk add python2-dev  # for python2.x installs
sudo apk add python3-dev  # for python3.x installs

For apt-cyg (Cygwin...):

apt-cyg install python-devel   # for python2.x installs
apt-cyg install python3-devel  # for python3.x installs

Important Note: python3-dev/devel does not automatically cover all minor versions of python3.
E.g If you are using python 3.11 you may need to install python3.11-dev / python3.11-devel.

9
  • 4
    What if we don't have su access on the machine? I'm working in a viritual env with local user authorization. Is there any "pip"-like fix available, or someplace we can manually place a copy of Python.h?
    – sh37211
    Commented Jul 21, 2022 at 20:06
  • 1
    @sh37211 Yeah, you would usually just download the CPython sources to your homedir. Some custom linker options providing the path would usually be required in that case.
    – wim
    Commented Nov 15, 2022 at 2:25
  • 1
    @PhilGoetz See how to install apt-cyg for Cygwin?
    – wim
    Commented Feb 4, 2023 at 20:03
  • 11
    It seems that we need to install the specific python(2-3)-dev version. Sample for 3.11: sudo apt-get install python3.11-dev. Only this worked for me.
    – Thanos
    Commented Feb 8, 2023 at 9:42
  • 2
    @sh37211 a bit late but i would go with linuxbrew. Compiling python from source needs some (a lot) packages installed from system package manager too Commented Jun 22, 2023 at 9:14
566

On Ubuntu, I was running Python 3 and I had to install

sudo apt-get install python3-dev

If you want to use a version of Python that is not linked to python3, install the associated python3.x-dev package. For example:

sudo apt-get install python3.5-dev
3
  • 10
    If you are using virtual envs with different python versions, make sure to create the virtual env after the necessary dev package is installed. Otherwise the header files won't be copied correctly. Commented Feb 28, 2022 at 22:10
  • 1
    The python version addition was quite helpful in my case
    – Chiffa
    Commented Mar 13, 2023 at 9:38
  • Thanks very much! I tried this for python3.7 inside a virtualenv and it worked! Commented Jul 5 at 13:45
436

For Python 3.7 and Ubuntu in particular, I needed

sudo apt install libpython3.7-dev

. I think at some point names were changed from pythonm.n-dev to this.

for Python 3.6, 3.8 through 3.10 (and counting…) similarly:

sudo apt install libpython3.6-dev

sudo apt install libpython3.8-dev

sudo apt install libpython3.9-dev

sudo apt install libpython3.10-dev

sudo apt install libpython3.11-dev

sudo apt install libpython3.12-dev

6
  • 6
    Same for Python 3.10
    – Daniel
    Commented Feb 28, 2022 at 9:40
  • 1
    This was the best solution for pyhton3.10. Commented Feb 6, 2023 at 10:48
  • This is the only suggestion I've found that works for 3.11. Thanks!
    – shacker
    Commented Jun 17, 2023 at 7:21
  • 2
    worked on 3.12 for compiling packages, thanks!
    – sp1111
    Commented Oct 6, 2023 at 0:19
  • 1
    It solved this issue for Python 3.6 (deadsnakes)
    – Eido95
    Commented Sep 1 at 6:30
101

Two things you have to do.

Install development package for Python, in case of Debian/Ubuntu/Mint it's done with command:

sudo apt-get install python-dev

Second thing is that include files are not by default in the include path, nor is Python library linked with executable by default. You need to add these flags (replace Python's version accordingly):

-I/usr/include/python2.7 -lpython2.7 

In other words your compile command ought to be:

gcc -Wall -I/usr/include/python2.7 -lpython2.7  utilsmodule.c -o Utilc 
2
  • do I have to add flags for each included file in the C extension file ??
    – Mohanad Y.
    Commented Feb 4, 2014 at 8:38
  • 1
    If you are using another version of Python, 3.3 for example: sudo apt-get install python3.3-dev
    – FreshPow
    Commented Aug 6, 2014 at 13:07
42

on Fedora run this for Python 2:

sudo dnf install python2-devel

and for Python 3:

sudo dnf install python3-devel
1
  • 1
    On Mint 18.2 (Ubuntu based), it was apt-get install python-dev. Commented Aug 31, 2017 at 15:59
36

If you are using tox to run tests on multiple versions of Python, you may need to install the Python dev libraries for each version of Python you are testing on.

sudo apt-get install python2.6-dev 
sudo apt-get install python2.7-dev 
etc.
0
35

Make sure that the Python dev files come with your OS.

You should not hard code the library and include paths. Instead, use pkg-config, which will output the correct options for your specific system:

$ pkg-config --cflags --libs python2
-I/usr/include/python2.7 -lpython2.7

You may add it to your gcc line:

gcc -Wall utilsmodule.c -o Utilc $(pkg-config --cflags --libs python2) 
2
  • I get the following error message on RHEL: "Unknown option -I/usr/include/python2.7" Commented Jun 10, 2020 at 12:05
  • @FedorSteeman, someone edited my answer and removed the newline from the command.
    – sleblanc
    Commented Jul 1, 2020 at 20:18
32

For me, changing it to this worked:

#include <python2.7/Python.h>

I found the file /usr/include/python2.7/Python.h, and since /usr/include is already in the include path, then python2.7/Python.h should be sufficient.

You could also add the include path from command line instead - gcc -I/usr/lib/python2.7 (thanks @erm3nda).

7
  • 6
    All the other answers tell you to install something. This one worked for me. Why isn't this the top answer? Commented Aug 8, 2016 at 16:20
  • 3
    @ uoɥʇʎPʎzɐɹC Maybe because it won't run under python3 ?
    – Louis
    Commented Aug 31, 2016 at 6:44
  • It is better to set the lib at gcc -I/usr/lib/python2.7 etc rather than hardcode the include calls.
    – m3nda
    Commented Mar 29, 2017 at 2:31
  • 4
    @noɥʇʎԀʎzɐɹƆ Because it should work without changing the code. You often need to compile a code not owned by you, some external dependency for example, and the worst thing you can do is to modify that code. Commented Apr 19, 2017 at 12:38
  • 1
    This worked for me in Python3 as well
    – Gokul nath
    Commented Sep 20, 2022 at 14:28
29

Solution for Cygwin

You need to install the package python2-devel or python3-devel, depending on the Python version you're using.

You can quickly install it using the 32-bit or 64-bit setup.exe (depending on your installation) from Cygwin.com.

Example (modify setup.exe's filename and Python's major version if you need):

$ setup.exe -q --packages=python3-devel

You can also check my other answer for a few more options to install Cygwin's packages from the command-line.

28

In AWS API (centOS) its

yum install python27-devel
5
  • This does not provide an answer to the question. To critique or request clarification from an author, leave a comment below their post - you can always comment on your own posts, and once you have sufficient reputation you will be able to comment on any post.
    – Wtower
    Commented Jul 9, 2015 at 7:58
  • 2
    @Wtower Yes, it does provide an answer. Commented Jul 9, 2015 at 14:28
  • 1
    It does provide an answer. Although you have to substitute the version for what you need. Commented Aug 3, 2015 at 2:45
  • 1
    this helped overcome my issues attempting to pip install cryptography on an amazon linux instance.
    – ryantuck
    Commented Mar 6, 2017 at 23:34
  • This was a helpful answer, while it is possible to install python-devel or python2-devel on Amazon Linux, this is the only one that actually worked for me when running a pip install inside a virtualenv Commented Oct 18, 2017 at 2:15
28

AWS EC2 install running python34:

sudo yum install python34-devel

1
  • This worked for me: yum install python3-devel Commented Jul 26, 2022 at 16:41
23

This problem can also arise when you have different Python versions installed and you use a pip that's not the system's one. In that case, the non-system pip won't find the right version of Python headers.

It happened to me when trying to pip install a package for a Python bundled with an application. As it was not system's python, apt install pythonXX-dev didn't work.

In this case, the solution is to find the right python header:

find / -iname 'Python.h'

In the output, you will see system python headers, and hopefully the one you are looking for, for example:

/usr/include/python3.7m/Python.h
/usr/include/python3.6m/Python.h
/home/ubuntu/workspace/blender-git/lib/linux_centos7_x86_64/python/include/python3.7m/Python.h
/home/ubuntu/miniconda3/pkgs/python-3.8.5-h7579374_1/include/python3.8/Python.h
/home/ubuntu/miniconda3/pkgs/python-3.7.0-h6e4f718_3/include/python3.7m/Python.h
/home/ubuntu/miniconda3/include/python3.8/Python.h
/home/ubuntu/miniconda3/envs/sim/include/python3.7m/Python.h
/home/ubuntu/src/blender-deps/Python-3.7.7/Include/Python.h
/opt/lib/python-3.7.7/include/python3.7m/Python.h

Then, you can set a compiler flag that will get used by gcc when called by pip. Mine was /home/ubuntu/workspace/blender-git/lib/linux_centos7_x86_64/python/include/python3.7m/Python.h, so I did:

export CPPFLAGS=-I/home/ubuntu/src/blender-deps/Python-3.7.7/Include
pip install <package>
7
  • What is the purpose of -I ? Commented Dec 23, 2021 at 9:40
  • @SultanAhmedSagor the -I flag tells the compiler that it is a path in which look for header files (-I as "include", I guess): caiorss.github.io/C-Cpp-Notes/compiler-flags-options.html
    – Milo
    Commented Dec 23, 2021 at 10:10
  • 2
    Thanks, this gave me the hint I needed - I needed to install python3.8-dev :) Commented Dec 25, 2021 at 18:07
  • I mixed this and "rpm -ql python36-devel.x86_64 | grep -i "Python.h" solution. Helped a lot! thanks!
    – Seeker
    Commented Jul 19, 2022 at 20:00
  • 3
    This is the most killer answer right here! Instead of randomly installing new dependencies, first search for your system.
    – Fusion
    Commented Jul 19, 2023 at 9:09
19

If you use a virtualenv with a 3.6 python (edge right now), be sure to install the matching python 3.6 dev sudo apt-get install python3.6-dev, otherwise executing sudo python3-dev will install the python dev 3.3.3-1, which won't solve the issue.

1
  • 2
    Worked great for me on 3.5(.2), too. Explicitly installing the right dev package for your version of Python is a Good Thing.
    – Seth
    Commented May 29, 2017 at 13:52
17

In my case, what fixed it in Ubuntu was to install the packages libpython-all-dev (or libpython3-all-dev if you use Python 3).

2
  • 2
    python-all-dev in my case, but close enough.
    – Dave S.
    Commented May 31, 2016 at 19:07
  • 1
    @Oriol Nieto, Thank you very much. python-all-dev also solved the issue for me. Commented Feb 22, 2017 at 14:17
16

I managed to solve this issue and generate the .so file in one command

gcc -shared -o UtilcS.so
-fPIC -I/usr/include/python2.7 -lpython2.7  utilsmodule.c
15

It's not the same situation, but it also works for me and now I can use SWIG with Python3.5:

I was trying to compile:

gcc -fPIC -c existe.c existe_wrap.c -I /usr/include/python3.5m/

With Python 2.7 works fine, not with my version 3.5:

existe_wrap.c:147:21: fatal error: Python.h: No existe el archivo o el directorio compilation terminated.

After run in my Ubuntu 16.04 installation:

sudo apt-get install python3-dev  # for python3.x installs

Now I can compile without problems Python3.5:

gcc -fPIC -c existe.c existe_wrap.c -I /usr/include/python3.5m/
0
13

I also encountered this error when I was installing coolprop in ubuntu.

For ubuntu 16.04 with python 3.6

sudo apt-get install python3.6-dev

If ever this doesn't work try installing/updating gcc lib.

sudo apt-get install gcc
1
  • 1
    omg, I struggled with this for SO long because I had run python3-dev many times and kept getting the same error, but didn't know about python3.6-dev!! Thanks!!
    – Blairg23
    Commented Mar 14, 2019 at 4:35
12

try apt-file. It is difficult to remember the package name where the missing file resides. It is generic and useful for any package files.

For example:

root@ubuntu234:~/auto# apt-file search --regexp '/Python.h$'
pypy-dev: /usr/lib/pypy/include/Python.h
python2.7-dbg: /usr/include/python2.7_d/Python.h
python2.7-dev: /usr/include/python2.7/Python.h
python3.2-dbg: /usr/include/python3.2dmu/Python.h
python3.2-dev: /usr/include/python3.2mu/Python.h
root@ubuntu234:~/auto# 

Now you can make an expert guess as to which one to choose from.

11

Here is yet another solution, because none of these solutions worked for me. For reference, I was trying to pip install something on an Amazon Linux AMI base Docker image for Python 3.6.

Non-docker solution:

# Install python3-devel like everyone says
yum -y install python36-devel.x86_64

# Find the install directory of `Python.h`
rpm -ql python36-devel.x86_64 | grep -i "Python.h"

# Forcefully add it to your include path
C_INCLUDE_PATH='/usr/include/python3.6m'
export C_INCLUDE_PATH

Docker solution:

# Install python3-devel like everyone says
RUN yum -y install python36-devel.x86_64

# Find the install directory of `Python.h`, for me it was /usr/include/python3.6m
RUN rpm -ql python36-devel.x86_64 | grep -i "Python.h" && fake_command_so_docker_fails_and_shows_us_the_output

# Since the previous command contains a purposeful error, remove it before the next run

# Forcefully add it to your include path
ARG C_INCLUDE_PATH='/usr/include/python3.6m'

NOTE: If you're getting the error when compiling C++, use CPLUS_INCLUDE_PATH.

Alternatively, you may prefer to use another Docker image. For example, I was trying to install asyncpg~=0.24.0 on python:3.9.4-slim, which generated the same error as you saw. However, when I updated the image to python:3, it worked fine.

4
  • 2
    The exact solution to my problem, thanks! Commented Jun 14, 2021 at 11:16
  • Worked for amazon linux like a charm. Glad i found your solution. Thank you
    – deeshank
    Commented Aug 28, 2021 at 6:22
  • As of 2022 went great. I added the commands you pointed out in a single line of my build spec, separated by ; so the EXPORT would work
    – damuz91
    Commented Mar 4, 2022 at 13:32
  • Worked on centos 8 plesk django 4.2 app thank you
    – Crimeira
    Commented Oct 14, 2023 at 19:10
10

For CentOS 7:

sudo yum install python36u-devel

I followed the instructions here for installing python3.6 on several VMs: https://www.digitalocean.com/community/tutorials/how-to-install-python-3-and-set-up-a-local-programming-environment-on-centos-7 and was then able to build mod_wsgi and get it working with a python3.6 virtualenv

9

For the OpenSuse comrades out there:

sudo zypper install python3-devel
1
  • make sure to use the exact version of python, e.g. python39-devel
    – wisbucky
    Commented Aug 23, 2023 at 18:30
8

If you're using Python 3.6 on Amazon Linux (based on RHEL, but the RHEL answers given here didn't work):

sudo yum install python36-devel
0
7
  1. You must install the Python development files on your operating system if the Python provided with your operating system does not come with them. The many answers on this question show the myriad ways this can be achieved on different systems.

  2. When you have done so, the problem is telling the compiler where they're located and how to compile against them. Python comes with a program called python-config. For compilation, you need the --includes output and for linking a program against the Python library (embedding Python into your program) the --ldflags output. Example:

    gcc -c mypythonprogram.c $(python3-config --includes)
    gcc -o program mypythonprogram.o $(python3-config --ldflags)
    

The python-config program can be named after the Python versions - on Debian, Ubuntu for example these can be named python3-config or python3.6-config.

6

Sure python-dev or libpython-all-dev are the first thing to (apt )install, but if that doesn't help as was my case, I advice you to install the foreign Function Interface packages by sudo apt-get install libffi-dev and sudo pip install cffi.

This should help out especially if you see the error as/from c/_cffi_backend.c:2:20: fatal error: Python.h: No such file or directory.

1
  • sudo pip3 install cffi (# for python3) Commented Sep 16, 2017 at 4:29
5

try locate your Python.h:

gemfield@ThinkPad-X1C:~$ locate Python.h
/home/gemfield/anaconda3/include/python3.7m/Python.h
/home/gemfield/anaconda3/pkgs/python-3.7.6-h0371630_2/include/python3.7m/Python.h
/usr/include/python3.8/Python.h

if not found, then install python-dev or python3-dev; else include the correct header path for compiler:

g++ -I/usr/include/python3.8 ...
2
  • neat. Thank you!
    – aerijman
    Commented May 14, 2021 at 18:40
  • On CentOS you have to run yum install mlocate first, in case anyone else tries this! Commented Sep 16, 2022 at 16:12
5

I am on Ubuntu. I have installed all packages as was recommended in some answers.

sudo apt-get install python-dev   # for python2.x installs
sudo apt-get install python3-dev  # for python3.x installs

I still had this problem, the line:

#include "Python.h"

And some others, I can edit them manually, it is a bad practice. I know the secret now, it comes from the cython source code. I have the file. It compiles without errors. That is the file. Change PYTHON to python version you have, python/python3. Change FILE to your c-filename. The name of the makefile file should be Makefile. Run the the file with the command:

make all

Makefile for creating our standalone Cython program

    FILE := file.c
    PYTHON := python3
    PYVERSION := $(shell $(PYTHON) -c "import sys;                     
    print(sys.version[:3])")
    PYPREFIX := $(shell $(PYTHON) -c "import sys; print(sys.prefix)")

    INCDIR := $(shell $(PYTHON) -c "from distutils import sysconfig; 
    print(sysconfig.get_python_inc())")
    PLATINCDIR := $(shell $(PYTHON) -c "from distutils import 
    sysconfig; print(sysconfig.get_python_inc(plat_specific=True))")
    LIBDIR1 := $(shell $(PYTHON) -c "from distutils import sysconfig; 
    print(sysconfig.get_config_var('LIBDIR'))")
    LIBDIR2 := $(shell $(PYTHON) -c "from distutils import sysconfig; 
    print(sysconfig.get_config_var('LIBPL'))")
    PYLIB := $(shell $(PYTHON) -c "from distutils import sysconfig; 
    print(sysconfig.get_config_var('LIBRARY')[3:-2])")

    CC := $(shell $(PYTHON) -c "import distutils.sysconfig; 
    print(distutils.sysconfig.get_config_var('CC'))")
    LINKCC := $(shell $(PYTHON) -c "import distutils.sysconfig; 
    print(distutils.sysconfig.get_config_var('LINKCC'))")
    LINKFORSHARED := $(shell $(PYTHON) -c "import distutils.sysconfig; 
    print(distutils.sysconfig.get_config_var('LINKFORSHARED'))")
    LIBS := $(shell $(PYTHON) -c "import distutils.sysconfig; 
    print(distutils.sysconfig.get_config_var('LIBS'))")
    SYSLIBS :=  $(shell $(PYTHON) -c "import distutils.sysconfig; 
    print(distutils.sysconfig.get_config_var('SYSLIBS'))")

    .PHONY: paths all clean test

    paths:
        @echo "PYTHON=$(PYTHON)"
        @echo "PYVERSION=$(PYVERSION)"
        @echo "PYPREFIX=$(PYPREFIX)"
        @echo "INCDIR=$(INCDIR)"
        @echo "PLATINCDIR=$(PLATINCDIR)"
        @echo "LIBDIR1=$(LIBDIR1)"
        @echo "LIBDIR2=$(LIBDIR2)"
        @echo "PYLIB=$(PYLIB)"
        @echo "CC=$(CC)"
        @echo "LINKCC=$(LINKCC)"
        @echo "LINKFORSHARED=$(LINKFORSHARED)"
        @echo "LIBS=$(LIBS)"
        @echo "SYSLIBS=$(SYSLIBS)"

    $(FILE:.c=): $(FILE:.c=.o)
        $(LINKCC) -o $@ $^ -L$(LIBDIR1) -L$(LIBDIR2) -l$(PYLIB)         
    $(LIBS) $(SYSLIBS) $(LINKFORSHARED)

    $(FILE:.c=.o): $(FILE)
        $(CC) -c $^ -I$(INCDIR) -I$(PLATINCDIR)

    all: $(FILE:.c=)
2
  • Note: python3-dev does not automatically cover all minor versions of python3, if you are using e.g. python 3.8 you may need to install python3.8-dev Commented Dec 25, 2021 at 18:08
  • The problem is that I have a wrong include #include "Python.h". Compiler doesn't see it. You should edit the path manually. Or you can take the Makefile that I have posted. This file does the same as the manual edit of #include Commented Dec 25, 2021 at 19:19
4

This error occurred when I attempted to install ctds on CentOS 7 with Python3.6. I did all the tricks mentioned here including yum install python34-devel. The problem was Python.h was found in /usr/include/python3.4m but not in /usr/include/python3.6m. I tried to use --global-option to point to include dir (pip3.6 install --global-option=build_ext --global-option="--include-dirs=/usr/include/python3.4m" ctds). This resulted in a lpython3.6m not found when linking ctds.

Finally what worked was fixing the development environment for Python3.6 needs to correct with the include and libs.

yum -y install https://dl.iuscommunity.org/pub/ius/stable/CentOS/7/x86_64/python36u-libs-3.6.3-1.ius.centos7.x86_64.rpm

Python.h needs to be in your include path for gcc. Whichever version of python is used, for example if it's 3.6, then it should be in /usr/include/python3.6m/Python.h typically.

1
  • Not sure why there is a -1 but this is a problem as of today for python3.6 with CentOS as python36-devel is not available. You will need to install it from the URL above. Commented Nov 16, 2017 at 2:25
4

Sometimes even after installing python-dev the error persists, Check for the error if it is 'gcc' missing.

First download as stated in https://stackoverflow.com/a/21530768/8687063, then install gcc

For apt (Ubuntu, Debian...):

sudo apt-get install gcc

For yum (CentOS, RHEL...):

sudo yum install gcc

For dnf (Fedora...):

sudo dnf install gcc

For zypper (openSUSE...):

sudo zypper in gcc

For apk (Alpine...):

sudo apk gcc
3

It often appear when you trying to remove python3.5 and install python3.6.

So when using python3 (which python3 -V => python3.6) to install some packages required python3.5 header will appear this error.

Resolve by install python3.6-dev module.

2

This means that Python.h isn't in your compiler's default include paths. Have you installed it system-wide or locally? What's your OS?

You could use the -I<path> flag to specify an additional directory where your compiler should look for headers. You will probably have to follow up with -L<path> so that gcc can find the library you'll be linking with using -l<name>.

Not the answer you're looking for? Browse other questions tagged or ask your own question.