24

I'm currently trying to figure out what the appropriate number of workers is for each Amazon Instance Type. I used to run one Gunicorn worker, however that proved to be quite slow.

Many developers are currently using this formula to gauge how many workers would be suitable:

NUM_WORKERS=3  #recommended formula here is 1 + 2 * NUM_CORES

The problem I'm having is that Amazon isn't quite clear as to the number of cores each instance is running. For example, an M1 Small Instance has 1 EC2 Compute Unit (1 virtual core with 1 EC2 Compute Unit)

What does that essentially mean? That it has one core? or that it has two cores?

4 Answers 4

44

I know this is a old question. But I think I have a better answer to this question. Gunicorn docs suggests that 2n+1 [gunicorn -w <2n+1> myapp:wsgi] is a good guess for number of workers (Yes, n = number of cores). I came up with a tiny shell script to apply this formula. All you need to do is this:

gunicorn -w $(( 2 * `cat /proc/cpuinfo | grep 'core id' | wc -l` + 1 )) myapp:wsgi

Where the command

cat /proc/cpuinfo | grep 'core id' | wc -l

will return the total number of actual CPU cores (n). So

$(( 2 * `cat /proc/cpuinfo | grep 'core id' | wc -l` + 1 ))

equates to 2n+1 formula.

This will apply 2n+1 formula to all the linux-based machines. You dont need to know the number of workers for each type of instance or anything like that.

Reference: http://dhilipsiva.com/2015/10/22/appropriate-number-of-gunicorn-workers.html

9
  • 11
    gunicorn.conf.py import multiprocessing; workers = multiprocessing.cpu_count() * 2 + 1 docs.gunicorn.org/en/19.3/configure.html
    – kev
    Commented Oct 18, 2015 at 22:54
  • @kev so is using a .py instead of a gunicorn.service file advised? Commented Jan 27, 2019 at 0:09
  • @Mr-Programs not sure anymore what filetype it is, but it is (still) in the official documentation: docs.gunicorn.org/en/19.9.0/configure.html
    – kev
    Commented Jan 27, 2019 at 9:16
  • 4
    Why not simply use $(( 2 * `nproc` + 1 )) to get the number of processing units available?
    – Faheel
    Commented Jul 29, 2019 at 9:53
  • @Faheel, did not know that such a command existed :P
    – dhilipsiva
    Commented May 25, 2021 at 14:18
22

Building on epicbrew's work, here's how to launch 2N+1 Gunicorn workers, where N = number of CPU cores:

gunicorn --workers=$((2 * $(getconf _NPROCESSORS_ONLN) + 1)) wsgi:application

This works on both Linux and macOS! More detail on the John Tells All blog.

8

The Amazon EC2 m1.small instance type definitely has one virtual core only; from a threading/worker perspective you can ignore the EC2 Compute Unit (ECU) specification entirely and take the listed number of (virtual) cores on the Amazon EC2 Instance Types page literally, multiplying by the number of listed CPUs, where applicable (only relevant for cluster instances).

If you want to avoid doing the math and/or have programmatic access to that information, you might want to have a look at the missingcloud project - the aws.json dataset features a cores field within the instance_types collection, e.g.:

"instance_types" : {
        "m1.small" : {
            "compute_units" : 1,
            "cores" : 1,
            "gpus" : 0,
            "ramMB" : 1700,
            "storageGB" : [10, 160],
            "i/o" : "moderate",
            "ebs_optimized_iopsMbps" : 0,
            "arch" : [32,64]},
        ...
}
1
  • 1
    why do you advise to not get this info programatically? gunicorn documentation even has it done programmatically Commented Jan 27, 2019 at 0:18
4

An easy way to see how many cpu's are detected is to run top and press "1" to show the number of cpu's. You will see cpu0, cpu1, cpu2 etc.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.