I'm using a rabbitmq broker and there is a celery worker which is subscribed to the broker. From my testing, it looks like rabbitmq treats messages in FIFO order. Because one queue has been populated, then another, then another, and so on, my worker consumes all the messages from queue 1, and only moves on to queue 2 once it is done with queue one.

Is it possible to change this behavior so that the celery worker consumes in round-robin style? I.e., the celery worker consumes a message from queue 1, then a message from queue 2, and so on, only coming back to queue 1 once a message has been consumed from each of the other queues.

Thanks

Your Answer

 

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Browse other questions tagged or ask your own question.