Questions tagged [resque]
Resque (pronounced like "rescue") is a Redis-backed library for creating background jobs, placing those jobs on multiple queues, and processing them later.
1,074
questions
0
votes
1
answer
42
views
How to re run queued job in resque using redis
I am currently facing an issue in which I have scheduled job using Resque and redis but due to unavailability of any worker at the scheduled time for the job to run it got missed. Now the job remains ...
1
vote
1
answer
16
views
When does eager loading happen with resque?
I'm fairly new to resque. I recently found out that Rails.application.eager_load defaults to false in rake tasks even if the config is set to true in the environment. I'd like to set config....
0
votes
0
answers
93
views
Resque Set verify_mode on Redis to OpenSSL::SSL::VERIFY_NONE on Heroku
Due to a recent update, I need to be able to set the verify mode of Redis to verify none.
The output of Resque.redis.ping
OpenSSL::SSL::SSLError (SSL_connect returned=1 errno=0 state=error: ...
0
votes
0
answers
35
views
Finding queue name of a resque job while its being processed
My Ruby project contains many queues and I want to know if I can find which queue the current processing jobs is coming from as I need to make some decision in my code based on the queue name.
There ...
0
votes
1
answer
35
views
Rails + How do I assign dedicated workers to Resque queues?
Here, trying to assign dedicated workers to specific queues in Resque.
For example - 2 Workers are dedicated to default Queue, and 4 dedicated workers to the high queue.
Here, 16 workers to dedicated ...
0
votes
0
answers
19
views
Allocate multiple workers to the same queue in resque
I need to add a new resque queue to an existing RoR application that is already deployed in production. It would be more difficult to change how the workers are started (because it will require a ...
0
votes
0
answers
94
views
Rails Resque - AWS ECS task randomly stuck
We are running our Ruby on Rails application on AWS ECS. Application has multiple services per cluster each running X number of tasks that are responsible for jobs in their queue.
For queue we are ...
0
votes
0
answers
127
views
Redis::CommandError: LOADING Redis is loading the dataset in memory
I am using redis-rb 4.0.3.
I have the following options set up for reconnects -
:reconnect_attempts: 120
:reconnect_delay: 30
:reconnect_delay_max: 600
But when Redis Server is down, it will keep on ...
0
votes
0
answers
101
views
ruby-on-rails-7 resque config for high availability with redis sentinel
when i try the same approach for the resque.yml that works without an issue with the config.cache_store = :redis_cache_store, the resque workers are unable to connect at all:
name: mymaster
role: ...
0
votes
0
answers
157
views
TypeError: Unsupported command argument type: Resque::Worker
I am using resque gem - (1.27.4)
I upgraded my redis-rb gem to 5.0.6 from 3.3.5.
In my rails application, I initialize the Resque's redis instance as follows:
Resque.redis = Redis.new(creds)
Now I ...
0
votes
0
answers
42
views
RubyOnRails How to Kill Stuck/Stale Resque Workers
Unfortunately, one job runs every hour instead of once a day.
Frequent deployment is not possible because of Traffic.
Looking for some script to KILL the specific resque process. For reference:
Want ...
0
votes
1
answer
70
views
ActiveJob does not execute the job asynchronously
I am trying to implement an API endpoint that would queue a request and return immediately.
I am using the gem https://rubygems.org/gems/activejob/versions/5.2.0 (I am on an old version for historical ...
0
votes
0
answers
24
views
Rails + Scheduled Job executed successfully Still says Scheduled Job Failed: <JOBNAME>
In Rails App, I have added one job to update the User status from created to processing.
class UserStatusCreatedToProcessingJob < ApplicationScheduledJob
def perform
title = "[...
0
votes
0
answers
19
views
How do i maximum limit set in resque cleaner
Now I have a default resque cleaner limit
module Resque::Plugins
ResqueCleaner::Limiter.default_maximum = 10_000
end
I need a maximum limit 50000, please help with this.
0
votes
0
answers
39
views
Why don't Rails Resque Workers take tasks from the queue if they are re-registered?
Sometimes workers get stuck on a task forever. There was an idea when processing a task for a long time, mark the current one as failed, and then restart the worker, something like this:
worker....
2
votes
0
answers
116
views
Unsupported command argument type: Resque::Worker
Im attempting to run resque for a rails 7 app on my machine like this: QUEUE=* bundle exec rake resque:work
It fails with this:
rake aborted!
TypeError: Unsupported command argument type: Resque::...
0
votes
1
answer
107
views
Rails 6.0 Resque Redis and Auth
Im using rails 6.0 with resque, redis and I can't get rails server to start because i've got AUTH issues and get the following when i start rails server
vendor/bundle/ruby/2.7.0/gems/redis-4.6.0/lib/...
0
votes
1
answer
247
views
How to add a scheduled Resque job in ruby on rails?
Recently I have shifted from 'Sidekiq' to 'Resque' gem in my application. I want to shift the scheduled jobs also. But I am unaware of how to do that.
Code with Sidekiq (Before) -
class SetCurrentDay
...
0
votes
1
answer
107
views
Define worker priority in Resque
I have an app that uses Resque to enqueue process that handle video processing (similar to youtube). I have a Docker Swarm environment with multiple nodes, some nodes have one or more Resque's workers ...
0
votes
1
answer
354
views
Resque on AWS Elastic Beanstalk
I'm having trouble starting Resque on AWS Elastic Beanstalk with the Ruby 2.7 running on 64bit Amazon Linux 2/3.4.3 platform. My Procfile is as follows:
Procfile:
web: bundle exec puma -C /opt/...
1
vote
2
answers
444
views
In a Rails Gemfile, how do I reference a commit from a PR?
We need to patch rescue, and evidently someone has already created a PR here — https://github.com/resque/resque-web/pull/157/commits/0972517d6e42eeb096555a17346937d6df100d82
However, I’m not sure how ...
0
votes
1
answer
1k
views
Redis-rb - Redis::CommandError: ERR unknown command 'exists?'
Seeing some odd behavior that I can't quite explain when using Resque with Redis for async jobs. When a job fails, the method report_failed_job throws an exception stating that the command "...
0
votes
0
answers
137
views
Resque worker is failing the jobs
I have deployed a Rails app on Heroku and assigned 5 Resque workers from Heroku resources which are working fine. But it seems like there is 1 more worker is assigned from somewhere else and failing ...
2
votes
1
answer
244
views
Production level setup for Resque on AWS
We have dockerized Rails application and It is deployed on AWS(using Fargate).
Currently, we have Dev and Staging servers running on AWS. We use Resque for scheduling and queuing purpose. We do use ...
0
votes
1
answer
346
views
Cleaning Resque failed jobs in Ruby application
I have been using resque in my ruby app with resque-retry plugin. I happened to have a db issue which results into 1M failed jobs. Now these failed jobs are not coming into the fialover queue ...
2
votes
2
answers
375
views
Sprockets::Rails::Helper::AssetNotPrecompiled in ResqueWeb
I've been trying to fix this for about two days but I'm getting no where. I'm trying to get the resque-web page to show but I keep running into the error
Sprockets::Rails::Helper::AssetNotPrecompiled ...
1
vote
1
answer
362
views
Best practice to implement scheduled task execution with Rails?
In my Rails application users can cancel their subscription which should trigger a function that downgrades their account at their current_billing_period_end (this variable is provided by the API of ...
0
votes
1
answer
460
views
Kill Resque Workers from Ruby
I'm using the following command to start 2 Resque background workers from my CLI.
COUNT=2 QUEUE=* rake resque:workers RAILS_ENV=production &
When I pull code updates from git to the server, I ...
0
votes
1
answer
867
views
How to test Resque worker
Within my rails app, I have a worker that is reading an AWS SQS and then simply enqueues another worker onto Resque. I'm looking for the best way to test this with RSpec.
Is there a way to look to ...
3
votes
0
answers
71
views
Ruby - Fork throws Errno::EPIPE
What are the circumstances in which a fork do call would throw Errno::EPIPE: Broken pipe? I'm using Resque on an AWS instance and bizarrely, while Resque runs fine on a staging server, it is ...
0
votes
1
answer
100
views
Resque not failing an obviously buggy job
I have the following problem with Resque and Rails 6 (ruby 2.7.2). I am new to this gem and wanted to do some simple testing to see how things are handled, so I created a simple failing job:
class ...
0
votes
1
answer
172
views
No route matches [GET] "/resque/overview" when using resque in production with passenger
I'm using resque for background processing, the route /resque works fine in development, but in production (using passenger) it doesn't, the log/production.log shows the error:
ActionController::...
1
vote
1
answer
810
views
How to prioritize queues using Resque and Redis
My application has multiple queues and I'm trying to prioritize specific queues.
resque-pool.yml
development:
"high_priority, med_priority, low_priority": 1
According to the resque-pool ...
2
votes
1
answer
424
views
Log ActiveJob APM Traces with DataDog
my configuration is:
Datadog.configure do |c|
c.tracer enabled: Rails.env.production? || ENV['DD_TRACE_ENABLED'] == 'true'
c.tracer analytics_enabled: true
c.use :rails, service_name: 'rails'
...
0
votes
1
answer
693
views
Can someone explain the term QUEUE=* rake resque:work
On Ruby on Rails I need to start a 'rescue' task.
To let this work the command QUEUE=* rake resque:work must be executed in a new terminal (macOS).
But: Can someone explain what this actually means?
0
votes
2
answers
211
views
Shopify App on Heroku (Resque) Fails on Webhook Registration: ApiVersionNotSetError
shopify_app-13.4.0
local env works fine
when deploying to heroku and my rescue worker is trying to register webhooks I get this error:
ShopifyAPI::ApiVersion::ApiVersionNotSetError (You must set ...
0
votes
0
answers
144
views
Rails Background jobs uses all CPU memory and blocks UI actions
I am using resque gem to process background jobs for import and exports task (Asynchronous). These jobs were using almost all CPU memory if import/export task increasing and it blocks UI(Web) actions ...
1
vote
1
answer
608
views
How to delete Resque ActiveJob Queue
I am using Resque with Redis as the queuing backend via ActiveJob. How do I clear all queues to prevent jobs from running again.
From the docs, I see that I can do
Resque::Job.destroy(queue_name, "...
1
vote
1
answer
492
views
Why does Resque show "0 out of 0 Workers Working" while a worker is running? No jobs getting picked up
I'm trying to test out my Ruby on Rails app. I have redis running, I have a rails server setup and I started a Resque worker in the terminal via the command rake resque:work QUEUE=*, which responds ...
0
votes
1
answer
70
views
Can Resque Cleaner be expanded to store >1000 failed jobs?
I have Resque Cleaner set up with Redis and a Ruby on Rails framework. I noticed the cleaner fills with failed jobs up until the 1000 mark. I've been trying to find a way to increase the 1000 ...
0
votes
2
answers
1k
views
Not working a background job with using Resque on Heroku
I have my rails application that has a job (using Active Job). I use resque and resque-scheduler gems for queuing backend.
I want to connect my rails application to a redis-to-go server with Resque ...
0
votes
1
answer
423
views
How to pass parameters into xml file?
I have a job like this: jobs/create_site_map.rb
class CreateSiteMap
@queue = :create_site_map
def self.perform(slct_common_path, http_host, domain_name)
... some code ...
...
0
votes
2
answers
506
views
Wrong number of arguments - resque
I have a job create_site_map.rb like below:
class CreateSiteMap
@queue = :create_site_map
def self.perform(slct_common_path, http_host, site_id)
end
end
And a rake file:
require "resque/tasks"...
0
votes
1
answer
322
views
Debugging Resque::Server
We have two Rails applications using Resque and Redis. Resque and Redis are configured identically on both apps, which are both using Rails 4.2 and Resque 1.27.4.
However, the availability of Resque ...
4
votes
1
answer
2k
views
Resque error: DirtyExit - Child process received unhandled signal
My background jobs are all failing with the following error Resque::DirtyExit Child process received unhandled signal. After I restart the server they work for some minutes and then start failing. If ...
0
votes
0
answers
66
views
Can one rails application connect to multiple resque?
I using single rails application and I like to connect multiple resque to publish a message to multiple resque queues
I am using resque gem but I not see any way to configure multiple resque can ...
4
votes
1
answer
1k
views
How to set dynamic resque queue
I wish I could decide on which queue to go to work.
This is because if the job is scheduled by the server (cronjob) it must be run on a slow queue, if instead it is run by the user it will go on a ...
1
vote
1
answer
97
views
Stalled Resque Worker Monitoring on Heroku
I am using Resque on Heroku with Heroku Redis. Occasionally and intermittently, the Resque workers are stalling. There are no errors; the workers just don't do anything (it seems). Restarting the ...
0
votes
1
answer
64
views
Rails 5 - Running Resque on a Separate Machine
I understand how to setup a machine to run Resque with the environment, etc. What I cannot find, is now to point a Web (etc) server to (use) a queue on a separate machine.
For example, I am using ...
3
votes
1
answer
1k
views
Resque: how can i use specific worker for only one specific queue
in my rails 5 app i use resque and resque-scheduler for sending message to my customer.for that i created different different queue for messages and created 3 worker for sending message using queue.
...