Questions tagged [worker]
In software, the term worker usually describes a long-running process being executed in a separate thread from an application's main thread of execution. Consider [tag:web-worker] for javascript.
1,244
questions
0
votes
0
answers
6
views
Catching tensorflow packets ( TCP packets ) for averaging gradients in Parameter server architechture
I am using tensorflow version 1.15.0 python version 3 and a single CPU
I am trying to find a way to figure out what is the actual data sent between a parameter server and a worker in order to gather ...
0
votes
0
answers
5
views
Limiting Number of Mturk Project Being Displayed
When using the URL worker.mturk.com/projects I'm getting a large number of HITs. I think all available qualified HITs. Is there a URL parameter that will limit the number of HITs displayed? I thought ...
0
votes
0
answers
39
views
Web worker memory leak when using transferables
I'm sending a canvas image as a bitmap to a web worker, which converts it to a blob and sends it back. Including the ImageBitmap and the returning ArrayBuffer in the postMessage transferables seems to ...
0
votes
0
answers
32
views
Hosting and help for scraper/worker
First of all, I am not sure if it's scraper or not sorry for that.
I am using Javascript and what I do is, I download a .gz file, extract json file in it, read the json and extract almost 900k IDs. ...
0
votes
0
answers
6
views
worker-farm module slowed after concurrent call limit is hit
I saw worker-farm as a threading module in node.js, it works well but after a bit it starts slowing down, i think this is because maximum concurrent calls per worker is reached, how do i prevent it ...
0
votes
1
answer
20
views
worker.js: window is not defined
I am trying to make a worker that will run automatically and constantly check the browser's width, but, I am getting this error: worker.js:1 Uncaught ReferenceError: window is not defined at worker.js:...
0
votes
0
answers
60
views
How to use serilog in a .NET 6 Worker service when using an absolute file path?
In several questions, people already experienced problems with Serilog in .NET 6 when writing logs to log file, such as here and here. I also experience such problems but when using an absolute file ...
0
votes
1
answer
38
views
Setup an email notification when consumer: Connection to broker lost in celery
I want to implement an email system which will send an email whenever my celery worker lost connection with my Redis server.
Whenever it lost connection it gives warning:
[2023-03-02 21:33:48,272: ...
0
votes
0
answers
53
views
"an unexpected error occurred on a send" on v2ray client
I have set up a server on Doprax to run a v2ray-fork from github. I connected my cloudflare worker to it for host and SNI. I made a Vmess server and it was working just fine for about 20 days. It ...
0
votes
0
answers
26
views
how to keep a web worker self-contained [duplicate]
I built a website that relies on frequently requesting and displaying data from a rest-api using fetch().
After I was done with the hardest part of the work I found that my site doesn't refresh like ...
0
votes
0
answers
29
views
Airflow - DAG clear and failed to fetch log from worker
Hope you're doing well.
We are currently working on an Airflow 1.10.3 version.
I have a dag that is based on a MySQL Hook which has been recently upgraded.
Somehow, the task was never able to start ...
0
votes
0
answers
19
views
ThreadPoolExecutor in Databricks and Driver Node Memory Issue
I am using a threadpool executor and running notebooks in parallel. However, these parallel notebooks are not using executors at all and all the load is going towards the driver node resulting in ...
1
vote
0
answers
20
views
Prevent Node.js worker crash from propagating to main thread
I'm using Node.js workers to run resources-intensive units of work in isolation, and to be able to keep the system alive in case one of them crashes badly.
However, when a Node.js worker crashes it ...
0
votes
0
answers
14
views
How to intercept backend (api) requests at browser level in multi monitor setup
Problem:
Assume an application launched in multimonitor. i.e. Application launched in 2 monitors with separate browser instances.
Now each browser instance makes a API call to backend to load the data ...
0
votes
0
answers
39
views
can't access lexical declaration before initialization during Angular service worker update
I develop an Angular app that uses a service worker (ngsw-config.json etc...).
I'm testing the Angular service worker update mechanism.
I get this error message in browser console when a new app ...
-2
votes
1
answer
33
views
For a web application in Python running in a web server with WSGI, how to have one single WSGI Worker performing a task?
My web application with Python 3.9 and Flask is running in a web server with WSGI.
As more users connect to the web server, more workers are started by WSGI, but there are some tasks that must be ...
0
votes
0
answers
24
views
Heroku can't run Node.js bot [duplicate]
I've this app online for almost 6 months. When did Heroku become paid?
I turned off the app and now turned on again, but with this error message:
2023-02-17T01:41:42.781769+00:00 heroku[web.1]: ...
0
votes
1
answer
26
views
ASP.NET Core Web API - How to resolve services are not able to be constructed (Error while validating the service descriptor
In ASP.NET Core 6, I am implementing Windows worker service using this code in the Program.cs:
IHost host = Host.CreateDefaultBuilder(args)
.UseWindowsService()
.ConfigureServices(services =&...
1
vote
1
answer
29
views
What's the best way to schedule a Scrapy spider?
I need my spider to run every minute. Usually for scheduling tasks I use celery-beat, however, from what I've read, Celery is not used with scrapy.
What's the best approach to schedule scrapy spiders?
1
vote
0
answers
109
views
Why background service is not working as a service but works as an executable?
I have created a background service in C#. Last week I moved it to my virtual machine, I created a service as sc.exe create NameOfService binPath= blabla and worked perfectly until Sunday (yesterday 2/...
-1
votes
1
answer
36
views
Promise and work thread chunking not working
I have this in my code where i am using promise to limit at max MAX_WORKERS workgroup at a time.
const MAX_WORKERS = 3;
let promises = [];
let chunk = 3;
let totalNodes = keyCountMap.length / 2;
...
0
votes
0
answers
17
views
Access Cordova plugin in web worker
This is in regards to
Get Cordova plugin file to fully work in a web worker
I am unable to access Cordova plugins in the web worker. Is there support for Cordova in web worker?
0
votes
0
answers
28
views
not able to make multiple work group working and causing freeze
I am doing create multiple worker threads, in my case, i am trying to create 2:
This is my code to create work thread
function createWorker(data1, data2) {
return new Promise((resolve) => {
...
0
votes
0
answers
101
views
Android: Migrate Foreground Service to WorkManager
My application uses location in the background. From Android 12 onwards, we are not supposed to use Foreground Service and if we use it, the application crashes with the below exception:
Fatal ...
0
votes
0
answers
43
views
How to know which Node is Master Node, which Node is Worker Node for Spark-YARN (Cloudera)?
I'm using a tool in which I have to point out the master node (link format is spark://<some-spark-master>:7077) of the Cloudera Spark Cluster. Also as I learned, Spark has "Master Node"...
0
votes
1
answer
74
views
A Golang Worker Pool, where the workers themselves open and close the SQL Connections
i was experimenting with Go worker pools to speed up my import script with concurrent workers. But without any luck by now. And i spend lot of hours until i wrote this post...
First i used this one ...
4
votes
1
answer
150
views
Laravel Horizon Restrictions and Optimization
Is there any rule of thumb or any logical relation between maxProcesses, number of supervisors and the total number of queues in laravel horizon?
What if I have 15 supervisors and 40 queues (each ...
0
votes
1
answer
31
views
how do I return a value from a worker for a function in Javascript
I have a function that spawns a worker
function fetchFile(mes) {
const worker = new Worker('worker.js');
worker.postMessage(mes);
//somehow return the message returned by the worker
}
...
0
votes
0
answers
20
views
Creating new rapier2D world in other CPU threads. Cannot read properties of undefined (reading 'rawintegrationparameters_new')
I'm trying to create a new physic world (by @dimforge/rapier2d-compat physic engine) in other CPU threads with Worker. but it throws this error :
TypeError [Error]: Cannot read properties of undefined ...
1
vote
0
answers
24
views
uWSGI mules' counterpart in Gunicorn
Does Gunicorn have a separate worker like the uwsgi mules that I can use to offload tasks? I need at least 4 workers dedicated to certain logics. I searched the documentation but I can't find anything ...
0
votes
0
answers
31
views
Performance issue in odoo 15 with AWS EC2 2 core cpu and 4 gb ram
We have recently upgraded from Odoo 12 to Odoo 15, both community versions, and are now experiencing performance issues on your AWS EC2 server.
The server has 2 cores cpu and 4GB of RAM and we are ...
0
votes
0
answers
54
views
Alternative to resolve max connection limit issue in sqlalchemy?
Summary
We run into the MySQL “max connection reached” issue by making a lot of read/write queries from different python multiprocessing workers from different autoscaled AWS server instances, ...
2
votes
1
answer
32
views
How can i add net5.0 Worker Application AddJsonOptions
There are API project and Worker project in the solution. The API project is written in net5.0 Microsoft.NET.Sdk.Web.
In Startup.cs
services.AddControllers().AddJsonOptions(options =>
{
...
1
vote
0
answers
26
views
Run heavy script in background using worker threads in Meteor
I am using Meteorjs
I have one heavy query which I need to run in background
e.g:
Meteor.users.update({}, {$set:{status: 1}});
I need this query to run in background.
For that I used worker threads.
...
0
votes
0
answers
37
views
Run the same python script with different values over 200 times at once
Before getting too far, I do not think that multiprocessing or Threading will work in this scenario.
I currently have written a Python worker that sends HTTP Post requests to gather data and when an ...
0
votes
0
answers
23
views
Unix socket is sending stop request to the worker from time to time
I'm using Workerman to create a UNIX socket to which I'm connecting and searching keywords. The problem is that from time to time (it could be after 1 second, or after 1 min, or even not all) stop ...
-1
votes
1
answer
23
views
Call worker via postmessage from a class
I am currently learning how to handle with workers. I made a very simple example with a class.
All js files are in the src folder.
//***********index.html**************
<!DOCTYPE html>
<...
0
votes
2
answers
36
views
Dokku remove worker without finishing tasks
I have Ruby on Rails app and after I do any deployment with Dokku, I have my old worker running the tasks normally, but when I complete the deploy, after a few seconds this worker is removed and a new ...
0
votes
0
answers
13
views
I need to several celery projects configured on a single server
On a machine, I want to configure celery beat and celery worker.
test environment beat
celery -A test_project.celery -Q test -n test beat -l info
test environment worker
celery -A test_project.celery ...
1
vote
0
answers
24
views
Running Service Worker cause an error responding to the control function (NET HELPMSG 2186)
I am developing a .net Service Worker. When I publish it, I can run the Worker and it works normally. But when I going to make it as a Windows Service, it doesn't run and causes error by message:
The ...
0
votes
1
answer
86
views
Options Pattern Class not Populating
I'm creating a .NET 6 worker service, hosted as a windows service. The service uses the FluentFTP library to download files from a remote server. I'm trying to implement strongly-typed configuration ...
0
votes
0
answers
35
views
observing PeriodicWorkRequest doesn't work
I'm wanna to use Worker for creating notifications for Jetpack Compose App.
this a function in TasksViewModel.kt
private fun setPeriodicNotification(context: Context, tasks: Flow<List<Task>&...
0
votes
0
answers
47
views
Flower UI not showing processes from all running Celery pods
My config has 1 celery worker, 1 queue and I have 5 pods running celery, each with concurrency of 8. I can see the incoming tasks being spread to all 5 pods.But Flower UI shows 1 queue having max ...
0
votes
1
answer
58
views
How to Create Workers Dynamically in Ballerina
How can I create workers dynamically and then wait for them to complete? The number of workers to create is determined at runtime.
0
votes
0
answers
284
views
Identify the retry job in Sidekiq
When a job in Sidekiq fails, it goes into retry queue and it is retried for 25 times, as per https://github.com/mperham/sidekiq/wiki/Error-Handling#automatic-job-retry. So the question is, Is there ...
0
votes
1
answer
30
views
Deploy python worker to heroku without running immediatly
I have a simply python script that I deploy on Heroku as worker:
Procfile:
worker: python main.py
The script is scheduled to run every day at a specific time with the Heroku Scheduler. I don't want ...
0
votes
0
answers
103
views
Chrome extension Proxy SSL error: err_tunnel_connection_failed Workerman
I am trying to create my own proxy server and connect to it through the chrome extension.
My proxy server is implemented in PHP workerman.
<?php
$context = [
'ssl' => [
'local_cert' ...
1
vote
2
answers
54
views
Actively change language of a GUI in PyQt5
I'm working on multithread PyQt5 application.
Now I want to convert it to append multi language support, using two puss buttons, which might dynamically change bunch of labels (images and texts).
I ...
0
votes
0
answers
33
views
Sharing file handles across worker threads in node.js
In very simple term i have an application which appends to file post doing some compute, to speed up this i broke the operation in chuncks equal to worker threads available to me so that each can run ...
1
vote
1
answer
55
views
Worker vs Service android application. Running app for long time, never stops
Android : java class →
Worker vs Service ?
What is the difference between Worker and Service? Which is better to do something in background for a long time. Application never stops.
Dear friends.
...