254
questions
0
votes
0
answers
10
views
Torque/Moab standard outfile date issue
I am experiencing some potential issues with Torque/Moab. The scheduler outputs files with suspicious time stamps on them and does not output standard error files.
I have launched a script on May 27th ...
0
votes
0
answers
22
views
How to submit array of jobs using TORQUE/PBS but using predefined list of nodes or exclude some nodes?
I want to submit a job array to TORQUE, but I really want to run these jobs only on the specific nodes (I have a list of nodes to exclude from using). How to do this?
here is my initial sh script to ...
0
votes
0
answers
17
views
Opposite Leg Joint Rotation Using Unity Joint Simulation
I've created a simple leg joint structure in Unity, using a cube as the hip with free movement and rotation for self-balancing. Two rectangular prisms represent the right and left legs, and they are ...
0
votes
0
answers
115
views
Any way to use future.apply parallelization without PBS/TORQUE killing the job?
I frequently use the packages future.apply and future to parallelize tasks in R. This works perfectly well in my local machines. However, if I try to use them in a computer cluster, managed by PBS/...
0
votes
1
answer
93
views
how to add iiwa joint torque sensor in drake
I want to use iiwa's joint torque feedback data in my controller's input.
But I didn't find API to get joint torque data.
Which API should I use?
get_reaction_forces_output_port. or ...
1
vote
1
answer
2k
views
“unable to find the specified executable file” when trying to use mpirun on julia
I am trying to run my julia code on multiple nodes of a cluster, which uses Moab and Torque for the scheduler and resource manager.
In an interactive session where I requested 3 nodes, I load julia ...
0
votes
0
answers
568
views
OpenMPI does not recognize multiple nodes?
I am trying to run a Julia script in paralell on a cluster.
The cluster uses Moab and Torque for the scheduler and resource manager.
Since SSH seems to be restricted, I use MPI for multiprocessing.
I ...
0
votes
0
answers
135
views
Batch and Bash codes while submitting jobs
I was used to the following way of submitting my jobs that to be done in R in an sequential way in 'PBS/Torque'.
following is my R code named simsim.R
#########
set<-1
#########
# Read i
#########
#...
4
votes
1
answer
4k
views
What is the simplest queue job manager for linux?
Frequently, I and my team of 6 members submit tasks to a computer. We want that the computer loads the next job after the previous one is done. We all use the same user.
In another computer we used ...
1
vote
1
answer
214
views
How would you check if SLURM or MOAB/Torque is available on an environment?
The title kind of says it all. I'm looking for a command line test to check if either SLURM, or MOAB/Torque is available for submitting jobs too.
My thought is to check if the command qstat finishes ...
-2
votes
1
answer
263
views
How to build a circuit for torque control using a DC motor, current sensor and arduino uno
I have been tasked with designing a circuit that controls the output torque of a DC motor. The requirements are that the motor should operate at one of two torque values (inputted using a toggle ...
0
votes
0
answers
424
views
Run parallel job without hyperthreading Torque PBS script
Is it possible to disable Hyperthreading? Or a way via torque PBS script to use only physical cores available in the node.
My problem is when I run my MPI job with node=1:ppn=12 it runs with a good ...
2
votes
1
answer
282
views
Snakemake --use-conda with --cluster and NFS4 storage
I am using snakemake in cluster mode to submit a simple one rule workflow to the HPCC, which runs Torque with several compute nodes. The NFSv4 storage is mounted on /data. There is a link /PROJECT_DIR ...
0
votes
0
answers
246
views
Error while running R code after submitting a job
If I simply run the R code then it works. However, it does not work when I submit a job.
I am trying to run myRcode.R file by submitting a job. Following is the .sh file:
#!/bin/bash
#PBS -N ...
1
vote
0
answers
503
views
PBS jobs queue then immediately exit sometimes
I've been using a PBS managed computing cluster for a few years now at my school. A few months ago I ran into this problem and they were never able to figure it out. When I submit jobs, they queue and ...
0
votes
1
answer
228
views
Matplotlib not found when trying to run code in Linux cluster
I am running a Julia script while ssh'ed into a Linux cluster. The code loads matplotlib as the following:
import Distributed
using Distributed
@everywhere pushfirst!(Base.DEPOT_PATH,"/tmp/...
2
votes
0
answers
84
views
Issue importing PyPlot when submitting Julia file to cluster via Torque
I am running some Julia code on my school's cluster. The .bps file which calls test_julia.jl is given below:
1 #!/bin/tcsh
2
3 #PBS -l walltime=24:00:00
4 #PBS -l nodes=1:ppn=1
5 #PBS -N ...
1
vote
1
answer
241
views
Torque formula in Java?
I'm trying to calculate the torque in a java program but I having some problems on how to convert the formula to code
Here is the formula:
and here is my code:
torque = CYLINDER_LOAD_FACTOR * ( ( ...
3
votes
1
answer
375
views
Error running 01 46, response: ...UNABLETOCONNECT
Getting the data from OBD II simulator to android application via Bluetooth successfully.
Now I am trying get the data from ELM327 device to android application.
I have an ELM327 device connected to ...
0
votes
1
answer
182
views
Getting status of the nodes under Torque resource manager?
How can I get information about the status of the computational nodes on the torque-managed cluster (I am interested in the number of nodes that are allocated for jobs vs. idle ones)? Under SLURM I ...
0
votes
1
answer
427
views
Unable to run torque/pbs server on Ubuntu 16.04
I downloaded the torque repo with
git clone https://github.com/adaptivecomputing/torque/
In my dockerfile I install it with
FROM nistmni/minc-toolkit:1.9.16
COPY "torque" "/execute/torque"
...
2
votes
1
answer
2k
views
MPI_Comm_spawn fails with "All nodes which are allocated for this job are already filled"
I'm trying to use Torque's (5.1.1) qsub command to launch multiple OpenMPI
processes, one process per node, and having each process launch a single
process on its own local node using MPI_Comm_spawn(...
1
vote
1
answer
74
views
Creating a multi headnode hpc cluster
I have a HPC cluster where several webapps are installed in docker containers, the queue is managed using Torque. Every app submits job to the HPC cluster connecting to it through ssh and then running ...
1
vote
1
answer
34
views
Run torque job while editing the source file
I have a project using git as the source control tool, with a default branch named dev. And I can run that as a job on a torque server. My question is, while the job using the code from branch dev is ...
2
votes
1
answer
1k
views
How can I restart a failed PBS job in cluster (qsub)?
I'm running a PBS job (python) in the cluster using qsub command. I'm curious to know how can I restart the same job from the step where it failed?
Any type of help will be highly appreciated.
0
votes
1
answer
70
views
PBS torque: how to solve cores waste problem in parallel tasks that spend very different time from each other?
I'm running parallel MATLAB or python tasks in a cluster that is managed by PBS torque. The embarrassing situation now is that PBS think I'm using 56 cores but that's in the first and eventually I ...
8
votes
0
answers
2k
views
Torque cannot communicate with host
I have been attempting to setup the torque scheduler for a small cluster. I followed the steps to setup the scheduler from http://docs.adaptivecomputing.com/torque/archive/3-0-2/1....
0
votes
0
answers
146
views
PBS/Torque test script not running successfully
I am a newbie in the world of cluster management software. I installed PBS-Torque successfully but when i ran
qsub test.sh i get
18.localhost
I checked using qstat i found following status.
Job ...
1
vote
1
answer
431
views
Torque PBS - running several serial Python processes
I want to do some parallel computing for the first time and I don't know exactly where should I start from.
The problem is that I have a huge file list (around 7000 csv files) that I want to process ...
0
votes
1
answer
218
views
GNUPlot cannot be executed after mpirun command in PBS script
I have PBS command something like this
#PBS -N marcell_single_cell
#PBS -l nodes=1:ppn=1
#PBS -l walltime=20000:00:00
#PBS -e stderr.log
#PBS -o stdout.log
# Specific the shell types
#PBS -S /bin/...
2
votes
1
answer
989
views
Cannot build torque after moving to ubuntu 18.04
After installing ubuntu 18.04 I cannot build torque software. Ubuntu 16.04 posed no such error.
make[4]: Entering directory '/home/socrates/torque-6.1.2/src/lib/Libattr'
g++ -DHAVE_CONFIG_H -I. -I.....
2
votes
1
answer
3k
views
how to get status of finished or aborted jobs in qsub/torque
Using torque, if I run a job with qsub with particular arguments, the job finishes and three things happen. 1) I get a file.eXXXX file containing the stderr of the process 2) I get a file.oXXXX file ...
0
votes
1
answer
81
views
Torque job randomly dying
I am running a Python3 script in batches of roughly 27 all with different input. The results are then saved to the results/$sizex$size folder. The working directory also must change to that folder so ...
2
votes
1
answer
499
views
create environment module to work with opencv-python on hpc nodes
I have a task to train neural networks using tensorflow and opencv-python on HPC nodes via Torque.
I have made privatemodule with python virtualenv and installed tensorflow and opencv-python ...
0
votes
1
answer
147
views
Job crashes with OOM when I submit as a que (PBS/Torque) but not when I run simply run the command in terminal
Here's the job script I use,
#!/bin/bash
#PBS -q batch
#PBS -N simulation
#PBS -j n
#PBS -o /dev/null
#PBS -l nodes=1:ppn=1,pmem=3400mb
#PBS -l ncpus=1,mem=3400mb
cd ${PBS_O_WORKDIR} && \
....
1
vote
1
answer
643
views
PBS/Torque cannot finalize the result of computation
I have installed Torque on Ubuntu machine (it's the server and the only node). And it seems like jobs are working fine except for the finalization part.
When the job ends, I get something like
PBS ...
2
votes
1
answer
846
views
R package mlr exhausts memory with multicore
I am trying to run a reproducible example with the mlr R package in parallel, for which I have found the solution of using parallelStartMulticore (link). The project runs with packrat as well.
The ...
1
vote
1
answer
313
views
torque qsub making jobs dependent on other jobs
I'd like to start a bunch of jobs using qsub, and the final job should only run if all the others finished "without error". In my case "without error" means they exited with status=0. The man page ...
1
vote
0
answers
186
views
qsub slow on cluster with a single computer
Torque is installed in a single computer, which is used for both head node
and computation node. I didnt installed Maui for job schedule, but use the built-in function of torque.
I find qsub is slow ...
0
votes
1
answer
66
views
Submit to cluster queue from local computer
It is possible to submit to a cluster run using a Maui scheduler from a remote machine that's on the same network as the login/head node? The remote machine is on the same network and has the same ...
2
votes
1
answer
203
views
'sed' command does not work normally in PBS scripts
I use torque to submit the test script shown blow
#!/bin/bash
#PBS -N test
#PBS -l nodes=1:ppn=1
#PBS -q ser
#PBS -V
#PBS -S /bin/bash
sed 's/a//' <<< aaabbbaaa
sed 's/\(a\)//' <<< ...
1
vote
0
answers
1k
views
Why PBS_NODEFILE and PBS_JOBID are not set in torque
I want to submit a work to our school's cluster, but it seems that something went error with the environment variable. Here is a test PBS file
#PBS -N test
#PBS -l nodes=1:ppn=1
#PBS -q ser
#PBS -V
#...
0
votes
1
answer
443
views
All nodes down after Torque install
All nodes registering as down after new torque install. I'm not sure why
[root@rbx-1 6.0.1]# pbsnodes -a
rbx-1
state = down
power_state = Running
np = 1
ntype = cluster
...
0
votes
2
answers
249
views
qsub: is it possible to use both the "-k" and "-o" parameters?
Recently I had to move from a computing cluster with LSF (bsub) to one that uses Torque (qsub).
On the prevous cluster I was able to check my jobs on the fly with the bpeek command.
On the new ...
1
vote
1
answer
503
views
TORQUE jobs hang on Ubuntu 16.04
I have TORQUE installed on Ubuntu 16.04, and I am having trouble because my jobs hang. I have a test script test.pbs:
#PBS -N test
#PBS -l nodes=1:ppn=1
#PBS -l walltime=0:01:00
cd $PBS_O_WORKDIR
...
0
votes
1
answer
71
views
monitoring job titles on torque cluster using ksh
If I use qstat I can get the list of jobs currently running
host username othername NameTask_JOBXXXX_G1_namesubtask -- 1 1 -- 8783: Q 00:00
host username ...
1
vote
2
answers
3k
views
Why Torque qsub don't create output file?
I trying start task on cluster via Torque PBS with command
qsub -o a.txt a.sh
File a.sh contain single string:
hostname
After command qsub I make qstat command, that give next output:
Job ID ...
0
votes
1
answer
559
views
Running torque job in tensorflow conda environment
I have a cluster running with torque to distribute jobs. I want to run a job with tensorflow code and I am having problems with tensorflow not being recognized.
I installed tensorflow on my LDAP user ...
1
vote
1
answer
257
views
Tensorflow and running distributed training with torque
I have written a neural network in line with the tensorflow guide on distributed training: https://www.tensorflow.org/deploy/distributed
If the cluster I would like to run the training on uses torque ...
0
votes
0
answers
1k
views
No output files from Torque scheduler
I am somewhat of a clustering neophyte and recently installed torque and the maui scheduler on a Debian cluster. To test the setup, I ran a simple pbs script test_torque.sh (see the script below).
...