Questions tagged [singularity-container]
For questions relating to the Singularity scientific computing container solution.
284
questions
0
votes
0
answers
10
views
Containerizing vim with plugins
I am trying to containerize vim along with the plugins. I am using singularity containers. The most important plugin is youcompleteme. My approach to containerizing the plugins is to install vim and ...
0
votes
1
answer
11
views
Singularity arguments conflict with my bioinformatics tool arguments
To make my tool more portable, and because I have to use it on a cluster, I have to put my bioinformatics tool at disposal for docker. Tool is located here. The docker hub is 007ptar007/metadbgwas, if ...
0
votes
1
answer
15
views
What is the right way to increase the hard and soft ulimits for a singularity-container image?
The task I want to complete: I need to run a python package inside of a singularity-container that is asking to open at least some 9704 files. This is the first I have heard of it and searching around ...
0
votes
1
answer
17
views
Run script before getting prompt in singularity shell
I have built a Docker container with a Docker file that ends with WORKDIR /where/I/will/work and when I spin up the container, I can get to work. Unfortunately, my remote system won't allow Docker ...
0
votes
1
answer
22
views
Which tmpsf partition is used in singularity and how can I increase it
I'm wondering how can I increase tmpfs size in singularity sif image and how it relates to tmpfs on host system. According to a post by Pawsey Centre:
Singularity has a flag for rendering containers ...
0
votes
1
answer
29
views
Building a singularity container for the text-package in R does not find python libraries
I want to build a singularity container for the text-package in R (which is using reticulate to access python). The singularity container builds, and the text-package is installed, and can run ...
0
votes
0
answers
28
views
Singularity: Fatal authentication error when pulling public image
I am new to Singularity and trying to get my first definition file to work. However, I am getting a fatal authentication error when trying to build the definition file, even though I am pulling a ...
1
vote
1
answer
49
views
What is the proper way to use Slurm to run a Python file that calls a bunch of terminal commands on a HPC?
The HPC I am using requires me to run programs on the compute using Slurm. Currently I am locally running a Python script on my laptop that calls a bunch of bash commands in a loop. As an example, the ...
0
votes
0
answers
43
views
Singularity ImportError: cannot import name 'SemLock' from '_multiprocessing'
I need a singularity image with PyTorch Geometric package to train a deep learning model in a slurm cluster.
I've built the singularity container with the definition file provided in the ...
0
votes
1
answer
54
views
Error "no free space in /var/cache/apt/archives" in singularity container, but disk not full
I'm trying to reproduce results of an older research paper and need tp run a singularity container with nvidia CUDA 9.0 and torch 1.2.0.
Locally I have Ubuntu 20.04 as VM where I run singularity build....
2
votes
2
answers
178
views
Error pulling docker image with singularity from gitlab container registry
I am trying to pull a docker image from my Gitlab container registry using singularity pull (as I want to use it singularity), but I get an error from singularity telling me that one file is not a tar ...
0
votes
2
answers
58
views
How to verify if in Singularity|Apptainer container?
According to the shell doc:
The change in prompt indicates that you have entered the container (though you should not rely on that to determine whether you are in container or not).
So other than ...
0
votes
1
answer
44
views
Errors Installing singularity inside dockerfile
I am trying to run a nextflow pipeline which uses an older version of nextflow (21.04.3) and java version 8. Since I have to use this pipeline on a remote server, therefore I can only use singularity.
...
0
votes
1
answer
61
views
singularity container uses host libraries upon rendering .Rmd file
I have build a singularity container based on r-base image and installing custom libraries like Seurat. Now I am trying to run my .Rmd script as follows:
singularity exec container.sif $(Rscript -e &...
-1
votes
1
answer
102
views
Failed to create user namespace
I installed singularity and nextflow in a docker image, I wanted to launch the singularity pcm image, with this command :
nextflow pcm.nf --allow-setuid --in example/example_proteome.faa --out result -...
0
votes
2
answers
55
views
Singularity container -B not found
I changed the I am running the following code:
#!/bin/sh
#
#SBATCH --job-name psy-bkeeser_fmriprep
#SBATCH --nodes=1
#SBATCH --ntasks=1
#SBATCH --cpus-per-task=16
#SBATCH --mem=32GB
#SBATCH --output /...
0
votes
0
answers
45
views
Singularity container on SLURM: passing best options to `sbatch`?
Running singularity containers on an HPC with SLURM on it, I am not sure whether I understand the best options to pass on to sbatch. Every one of the jobs look like this:
singularity run my_image.sif ...
0
votes
0
answers
44
views
Singularity connection differences between 'instance start' and 'run' with custom network portmap and ssl self-signed certificate
I have built a singularity container from the docker hub registry like so:
sudo singularity build \
postgres12.sif \
docker://postgres:12
And can successfully run the container like:
sudo ...
0
votes
0
answers
27
views
singularity relocation error when sourcing file in environment section
I'm trying to create a Singularity image for some application software that normally builds into a single directory. To use after building, you source a setup file "env.sh" that sets a bunch ...
0
votes
0
answers
36
views
Anyone know what's causing this linux error?
I'm trying to run deepvariant via their singularity container on the HPC, however I get this error, and I can't figure it out!
Code:
#!/bin/bash --login
#SBATCH -J AmyHouseman_deepvariant
#SBATCH -o %...
1
vote
0
answers
73
views
Can I install cuda libraries without having a GPU while building a container? [closed]
I am creating a singularity container on a server that doesn't have GPUs. I want to use this container on another server which has GPUs, so I am installing cuda development libraries for the container....
0
votes
1
answer
21
views
best way to mimic docker's layer caching of a common base image with singularity?
I'm new to containerization, so apologies if I misuse some terminology.
I am providing data analysis software for a scientific collaboration with a rapid release cycle, meant to run on HPC clusters. ...
1
vote
1
answer
72
views
Singularity container with stringr fails only locally with 'libicui18n.so.66: cannot open shared object file: No such file or directory'
I enjoy using the Singularity container software, as well as the R package 'stringr' to work with strings.
What I fail to understand is why a Singularity container fails locally (i.e. on my Ubuntu 20....
0
votes
1
answer
33
views
Singularity access files on host on %post
I am using singularity to create a python environment with Conda and need to access an .yml file in the def script. How can you access them ?
0
votes
1
answer
39
views
Singularity image
I wrote the following definition file:
Bootstrap: library
From: ubuntu:18.04
%post
apt-get update
apt-get install -y r-base r-base-dev libpng-dev libtiff-dev libjpeg-dev
R --slave -e 'install....
0
votes
0
answers
65
views
How can I edit a file when using a docker image using singularity?
I am trying to use a docker image available at docker://tscholak/text-to-sql-eval:e37020b6eee18bff865d9d2ba852bd636f3ed777 and I have cloned the github repo from https://github.com/ElementAI/picard
...
1
vote
1
answer
54
views
Why can't I pull the latest fmriprep singularity version?
I tried to pull the latest version of the Singularity image for fmriprep into an HPC, which to my understanding is 21.0.1.
I did it using the following bash script:
module load singularity
singularity ...
1
vote
0
answers
120
views
Correct gpg keys for ubuntu singularity container build
I have a def file which I'm attempting to use to build a singularity container on a host ubuntu 21.10 system. The lines I'm having trouble with are these
gpg --keyserver hkp://keyserver.ubuntu.com:80 ...
0
votes
3
answers
98
views
Copying files in to pre-built singularity containers
I have a pre-built singularity container. I would like to copy some files from the host in to the container.
Will I be able to edit the bootstrap file after the container has been built?
Or is there a ...
2
votes
0
answers
85
views
Using the R package reticulate within a Singularity container
reticulate is an R package to call Python code from R, that I find easy to use on my local computer and I sometimes get working within a Singularity container.
In this question I will post a simple ...
1
vote
1
answer
91
views
error when pulling a docker container using singularity in nextflow
I am making a very short workflow in which I use a tool for my analysis called salmon.
In the hpc that I am working in, I cannot install this tool so I decided to pull the container from biocontainers....
1
vote
0
answers
242
views
bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8) in singularity container
Problem
I've had different .sif-files with various versions of ROS (ROS:kinetic and ROS:melodic is the ones I've used most). It worked flawlessly, until it suddenly started giving me this warning:
$ ...
0
votes
1
answer
192
views
Singularity v3.9.4 Installation - mconfig not inside a git repository and no VERSION file found
I'm trying to install Singularity after installing Go. I've confirmed that Go has been installed successfully:
$ go version
go version go1.17.6 linux/amd64
After that, I run the following commands:
$ ...
0
votes
0
answers
35
views
Create container from a GitHub Actions .yaml file?
Whenever triggered, GitHub Actions uses the .yaml scripts in .github/workflows to build a temporary and fresh environment, from where the script is run.
This process is very similar to a Docker or ...
0
votes
1
answer
97
views
Singularity mongodb container in background mode
I am trying to run a Singularity container for MongoDB on a remote server in background mode.
The recipe file that I used to build the mongo.sif is:
Bootstrap: docker
From: mongo:4.4.11
%startscript
...
0
votes
0
answers
118
views
How to start pre-installed mysql server within a singularity container
I have a docker container image, where mysql server is installed and pre-loaded with all database tables needed by an application. The data folder for mysql is /home/meta_test/mysql and it is set to ...
0
votes
0
answers
132
views
Adding pip package to an existing singularity image with sandbox
I'm currently using a singularity image that i received from my colleague and I need to use a pip package that is not installed there. As far as I understand, I could easily add the required package ...
0
votes
2
answers
60
views
Unable to write to mongo instance running as a Singularity Container
I have been following the repo: https://github.com/singularityhub/mongo for building mongo container using Singularity.
By following all the steps mentioned in the repo:
git clone https://www.github....
0
votes
0
answers
37
views
singularity using wrong python version: urllib2.URLError: <urlopen error [Errno 1]
I had the following error while trying singularity. I am working in python3 but it called python2.6. Is there a way to change this?
singularity pull shub://chrarnold/Singularity_images:difftf_conda
...
0
votes
0
answers
37
views
sbatch: How can I see I'm getting the amount of memory I requested
I'm running SLURM with the following script"
#!/bin/bash
LAB_PATH="/sci/labs/shahar.arzy/uri.elias"
ASSUTA_DIR=$LAB_PATH"/Projects_Data/Assuta"
FS_LICENSE=$LAB_PATH"/...
0
votes
1
answer
26
views
How to execute a command inside a singularity container that do not interact/sources options from the host OS?
I have a binary installed on a Docker container that I have been trying to run via Singularity:
singularity run docker://repo/container_image ./repository/bin --flag
The problem is that with such ...
0
votes
1
answer
97
views
Substitute for docker-compose using singularity linux
Thanks for viewing my question!
Problem:
I'm fairly new to docker and linux. I am wanting to run a docker image in my linux dist (CentOS version 7), where I don't have the ability to change the root. ...
0
votes
1
answer
106
views
Unable to login to private Docker registry using Singularity on cluster
I've been trying to login to the private Docker registry of the GitLab instance of my university. Since Docker is not installed on the cluster I'm working on I'm using Singularity.
When trying to ...
0
votes
0
answers
91
views
How to use more memory to run a PostgreSQL server in a Singularity Container on an HPC cluster
I am running PostgreSQL 13.4 on Singularity 3.6.4 on a well resources HPC cluster as a data warehouse for 1.5 TB of data utilized by me team for research projects. The HPC cluster utilizes LSF for job ...
0
votes
0
answers
57
views
Singularity recipe for mongo-cxx driver
I want to set up a singularity container that has gcc, mongoDB, and mongo-cxx (with bson-cxx). My local computer has these installed, which is where I'm currently running my C++ project, but I now ...
1
vote
1
answer
313
views
Is there a way to track singularity containers like "docker ps" without starting as singularity instance?
Is there a way to track running singularity container like "docker ps" ? or singularity logs any start/stop info in somewhere.
I have tried the "singularity instance list" command ...
0
votes
0
answers
36
views
Script fails in container but singularity returns 0 (no error)
I am running a script inside of a singularity container and then checking the error code like this
singularity exec container.sif ./script.sh
echo $?
I can see from the standard output that script.sh ...
0
votes
0
answers
111
views
Singularity container not binding correctly on WSL2
So a little bit of background. I am currently studying at University and we have to set up the xv6 OS on a Singularity container (the image and the source for xv6 were provided for us by the teacher). ...
0
votes
0
answers
151
views
Singularity .sif image from sandbox
After building a sandbox with ubuntu and conda from a definition file, I created a singularity image with sudo singularity build my_image.sif image/.
Later, if I try to shell inside the image with the ...
0
votes
0
answers
27
views
Directory is lost after I bound it to a Singularity container. Why?
My aim was to create a container. I first built the sandbox directory. Then I shelled into it in writable mode and binding home and a specific directory that I needed. I installed some packages, I ...