Questions tagged [singularity-container]
For questions about programmatic problems relating to the Singularity scientific computing container solution.
371
questions
0
votes
0
answers
22
views
How to copy files from host machine to Singularity container when the in-container directory does not exist
Environment:
Ubuntu 22.04 server LTS
Singularity 4.0.2
I'm trying to copy a file /home/host_user/.vnc/passwd from host machine to the Singularity container under directory/root/.vnc. The problem ...
0
votes
1
answer
22
views
Running a command within a launched shell within an apptainer instance
I'm working towards setting up a script for batch submission to an HPC system which uses software in an apptainer image. Here's what I have in mind:
apptainer run container.sif runjob.sh
runjob.sh
---...
0
votes
1
answer
46
views
How to start a conda/mamba environment in a container during execution
I would like to do exec on my container and execute my command:
apptainer exec myContainer.sif myCommand
(or singularity)
but myCommand is within a conda/mamba environment, so I am doing:
apptainer ...
0
votes
0
answers
17
views
Singularity Container: I cannot make writable persistent from singularity sandbox to host
I do the following
I build a sandbox
singularity build --sandbox project/ project.recipe
I access the sandbox to modify stuff
singularity shell -B /path/to/host:/path/in/sandbox --writable project
...
0
votes
0
answers
55
views
FATAL: While performing build: conveyor failed to get: while converting reference: pinging container registry registry-1.docker.io:
I install apptainer by following the instructions from https://github.com/apptainer/apptainer/issues/url. After fresh installation "apptainer build" command gives error while building from ....
0
votes
0
answers
26
views
Running a command inside a singularity container
This is probably very easy, but I am very new to singularity containers, any help appreciated. I have the following definition file:
Bootstrap: docker
From: ubuntu:20.04
%post
apt-get -y update
...
0
votes
0
answers
16
views
pkg_resources.DistributionNotFound: The 'fairseq' distribution was not found
I'm trying to reproduce the work of a paper that uses fairseq code in a Singularity container. In the Singularity recipe I install fairseq code with pip install --editable . and it appears to work ...
0
votes
1
answer
17
views
Apptainer build gets stuck at "Geographic area" selection
I tried to build an apptainer image from the following definition file:
Bootstrap: docker
From: pytorch/pytorch:2.0.1-cuda11.7-cudnn8-devel
%files
./requirements.txt /src/requirements.txt
%post
...
0
votes
0
answers
36
views
Different behavior for pipenv (not) using pyenv when using gitlab-runner with singularity
Background
Trying to find an easy, automated way to mirror local python apps from different environments (with different dependencies) into running containers, I use a bunch of different tools:
Local ...
0
votes
1
answer
30
views
How to set a shell variable in a Singularity definition file so that it is seen by several sections
I need to set a version string for an app that I am packaging in a Singularity container. This version string is used in several places in the definition file (*.def).
I know that I can set a shell ...
0
votes
1
answer
46
views
Singularity could not open image
I ran my workflow with nextflow using singularity, for my first process there are no problems, but the second one gives me this error:
could not open image /staphb/samtools:1.15.img: failed to ...
0
votes
1
answer
27
views
Trying to run a R script within a container
I am trying to run a tool called LINDA with singularity. I am struggling to understand how I can run a R script within the container. So far I am running the command below with slurm but it says there ...
0
votes
0
answers
60
views
Docker container works well, but Singularity sif creates permission error
I created a Docker image that works as expected. I've provided the dockerfile and entrypoint file here on the off chance it's helpful.
I can run through prokaregia.sh, the script the environment was ...
1
vote
0
answers
60
views
Warning given when running a model: boundary (singular) fit: see help('isSingular')
I am doing following simulation study to observe model performance of sample pooled data from superpopulation data
a<-0
beta<-0.5
n<-10^6
probx<-0.5
gamma<-c(rep(x = 0.1,n/5), rep(x = ...
0
votes
1
answer
91
views
Why singularity containers behave differently on login vs computing nodes on slurm HPC
Why I am able to run an R script in a singularity container manually without problems, but as an array job on slurm HPC it fails on various levels. This is in contradiction with the assumption that ...
0
votes
0
answers
22
views
How to modify temporary files when running apptainer interactivelly
When running my container with docker I need to modify one file
sed -i "242s/.decode('utf-8')//" /usr/local/lib/python3.6/site-packages/keras/models.py
When running the .sif file I have ...
0
votes
0
answers
102
views
How to run a python script stored in singularity container?
I'm currently engaged in a project that involves deploying the application within a Singularity container environment. The application is coded in python. I have setup a singularity container sandbox ...
0
votes
1
answer
26
views
MPI ring_c not working on Singularity Container
I installed openmpi 4.1.2 and mpich 4.1.2 on a Ubuntu Bionic Singularity container.
They install fine, and I compile the ring_c from the test scripts and at first glance things work.
I tested that I ...
0
votes
1
answer
48
views
How to hide warning when working with apptainer
This is the code:
## The tools are images generated and excuted by apptainer
export python="apptainer run /mainfs/wrgl/broadinstitute_warp_development/warp/images/datascience-notebook_latest.sif&...
0
votes
0
answers
11
views
As an administrator, configure Singularity to redirect paths to local repositories
I'm new to Singularity and especially to it as an administrator. I have local servers or cached files for various packages like apt or python pip. Is there a way to ensure that Singularity ...
0
votes
0
answers
35
views
How to create a virtual environment with singularity containers (influxdb, ganglia, prometheus) for generating (ML) train data
I am creating a virtual environment initially using docker containers locally on my Ubuntu machine. Eventually, I will take it to the HPC environment and run it there in much larger scales. The ...
0
votes
0
answers
59
views
JupyterLab not identifying hostname when launched
I'm trying to use a Singularity image to run a JupyterLab instance, but once the instance is started I'm unable to access it remotely because JupyterLab seems to fail to capture the name of the node ...
1
vote
0
answers
101
views
Issue with RStudio Server in Singularity Container: User Privilege and UID Switching
Description:
I have been successfully converting a Docker container to a Singularity container using the steps provided on https://rocker-project.org/use/singularity.html.
singularity pull docker://...
0
votes
0
answers
59
views
Apptainer pull failed to get checksum
I have access to two systems and want to run the same container on both (as far as possible). The problem is that one only supports charliecloud, the other apptainer.
I found out the best way would be ...
0
votes
0
answers
35
views
singularity container using package from outside of container
I created a singularity container with conda just to install the packages faster. However, I noticed that when I use the container if there is already a package installed in my system that is the same ...
0
votes
0
answers
58
views
PATH from docker env overwritten by Singularity when called by Snakemake
I am trying to use containers to run Snakemake pipelines, but the PATH variable keeps getting overwritten when Snakemake converts docker containers to singularity. Here is my dockerfile.
# Dockerfile
...
1
vote
1
answer
88
views
How can I point Nextflow to the correct singularity binary?
I have a Nextflow workflow which I run from a conda environment (which also has singularity installed):
name: nextflow
channels:
- conda-forge
- bioconda
- defaults
dependencies:
- nextflow
-...
2
votes
0
answers
169
views
Cannot bind a directory using --singularity-args '-B' in snakemake
I have troubles running snakemake in a singularity container.
My raw data resides outside the working directory, and I am not able to access the raw data from inside the container.
Path to the raw ...
0
votes
0
answers
39
views
Can't pack singularity sanbox into sif container
I'm using singularity to build a container containing a conda environment (QIIME). I have already set the conda environment inside the singularity sandbox. And I want to build an auto-active conda ...
1
vote
1
answer
139
views
Can't excute command in Singularity image with Nextflow
I'm trying to do a simple process, create the a.txt file in $projectDir/Result directory with a singularity container.
My working dir:
touch.nf
nextflow.config
a.txt (I want to create)
This is my ...
0
votes
2
answers
154
views
How do I run many Singularity/Apptainer containers from one Python script, using multiple CPUs and nodes?
Problem statement
I have a Python program that needs to launch a number of Singularity containers in parallel.
Is it possible to do this, exploiting all of the available hardware, using only built-in ...
0
votes
0
answers
31
views
A docker container produce errors with Apptainer unless in writable sandbox mode
A (confidential) docker container fails on tests when run by Apptainer unless it is in the writable sandbox mode.
I tried ls \ -tral I see only /etc, /tmp, mounted and special folders like /....
0
votes
0
answers
98
views
JupyterHub config and access through Bright CM
In our university, we're working on a cluster where potentially 70-80 users might need to use Jupyter Notebook simultaneously. We are currently utilizing Bright Cluster Manager (BCM) and not OOD.
We'...
0
votes
0
answers
33
views
singularity pulls but does not search lolcow?
singularity search lolcow gives me: FATAL: Couldn't search library: request did not succeed: http status code: 504
However singularity run library://lolcow works and singularity search tensorflow ...
0
votes
0
answers
59
views
How to add libraries with pip and conda to a Singularity container
I'm working in a computational HPC node and I'm provided with a singularity container. I don't have write permissions to the image. I would like to execute this container, pip install some libraries ...
0
votes
1
answer
127
views
Singularity and numba/numpy: RuntimeError: Attempted to compile AOT function without the compiler used by `numpy.distutils` present
My software is written in Python and uses numba and numpy. I distribute it using Docker.
Here is the Dockerfile.
One of my users (see GitHub issue) wants to run the software on a HPC where Singularity ...
0
votes
0
answers
22
views
How can the current directory be shown in a singularity container on the terminal?
I'm a new Singularity user. When I run the command singularity shell my_con.sif. The terminal only shows:
Singularity>
For convenience, is there any way to show the current path on the terminal? ...
0
votes
0
answers
125
views
Apptainer installation with use Windows Subsystem for Linux (WSL)
I am extremely happy user of Windows OS 11 who needs to use Apptainer in my developer work. I am considering two options of apptainer installation/use in Windows:
using Git/VirtualBox/Vagrant/Vagrant ...
0
votes
0
answers
26
views
My stable-baselines3 script is interrupted in singularity images and no logs
I try to train a custom environment by stable-baselines3 inside a singularity images.But it is always interrupted by SIGTEM.Here are the informations:
Loguru caught a signal: SIGTERM
Loguru caught a ...
3
votes
2
answers
259
views
Python script file missing in Singularity image
In AWS, created a docker image with a python script to print a string(basicprint.py)
docker file:
FROM python
COPY ./basicprint.py ./
CMD ["python", "basicprint.py"]
It works ...
1
vote
1
answer
405
views
Pulling from GitLab with singularity
I'm trying singularity for the first time and having some issues.
I have an image in my container registry for which I have a personal access token in the repo.
I wish to pull this with singularity, ...
0
votes
0
answers
160
views
Unable to use Nvidia OpenCL in Singularity containers
I'm struggling a lot with making OpenCL GPU acceleration available within a Singularity container. Executed directly on the host itself (without Singularity in between), I get the GPU application, a ...
0
votes
0
answers
54
views
Container for RStudio (not server)
I am trying to setup a container for RStudio (not the server!). On our university system (a modified Debian 11), I could not install Rstudio. Therefore, I tried putting together a Singularity recipe. ...
0
votes
0
answers
20
views
OpenFOAM user compilations
This is my first question in Stack overflow. I am studying master mechanical engineering.
I have started Project Work. I have never worked with C++ or OpenFoam before, sothat i am a little bit lost ...
1
vote
1
answer
60
views
quotes and spaces in singularity container
I am trying to send an argument from a terminal into a singularity container. It am trying to run an AFNI container (19.3.18) https://afni.nimh.nih.gov/pub/dist/doc/htmldoc/background_install/...
0
votes
1
answer
303
views
Singularity: Python package not available even though it is in docker
I built myself a docker image from this docker file:
FROM ubuntu:22.04
RUN apt-get update
RUN apt-get upgrade -y
# Install python:
RUN apt-get install software-properties-common -y
RUN add-apt-...
0
votes
0
answers
490
views
Error from Singularity building a docker image . Process gets killed
The process gets killed every time I run a singularity build for an 8GB docker image in a HPC
Initially I would run
salloc --time=1:0:0 --ntasks=4 --gres=gpu:2 --account=<xx> --nodes=2 --ntasks-...
0
votes
0
answers
61
views
Two different ssh config options to connect to the same remote host
I am trying to get a somewhat convoluted SSH setup working. There is a remote HPC cluster that spins up compute nodes that one can access through SSH. There are hundreds of nodes with names like ...
0
votes
0
answers
92
views
stdout stderr not captured from binary executed in singularity container
I have a complex HPC (openpbs 20.0.1, Ubuntu 18.04) workflow using a python subprocess to execute qsub which ultimately launches a singularity (3.9.9) container with the exec command to execute a ...
0
votes
0
answers
21
views
How can I write the file paths so that a script that exists outside of a singularity image can call scripts within that image?
Question
I'm new to working with containers, but the HPC I'm using requires that most things be run via containers (fair enough) so I'm trying to run my code appropriately. Because editing files in ...