384
questions
0
votes
0
answers
8
views
Build a Singularity container until writing to SIF?
When creating a Singularity Image File (.sif) from a Singularity script, the sif can get too big for services such as GitHub Actions, which causes a Continuous integration script to break.
However, ...
0
votes
0
answers
24
views
Defining Bind Paths and Mounts in Def Files
I am using Apptainer to containerize a JupyterLab server.
I want my container to bind to the home directory and a few other settings-related directories.
I picked up this project from a coworker, and ...
0
votes
1
answer
30
views
Starting Nextflow in a singularity container and use it to run another singularity container
I want to use nextflow in a singularity container that will further run my nextflow pipelines packed in a singularity. This will help us bypass installation of nextflow in all our test servers. I am ...
0
votes
1
answer
18
views
Is there a way to run snakemake within a singularity container with computing cluster submission for individual rules?
Is there a way to get the rules submitted to the cluster to inherit the parent command singularity container?
I'm running the base snakemake within a container for portability with most rules using ...
0
votes
0
answers
15
views
CmdStan and OpenCL - Exception: compile_kernel: calculate : Unknown error -11
I'm trying to run some models on HPC GPUs using CmdStan and OpenCL. I'm using this Docker image to get everything available just right.
Just to keep things simple, I'm using the same stan model from ...
0
votes
1
answer
51
views
singularity failing due to error squashfs filesystem seems not enabled
Singularity version 4.1.4-1 and squashfs-tools version 4.3 are installed on RHEL 7.9 (Maipo).
Running a container fails with the following message:
(base) -bash-4.2$ singularity --verbose shell ...
1
vote
1
answer
35
views
Singularity/Nexflow script won't load Tensorflow from .sif on cluster
I'm trying to run a singularity/nextflow script on an HPC. This script utilizes tensorflow, which is specified in the docker image I used to pull the initial .sif file from lpryszcz/deeplexicon:latest....
0
votes
0
answers
20
views
How to run brew during an apptainer build given brew cannot run as root?
I am trying to build the following apptainer. The last part of the script compiles the octopus variant caller.
Bootstrap: docker
From: ubuntu:latest
%environment
DEBIAN_FRONTEND=noninteractive
...
0
votes
0
answers
54
views
Singularity container with OpenMPI and InfiniBand (UCX)
I'm working as an intern currently, and I was asked to build a Singularity container for OpenMPI to make distributed programming possible on multiple machines of our HPC cluster using containers.
...
0
votes
0
answers
15
views
Multiple conda environments in a single singularity container
The title is pretty much the question.
Is it possible to generate multiple conda/mamba environments in a single container using the recipe.
I've been trying using the code below but when I build the ...
0
votes
0
answers
24
views
Sticky bit on /tmp in container causing MPI code to hang
First of all, great job on singularity. It has been very useful so far. I have a rather detailed question concerning a problem we encountered recently with a project using a CentOS 7 container, MPI 1....
0
votes
0
answers
144
views
Installing Singularity Error: make: *** .builddir: No such file or directory. Stop
I've been unsuccessfully attempting to install Singularity for a while now. I've updated to Noble, and tried to follow the instructions given on the Singularity CE Guide to install the latest version ...
0
votes
1
answer
118
views
Singularity build crashes because of pip memory usage
I am currently trying to build quite a simple .sif image from a .def file with singularity 4.1.3.
The problem is that whatever settings I try to use for pip install, I always fail the build due to:
...
0
votes
0
answers
44
views
Could not find any NVIDIA binaries on this host!, when i try to run docker image on server using singularity
I am trying to run a docker image on slurm server, I pulled this software's image from docker to my local machine then, copied to server.
When I run it on the server using
singularity run aoflagg.sif
...
0
votes
0
answers
82
views
Trying to build a Singularity .sif file from a .def file referencing a local docker image - not working
I am trying to build a Singularity .sif file from a .def file referencing a local docker image. This is not working at all.
The error is:
FATAL: While performing build: conveyor failed to get: ...
2
votes
1
answer
1k
views
How to correctly activate micromamba environment inside Apptainer container automatically?
I am trying to build a micromamba based container, that automatically activates the correct environment to run an application (here jupyter-lab).
Apptainer.def
Bootstrap: docker
From: mambaorg/...
0
votes
0
answers
60
views
Singularity showed cleanup error and says some directories do not exist
I tried to submit a job via PBS queue system, here is my script:
#!/bin/bash
#PBS -N cp2k
#PBS -S /bin/bash
#PBS -j oe
#PBS -q noor2
#PBS -m e
#PBS -l walltime=1:00:00,nodes=1:ppn=64
export ...
0
votes
1
answer
140
views
How to Run Commands in a Singularity from Shell Script
I wish to run a Python script in a singularity container.
In particular, I have attempted writing the following in the shell script
singularity shell <name.sif>
python3 <python-script.py>
...
0
votes
0
answers
69
views
Spack Error: Additional properties are not allowed
I am trying to build lbann in a container. The lbann package is installed within the container using spack in such a way that it makes use of the openmpi package built from source within the container....
0
votes
1
answer
46
views
Issue with Singularity Command Recognition for Fastq.gz Files
I am developing a shotgun metagenomics pipeline using Snakemake and Singularity, but I'm facing difficulties when trying to execute the Singularity command within Snakemake to analyze fastq.gz files. ...
0
votes
1
answer
56
views
The /etc directory appears empty when I try to access files using R
I have a bash script where I use singularity exec to run a program from inside the container. I want to call this script in R using the system() function. Everything works fine until Singularity needs ...
0
votes
0
answers
38
views
Call singularity exec from a shell script in R
I have a bash script where I use singularity exec to run a program from inside the container. I want to call this script in R using the system() function. Everything works fine until it reaches the ...
0
votes
0
answers
40
views
IPC Server handler / File does not exist, running hadoop in singularity container
I don't have any experience with hadoop and am running into issues while attempting to run a singularity container that uses it - it seems like it's not really getting started and i'm trying to figure ...
1
vote
1
answer
39
views
--no-home Singularity flag doesn't work on Docker container in a cluster node
When I use a Docker container on a HPC cluster's login machine using Singularity, it works as expected and I can access the container's /home:
singularity exec docker://quay.io/comparative-genomics-...
0
votes
0
answers
28
views
How to run piped command with Python subprocess without deadlocking?
I have a python script that runs
for cmd in chr_commands:
info("Run: "+cmd)
subprocess.run(cmd)
Where each cmd is equivalent to
samtools view -F 0x0004 input.bam chr3:0-500000 2>&...
1
vote
0
answers
334
views
conveyor failed while building an apptainer image from defintion file
I am trying to run inference results from https://github.com/mlcommons/inference_results_v3.1/blob/main/closed/Intel/code/gptj-99/pytorch-cpu/docker/Dockerfile_int4 which uses docker however instead ...
1
vote
2
answers
106
views
Bind and run a Python module with singularity from a remote directory
I need to run a personnal Python module from a singularity container.
I usually run it with the following command :
singularity run ./Image/myimage.sif -m mymodule.start
However it's only work if I ...
0
votes
0
answers
29
views
Python package location docker on singularity
I have a docker container and which runs a python script using packages installed from a requirements.txt file. When I run this using docker, the packages are installed correctly and are located ...
0
votes
0
answers
50
views
Use --contain and --bind in singularity run command
I was experiencing a bunch of trouble with python packages for a Docker container running on singularity. I managed to solve the issue by adding the --contain flag to the singularity run command. But ...
1
vote
1
answer
463
views
Encountered Errors in Storing Images using Singularity in Cluster
I am trying to get myself familiar with operations related to our cluster, so I tried using singularity there. I am having issues with pulling a specific docker image into singularity in the cluster. ...
0
votes
1
answer
512
views
singularity exec is not recognizing executables in container $PATH (converted micromamba docker image to singularity image)
There is a similar post but this post is regarding building a singularity container: Singularity containers: adding custom packages to $PATH and pass it to singularity exec
I have converted a Docker ...
-1
votes
1
answer
97
views
singularity build cannot install build-essentials
I am trying to build a singularity container (recipe file at the end of this post) and it is not able to install build-essentials. Execution fails with:
E: Unable to locate package build-essentials
...
1
vote
0
answers
73
views
I cannot execute a program in a container when working with Apptainer becaouse the path is not found
I have pulled a Docker container to create the .sif file
apptainer pull docker://mblanche/ngmerge:latest
there is no documentation so I have explored the sif file to know where is the tool I want to ...
1
vote
0
answers
96
views
Running c++ on cluster with slurm and sif container
I'm attempting to execute a C++ code on a cluster that utilizes Slurm. Since the server did not have g++ installed, I created a Singularity container (SIF) to facilitate the execution. However, I've ...
1
vote
1
answer
81
views
Intermediate build checkpoints for singularity containers?
I have to build a container with singularity/apptainer. However, I'm in the process of writting the definition file, which needs some iteration and building the image is pretty long;
I'm pretty new to ...
0
votes
0
answers
343
views
Singularity container cannot find files after being created from a Docker image
I am creating a Singularity container from a Docker image. However, the Singularity container gives me errors that weren't present while I used Docker.
This is how I create my Docker image -
FROM ...
0
votes
0
answers
88
views
Failed to install SingularityCE in WSL - failed to verify certificate
I want to install Singularity on my WSL, I followed the instructions in INSTALL.md, I tried with different version however the outcome still the same. I have installed the dependencies and Go ...
0
votes
1
answer
67
views
loop through list element one at the time
Hi there I've been experimenting with a job array using Singularity, the problem is that singularity takes in input only global/environment variables within the container — to the best of my knowledge ...
0
votes
1
answer
103
views
Toil-cwl-runner not using default-container option with singularity option
Issue
We are attempting to run toil-cwl-runner with a default singularity image. We got this to work as we intended with cwltool, but toil-cwl-runner seems like it is ignoring the default image to use....
0
votes
0
answers
1k
views
How to activate conda and a specific conda env for each shell and subshell in a singularity container
I have been trying this for a few days and no success. I am building a Singularity container (version 4.0.2-jammy), and I want to use conda within it. I am able to install conda, create the ...
0
votes
1
answer
399
views
Running a command within a launched shell within an apptainer instance
I'm working towards setting up a script for batch submission to an HPC system which uses software in an apptainer image. Here's what I have in mind:
apptainer run container.sif runjob.sh
runjob.sh
---...
1
vote
1
answer
943
views
How to start a conda/mamba environment in a container during execution
I would like to do exec on my container and execute my command:
apptainer exec myContainer.sif myCommand
(or singularity)
but myCommand is within a conda/mamba environment, so I am doing:
apptainer ...
0
votes
0
answers
95
views
Singularity Container: I cannot make writable persistent from singularity sandbox to host
I do the following
I build a sandbox
singularity build --sandbox project/ project.recipe
I access the sandbox to modify stuff
singularity shell -B /path/to/host:/path/in/sandbox --writable project
...
1
vote
0
answers
425
views
FATAL: While performing build: conveyor failed to get: while converting reference: pinging container registry registry-1.docker.io:
I install apptainer by following the instructions from https://github.com/apptainer/apptainer/issues/url. After fresh installation "apptainer build" command gives error while building from ....
0
votes
0
answers
163
views
Running a command inside a singularity container
This is probably very easy, but I am very new to singularity containers, any help appreciated. I have the following definition file:
Bootstrap: docker
From: ubuntu:20.04
%post
apt-get -y update
...
0
votes
0
answers
60
views
pkg_resources.DistributionNotFound: The 'fairseq' distribution was not found
I'm trying to reproduce the work of a paper that uses fairseq code in a Singularity container. In the Singularity recipe I install fairseq code with pip install --editable . and it appears to work ...
0
votes
1
answer
90
views
Apptainer build gets stuck at "Geographic area" selection
I tried to build an apptainer image from the following definition file:
Bootstrap: docker
From: pytorch/pytorch:2.0.1-cuda11.7-cudnn8-devel
%files
./requirements.txt /src/requirements.txt
%post
...
0
votes
0
answers
88
views
Different behavior for pipenv (not) using pyenv when using gitlab-runner with singularity
Background
Trying to find an easy, automated way to mirror local python apps from different environments (with different dependencies) into running containers, I use a bunch of different tools:
Local ...
0
votes
1
answer
277
views
How to set a shell variable in a Singularity definition file so that it is seen by several sections
I need to set a version string for an app that I am packaging in a Singularity container. This version string is used in several places in the definition file (*.def).
I know that I can set a shell ...
0
votes
1
answer
495
views
Singularity could not open image
I ran my workflow with nextflow using singularity, for my first process there are no problems, but the second one gives me this error:
could not open image /staphb/samtools:1.15.img: failed to ...