Skip to main content
Filter by
Sorted by
Tagged with
0 votes
0 answers
8 views

Build a Singularity container until writing to SIF?

When creating a Singularity Image File (.sif) from a Singularity script, the sif can get too big for services such as GitHub Actions, which causes a Continuous integration script to break. However, ...
richelbilderbeek's user avatar
0 votes
0 answers
24 views

Defining Bind Paths and Mounts in Def Files

I am using Apptainer to containerize a JupyterLab server. I want my container to bind to the home directory and a few other settings-related directories. I picked up this project from a coworker, and ...
Clement Faisandier's user avatar
0 votes
1 answer
30 views

Starting Nextflow in a singularity container and use it to run another singularity container

I want to use nextflow in a singularity container that will further run my nextflow pipelines packed in a singularity. This will help us bypass installation of nextflow in all our test servers. I am ...
Anuradha Ravi's user avatar
0 votes
1 answer
18 views

Is there a way to run snakemake within a singularity container with computing cluster submission for individual rules?

Is there a way to get the rules submitted to the cluster to inherit the parent command singularity container? I'm running the base snakemake within a container for portability with most rules using ...
AroneyS's user avatar
  • 65
0 votes
0 answers
15 views

CmdStan and OpenCL - Exception: compile_kernel: calculate : Unknown error -11

I'm trying to run some models on HPC GPUs using CmdStan and OpenCL. I'm using this Docker image to get everything available just right. Just to keep things simple, I'm using the same stan model from ...
JoFrhwld's user avatar
  • 8,997
0 votes
1 answer
51 views

singularity failing due to error squashfs filesystem seems not enabled

Singularity version 4.1.4-1 and squashfs-tools version 4.3 are installed on RHEL 7.9 (Maipo). Running a container fails with the following message: (base) -bash-4.2$ singularity --verbose shell ...
tmoser911's user avatar
1 vote
1 answer
35 views

Singularity/Nexflow script won't load Tensorflow from .sif on cluster

I'm trying to run a singularity/nextflow script on an HPC. This script utilizes tensorflow, which is specified in the docker image I used to pull the initial .sif file from lpryszcz/deeplexicon:latest....
Brendan's user avatar
  • 11
0 votes
0 answers
20 views

How to run brew during an apptainer build given brew cannot run as root?

I am trying to build the following apptainer. The last part of the script compiles the octopus variant caller. Bootstrap: docker From: ubuntu:latest %environment DEBIAN_FRONTEND=noninteractive ...
Harry Matthews's user avatar
0 votes
0 answers
54 views

Singularity container with OpenMPI and InfiniBand (UCX)

I'm working as an intern currently, and I was asked to build a Singularity container for OpenMPI to make distributed programming possible on multiple machines of our HPC cluster using containers. ...
Vincent Donney's user avatar
0 votes
0 answers
15 views

Multiple conda environments in a single singularity container

The title is pretty much the question. Is it possible to generate multiple conda/mamba environments in a single container using the recipe. I've been trying using the code below but when I build the ...
daray's user avatar
  • 11
0 votes
0 answers
24 views

Sticky bit on /tmp in container causing MPI code to hang

First of all, great job on singularity. It has been very useful so far. I have a rather detailed question concerning a problem we encountered recently with a project using a CentOS 7 container, MPI 1....
todd's user avatar
  • 11
0 votes
0 answers
144 views

Installing Singularity Error: make: *** .builddir: No such file or directory. Stop

I've been unsuccessfully attempting to install Singularity for a while now. I've updated to Noble, and tried to follow the instructions given on the Singularity CE Guide to install the latest version ...
Zeke Young's user avatar
0 votes
1 answer
118 views

Singularity build crashes because of pip memory usage

I am currently trying to build quite a simple .sif image from a .def file with singularity 4.1.3. The problem is that whatever settings I try to use for pip install, I always fail the build due to: ...
Pietro's user avatar
  • 21
0 votes
0 answers
44 views

Could not find any NVIDIA binaries on this host!, when i try to run docker image on server using singularity

I am trying to run a docker image on slurm server, I pulled this software's image from docker to my local machine then, copied to server. When I run it on the server using singularity run aoflagg.sif ...
user25010317's user avatar
0 votes
0 answers
82 views

Trying to build a Singularity .sif file from a .def file referencing a local docker image - not working

I am trying to build a Singularity .sif file from a .def file referencing a local docker image. This is not working at all. The error is: FATAL: While performing build: conveyor failed to get: ...
trouselife's user avatar
2 votes
1 answer
1k views

How to correctly activate micromamba environment inside Apptainer container automatically?

I am trying to build a micromamba based container, that automatically activates the correct environment to run an application (here jupyter-lab). Apptainer.def Bootstrap: docker From: mambaorg/...
Soerendip's user avatar
  • 8,779
0 votes
0 answers
60 views

Singularity showed cleanup error and says some directories do not exist

I tried to submit a job via PBS queue system, here is my script: #!/bin/bash #PBS -N cp2k #PBS -S /bin/bash #PBS -j oe #PBS -q noor2 #PBS -m e #PBS -l walltime=1:00:00,nodes=1:ppn=64 export ...
Tieyuan Bian's user avatar
0 votes
1 answer
140 views

How to Run Commands in a Singularity from Shell Script

I wish to run a Python script in a singularity container. In particular, I have attempted writing the following in the shell script singularity shell <name.sif> python3 <python-script.py> ...
Crisandro Allen Lazo's user avatar
0 votes
0 answers
69 views

Spack Error: Additional properties are not allowed

I am trying to build lbann in a container. The lbann package is installed within the container using spack in such a way that it makes use of the openmpi package built from source within the container....
boltz's user avatar
  • 75
0 votes
1 answer
46 views

Issue with Singularity Command Recognition for Fastq.gz Files

I am developing a shotgun metagenomics pipeline using Snakemake and Singularity, but I'm facing difficulties when trying to execute the Singularity command within Snakemake to analyze fastq.gz files. ...
Rafaela Carolina dos Anjos Sch's user avatar
0 votes
1 answer
56 views

The /etc directory appears empty when I try to access files using R

I have a bash script where I use singularity exec to run a program from inside the container. I want to call this script in R using the system() function. Everything works fine until Singularity needs ...
anria's user avatar
  • 47
0 votes
0 answers
38 views

Call singularity exec from a shell script in R

I have a bash script where I use singularity exec to run a program from inside the container. I want to call this script in R using the system() function. Everything works fine until it reaches the ...
anria's user avatar
  • 47
0 votes
0 answers
40 views

IPC Server handler / File does not exist, running hadoop in singularity container

I don't have any experience with hadoop and am running into issues while attempting to run a singularity container that uses it - it seems like it's not really getting started and i'm trying to figure ...
aknodt's user avatar
  • 173
1 vote
1 answer
39 views

--no-home Singularity flag doesn't work on Docker container in a cluster node

When I use a Docker container on a HPC cluster's login machine using Singularity, it works as expected and I can access the container's /home: singularity exec docker://quay.io/comparative-genomics-...
Thomas's user avatar
  • 471
0 votes
0 answers
28 views

How to run piped command with Python subprocess without deadlocking?

I have a python script that runs for cmd in chr_commands: info("Run: "+cmd) subprocess.run(cmd) Where each cmd is equivalent to samtools view -F 0x0004 input.bam chr3:0-500000 2>&...
Niek de Klein's user avatar
1 vote
0 answers
334 views

conveyor failed while building an apptainer image from defintion file

I am trying to run inference results from https://github.com/mlcommons/inference_results_v3.1/blob/main/closed/Intel/code/gptj-99/pytorch-cpu/docker/Dockerfile_int4 which uses docker however instead ...
krishna's user avatar
  • 1,364
1 vote
2 answers
106 views

Bind and run a Python module with singularity from a remote directory

I need to run a personnal Python module from a singularity container. I usually run it with the following command : singularity run ./Image/myimage.sif -m mymodule.start However it's only work if I ...
Milodupipo's user avatar
0 votes
0 answers
29 views

Python package location docker on singularity

I have a docker container and which runs a python script using packages installed from a requirements.txt file. When I run this using docker, the packages are installed correctly and are located ...
Daniel Edwards's user avatar
0 votes
0 answers
50 views

Use --contain and --bind in singularity run command

I was experiencing a bunch of trouble with python packages for a Docker container running on singularity. I managed to solve the issue by adding the --contain flag to the singularity run command. But ...
Daniel Edwards's user avatar
1 vote
1 answer
463 views

Encountered Errors in Storing Images using Singularity in Cluster

I am trying to get myself familiar with operations related to our cluster, so I tried using singularity there. I am having issues with pulling a specific docker image into singularity in the cluster. ...
Newbie's user avatar
  • 41
0 votes
1 answer
512 views

singularity exec is not recognizing executables in container $PATH (converted micromamba docker image to singularity image)

There is a similar post but this post is regarding building a singularity container: Singularity containers: adding custom packages to $PATH and pass it to singularity exec I have converted a Docker ...
O.rka's user avatar
  • 30.4k
-1 votes
1 answer
97 views

singularity build cannot install build-essentials

I am trying to build a singularity container (recipe file at the end of this post) and it is not able to install build-essentials. Execution fails with: E: Unable to locate package build-essentials ...
Targon's user avatar
  • 161
1 vote
0 answers
73 views

I cannot execute a program in a container when working with Apptainer becaouse the path is not found

I have pulled a Docker container to create the .sif file apptainer pull docker://mblanche/ngmerge:latest there is no documentation so I have explored the sif file to know where is the tool I want to ...
Manolo Dominguez Becerra's user avatar
1 vote
0 answers
96 views

Running c++ on cluster with slurm and sif container

I'm attempting to execute a C++ code on a cluster that utilizes Slurm. Since the server did not have g++ installed, I created a Singularity container (SIF) to facilitate the execution. However, I've ...
io421's user avatar
  • 11
1 vote
1 answer
81 views

Intermediate build checkpoints for singularity containers?

I have to build a container with singularity/apptainer. However, I'm in the process of writting the definition file, which needs some iteration and building the image is pretty long; I'm pretty new to ...
Jeremy's user avatar
  • 21
0 votes
0 answers
343 views

Singularity container cannot find files after being created from a Docker image

I am creating a Singularity container from a Docker image. However, the Singularity container gives me errors that weren't present while I used Docker. This is how I create my Docker image - FROM ...
desert_ranger's user avatar
0 votes
0 answers
88 views

Failed to install SingularityCE in WSL - failed to verify certificate

I want to install Singularity on my WSL, I followed the instructions in INSTALL.md, I tried with different version however the outcome still the same. I have installed the dependencies and Go ...
Kdallah's user avatar
0 votes
1 answer
67 views

loop through list element one at the time

Hi there I've been experimenting with a job array using Singularity, the problem is that singularity takes in input only global/environment variables within the container — to the best of my knowledge ...
Matteo's user avatar
  • 221
0 votes
1 answer
103 views

Toil-cwl-runner not using default-container option with singularity option

Issue We are attempting to run toil-cwl-runner with a default singularity image. We got this to work as we intended with cwltool, but toil-cwl-runner seems like it is ignoring the default image to use....
Marcus Keil's user avatar
0 votes
0 answers
1k views

How to activate conda and a specific conda env for each shell and subshell in a singularity container

I have been trying this for a few days and no success. I am building a Singularity container (version 4.0.2-jammy), and I want to use conda within it. I am able to install conda, create the ...
Gian's user avatar
  • 101
0 votes
1 answer
399 views

Running a command within a launched shell within an apptainer instance

I'm working towards setting up a script for batch submission to an HPC system which uses software in an apptainer image. Here's what I have in mind: apptainer run container.sif runjob.sh runjob.sh ---...
Arland's user avatar
  • 57
1 vote
1 answer
943 views

How to start a conda/mamba environment in a container during execution

I would like to do exec on my container and execute my command: apptainer exec myContainer.sif myCommand (or singularity) but myCommand is within a conda/mamba environment, so I am doing: apptainer ...
ramiro's user avatar
  • 49
0 votes
0 answers
95 views

Singularity Container: I cannot make writable persistent from singularity sandbox to host

I do the following I build a sandbox singularity build --sandbox project/ project.recipe I access the sandbox to modify stuff singularity shell -B /path/to/host:/path/in/sandbox --writable project ...
christian ortiz's user avatar
1 vote
0 answers
425 views

FATAL: While performing build: conveyor failed to get: while converting reference: pinging container registry registry-1.docker.io:

I install apptainer by following the instructions from https://github.com/apptainer/apptainer/issues/url. After fresh installation "apptainer build" command gives error while building from ....
Shafayet Rahat's user avatar
0 votes
0 answers
163 views

Running a command inside a singularity container

This is probably very easy, but I am very new to singularity containers, any help appreciated. I have the following definition file: Bootstrap: docker From: ubuntu:20.04 %post apt-get -y update ...
ramiro's user avatar
  • 49
0 votes
0 answers
60 views

pkg_resources.DistributionNotFound: The 'fairseq' distribution was not found

I'm trying to reproduce the work of a paper that uses fairseq code in a Singularity container. In the Singularity recipe I install fairseq code with pip install --editable . and it appears to work ...
jessicalfr's user avatar
0 votes
1 answer
90 views

Apptainer build gets stuck at "Geographic area" selection

I tried to build an apptainer image from the following definition file: Bootstrap: docker From: pytorch/pytorch:2.0.1-cuda11.7-cudnn8-devel %files ./requirements.txt /src/requirements.txt %post ...
Knipser's user avatar
  • 347
0 votes
0 answers
88 views

Different behavior for pipenv (not) using pyenv when using gitlab-runner with singularity

Background Trying to find an easy, automated way to mirror local python apps from different environments (with different dependencies) into running containers, I use a bunch of different tools: Local ...
me807060's user avatar
0 votes
1 answer
277 views

How to set a shell variable in a Singularity definition file so that it is seen by several sections

I need to set a version string for an app that I am packaging in a Singularity container. This version string is used in several places in the definition file (*.def). I know that I can set a shell ...
András Aszódi's user avatar
0 votes
1 answer
495 views

Singularity could not open image

I ran my workflow with nextflow using singularity, for my first process there are no problems, but the second one gives me this error: could not open image /staphb/samtools:1.15.img: failed to ...
sara777's user avatar

1
2 3 4 5
8