Questions tagged [singularity-container]

For questions about programmatic problems relating to the Singularity scientific computing container solution.

Filter by
Sorted by
Tagged with
0 votes
0 answers
22 views

How to copy files from host machine to Singularity container when the in-container directory does not exist

Environment: Ubuntu 22.04 server LTS Singularity 4.0.2 I'm trying to copy a file /home/host_user/.vnc/passwd from host machine to the Singularity container under directory/root/.vnc. The problem ...
zzzhhh's user avatar
  • 21
0 votes
1 answer
22 views

Running a command within a launched shell within an apptainer instance

I'm working towards setting up a script for batch submission to an HPC system which uses software in an apptainer image. Here's what I have in mind: apptainer run container.sif runjob.sh runjob.sh ---...
Arland's user avatar
  • 45
0 votes
1 answer
46 views

How to start a conda/mamba environment in a container during execution

I would like to do exec on my container and execute my command: apptainer exec myContainer.sif myCommand (or singularity) but myCommand is within a conda/mamba environment, so I am doing: apptainer ...
ramiro's user avatar
  • 27
0 votes
0 answers
17 views

Singularity Container: I cannot make writable persistent from singularity sandbox to host

I do the following I build a sandbox singularity build --sandbox project/ project.recipe I access the sandbox to modify stuff singularity shell -B /path/to/host:/path/in/sandbox --writable project ...
christian ortiz's user avatar
0 votes
0 answers
55 views

FATAL: While performing build: conveyor failed to get: while converting reference: pinging container registry registry-1.docker.io:

I install apptainer by following the instructions from https://github.com/apptainer/apptainer/issues/url. After fresh installation "apptainer build" command gives error while building from ....
Shafayet Rahat's user avatar
0 votes
0 answers
26 views

Running a command inside a singularity container

This is probably very easy, but I am very new to singularity containers, any help appreciated. I have the following definition file: Bootstrap: docker From: ubuntu:20.04 %post apt-get -y update ...
ramiro's user avatar
  • 27
0 votes
0 answers
16 views

pkg_resources.DistributionNotFound: The 'fairseq' distribution was not found

I'm trying to reproduce the work of a paper that uses fairseq code in a Singularity container. In the Singularity recipe I install fairseq code with pip install --editable . and it appears to work ...
jessicalfr's user avatar
0 votes
1 answer
17 views

Apptainer build gets stuck at "Geographic area" selection

I tried to build an apptainer image from the following definition file: Bootstrap: docker From: pytorch/pytorch:2.0.1-cuda11.7-cudnn8-devel %files ./requirements.txt /src/requirements.txt %post ...
Knipser's user avatar
  • 347
0 votes
0 answers
36 views

Different behavior for pipenv (not) using pyenv when using gitlab-runner with singularity

Background Trying to find an easy, automated way to mirror local python apps from different environments (with different dependencies) into running containers, I use a bunch of different tools: Local ...
me807060's user avatar
0 votes
1 answer
30 views

How to set a shell variable in a Singularity definition file so that it is seen by several sections

I need to set a version string for an app that I am packaging in a Singularity container. This version string is used in several places in the definition file (*.def). I know that I can set a shell ...
András Aszódi's user avatar
0 votes
1 answer
46 views

Singularity could not open image

I ran my workflow with nextflow using singularity, for my first process there are no problems, but the second one gives me this error: could not open image /staphb/samtools:1.15.img: failed to ...
sara777's user avatar
0 votes
1 answer
27 views

Trying to run a R script within a container

I am trying to run a tool called LINDA with singularity. I am struggling to understand how I can run a R script within the container. So far I am running the command below with slurm but it says there ...
simthi's user avatar
  • 13
0 votes
0 answers
60 views

Docker container works well, but Singularity sif creates permission error

I created a Docker image that works as expected. I've provided the dockerfile and entrypoint file here on the off chance it's helpful. I can run through prokaregia.sh, the script the environment was ...
schmiggle's user avatar
1 vote
0 answers
60 views

Warning given when running a model: boundary (singular) fit: see help('isSingular')

I am doing following simulation study to observe model performance of sample pooled data from superpopulation data a<-0 beta<-0.5 n<-10^6 probx<-0.5 gamma<-c(rep(x = 0.1,n/5), rep(x = ...
Md. Sabbir Ahmed Mayen's user avatar
0 votes
1 answer
91 views

Why singularity containers behave differently on login vs computing nodes on slurm HPC

Why I am able to run an R script in a singularity container manually without problems, but as an array job on slurm HPC it fails on various levels. This is in contradiction with the assumption that ...
Imsa's user avatar
  • 69
0 votes
0 answers
22 views

How to modify temporary files when running apptainer interactivelly

When running my container with docker I need to modify one file sed -i "242s/.decode('utf-8')//" /usr/local/lib/python3.6/site-packages/keras/models.py When running the .sif file I have ...
Manolo Dominguez Becerra's user avatar
0 votes
0 answers
102 views

How to run a python script stored in singularity container?

I'm currently engaged in a project that involves deploying the application within a Singularity container environment. The application is coded in python. I have setup a singularity container sandbox ...
hbnj's user avatar
  • 1
0 votes
1 answer
26 views

MPI ring_c not working on Singularity Container

I installed openmpi 4.1.2 and mpich 4.1.2 on a Ubuntu Bionic Singularity container. They install fine, and I compile the ring_c from the test scripts and at first glance things work. I tested that I ...
Astro.Bacon's user avatar
0 votes
1 answer
48 views

How to hide warning when working with apptainer

This is the code: ## The tools are images generated and excuted by apptainer export python="apptainer run /mainfs/wrgl/broadinstitute_warp_development/warp/images/datascience-notebook_latest.sif&...
Manolo Dominguez Becerra's user avatar
0 votes
0 answers
11 views

As an administrator, configure Singularity to redirect paths to local repositories

I'm new to Singularity and especially to it as an administrator. I have local servers or cached files for various packages like apt or python pip. Is there a way to ensure that Singularity ...
HaDr0n's user avatar
  • 1
0 votes
0 answers
35 views

How to create a virtual environment with singularity containers (influxdb, ganglia, prometheus) for generating (ML) train data

I am creating a virtual environment initially using docker containers locally on my Ubuntu machine. Eventually, I will take it to the HPC environment and run it there in much larger scales. The ...
1lw's user avatar
  • 1
0 votes
0 answers
59 views

JupyterLab not identifying hostname when launched

I'm trying to use a Singularity image to run a JupyterLab instance, but once the instance is started I'm unable to access it remotely because JupyterLab seems to fail to capture the name of the node ...
Matheus Correia's user avatar
1 vote
0 answers
101 views

Issue with RStudio Server in Singularity Container: User Privilege and UID Switching

Description: I have been successfully converting a Docker container to a Singularity container using the steps provided on https://rocker-project.org/use/singularity.html. singularity pull docker://...
ck_CN's user avatar
  • 11
0 votes
0 answers
59 views

Apptainer pull failed to get checksum

I have access to two systems and want to run the same container on both (as far as possible). The problem is that one only supports charliecloud, the other apptainer. I found out the best way would be ...
Pinko's user avatar
  • 49
0 votes
0 answers
35 views

singularity container using package from outside of container

I created a singularity container with conda just to install the packages faster. However, I noticed that when I use the container if there is already a package installed in my system that is the same ...
Jackson12's user avatar
0 votes
0 answers
58 views

PATH from docker env overwritten by Singularity when called by Snakemake

I am trying to use containers to run Snakemake pipelines, but the PATH variable keeps getting overwritten when Snakemake converts docker containers to singularity. Here is my dockerfile. # Dockerfile ...
spo's user avatar
  • 304
1 vote
1 answer
88 views

How can I point Nextflow to the correct singularity binary?

I have a Nextflow workflow which I run from a conda environment (which also has singularity installed): name: nextflow channels: - conda-forge - bioconda - defaults dependencies: - nextflow -...
pietro_molina's user avatar
2 votes
0 answers
169 views

Cannot bind a directory using --singularity-args '-B' in snakemake

I have troubles running snakemake in a singularity container. My raw data resides outside the working directory, and I am not able to access the raw data from inside the container. Path to the raw ...
tretol's user avatar
  • 21
0 votes
0 answers
39 views

Can't pack singularity sanbox into sif container

I'm using singularity to build a container containing a conda environment (QIIME). I have already set the conda environment inside the singularity sandbox. And I want to build an auto-active conda ...
Rossy Clair's user avatar
1 vote
1 answer
139 views

Can't excute command in Singularity image with Nextflow

I'm trying to do a simple process, create the a.txt file in $projectDir/Result directory with a singularity container. My working dir: touch.nf nextflow.config a.txt (I want to create) This is my ...
Rossy Clair's user avatar
0 votes
2 answers
154 views

How do I run many Singularity/Apptainer containers from one Python script, using multiple CPUs and nodes?

Problem statement I have a Python program that needs to launch a number of Singularity containers in parallel. Is it possible to do this, exploiting all of the available hardware, using only built-in ...
theo-brown's user avatar
0 votes
0 answers
31 views

A docker container produce errors with Apptainer unless in writable sandbox mode

A (confidential) docker container fails on tests when run by Apptainer unless it is in the writable sandbox mode. I tried ls \ -tral I see only /etc, /tmp, mounted and special folders like /....
Serge's user avatar
  • 3,417
0 votes
0 answers
98 views

JupyterHub config and access through Bright CM

In our university, we're working on a cluster where potentially 70-80 users might need to use Jupyter Notebook simultaneously. We are currently utilizing Bright Cluster Manager (BCM) and not OOD. We'...
Manters's user avatar
0 votes
0 answers
33 views

singularity pulls but does not search lolcow?

singularity search lolcow gives me: FATAL: Couldn't search library: request did not succeed: http status code: 504 However singularity run library://lolcow works and singularity search tensorflow ...
aerijman's user avatar
  • 2,572
0 votes
0 answers
59 views

How to add libraries with pip and conda to a Singularity container

I'm working in a computational HPC node and I'm provided with a singularity container. I don't have write permissions to the image. I would like to execute this container, pip install some libraries ...
mrq's user avatar
  • 286
0 votes
1 answer
127 views

Singularity and numba/numpy: RuntimeError: Attempted to compile AOT function without the compiler used by `numpy.distutils` present

My software is written in Python and uses numba and numpy. I distribute it using Docker. Here is the Dockerfile. One of my users (see GitHub issue) wants to run the software on a HPC where Singularity ...
MrTomRod's user avatar
  • 344
0 votes
0 answers
22 views

How can the current directory be shown in a singularity container on the terminal?

I'm a new Singularity user. When I run the command singularity shell my_con.sif. The terminal only shows: Singularity> For convenience, is there any way to show the current path on the terminal? ...
Rossy Clair's user avatar
0 votes
0 answers
125 views

Apptainer installation with use Windows Subsystem for Linux (WSL)

I am extremely happy user of Windows OS 11 who needs to use Apptainer in my developer work. I am considering two options of apptainer installation/use in Windows: using Git/VirtualBox/Vagrant/Vagrant ...
Andrzej Marciniak's user avatar
0 votes
0 answers
26 views

My stable-baselines3 script is interrupted in singularity images and no logs

I try to train a custom environment by stable-baselines3 inside a singularity images.But it is always interrupted by SIGTEM.Here are the informations: Loguru caught a signal: SIGTERM Loguru caught a ...
Leestring's user avatar
3 votes
2 answers
259 views

Python script file missing in Singularity image

In AWS, created a docker image with a python script to print a string(basicprint.py) docker file: FROM python COPY ./basicprint.py ./ CMD ["python", "basicprint.py"] It works ...
Subbu VidyaSekar's user avatar
1 vote
1 answer
405 views

Pulling from GitLab with singularity

I'm trying singularity for the first time and having some issues. I have an image in my container registry for which I have a personal access token in the repo. I wish to pull this with singularity, ...
DScott's user avatar
  • 11
0 votes
0 answers
160 views

Unable to use Nvidia OpenCL in Singularity containers

I'm struggling a lot with making OpenCL GPU acceleration available within a Singularity container. Executed directly on the host itself (without Singularity in between), I get the GPU application, a ...
user3305567's user avatar
0 votes
0 answers
54 views

Container for RStudio (not server)

I am trying to setup a container for RStudio (not the server!). On our university system (a modified Debian 11), I could not install Rstudio. Therefore, I tried putting together a Singularity recipe. ...
aqua's user avatar
  • 220
0 votes
0 answers
20 views

OpenFOAM user compilations

This is my first question in Stack overflow. I am studying master mechanical engineering. I have started Project Work. I have never worked with C++ or OpenFoam before, sothat i am a little bit lost ...
khaled's user avatar
  • 33
1 vote
1 answer
60 views

quotes and spaces in singularity container

I am trying to send an argument from a terminal into a singularity container. It am trying to run an AFNI container (19.3.18) https://afni.nimh.nih.gov/pub/dist/doc/htmldoc/background_install/...
brainimaging_new_to_unix's user avatar
0 votes
1 answer
303 views

Singularity: Python package not available even though it is in docker

I built myself a docker image from this docker file: FROM ubuntu:22.04 RUN apt-get update RUN apt-get upgrade -y # Install python: RUN apt-get install software-properties-common -y RUN add-apt-...
Imahn's user avatar
  • 394
0 votes
0 answers
490 views

Error from Singularity building a docker image . Process gets killed

The process gets killed every time I run a singularity build for an 8GB docker image in a HPC Initially I would run salloc --time=1:0:0 --ntasks=4 --gres=gpu:2 --account=<xx> --nodes=2 --ntasks-...
user21694670's user avatar
0 votes
0 answers
61 views

Two different ssh config options to connect to the same remote host

I am trying to get a somewhat convoluted SSH setup working. There is a remote HPC cluster that spins up compute nodes that one can access through SSH. There are hundreds of nodes with names like ...
book_kees's user avatar
  • 327
0 votes
0 answers
92 views

stdout stderr not captured from binary executed in singularity container

I have a complex HPC (openpbs 20.0.1, Ubuntu 18.04) workflow using a python subprocess to execute qsub which ultimately launches a singularity (3.9.9) container with the exec command to execute a ...
Chase Schuette's user avatar
0 votes
0 answers
21 views

How can I write the file paths so that a script that exists outside of a singularity image can call scripts within that image?

Question I'm new to working with containers, but the HPC I'm using requires that most things be run via containers (fair enough) so I'm trying to run my code appropriately. Because editing files in ...
SpaceRockDoc's user avatar

1
2 3 4 5
8