Questions tagged [nvidia]
For programming questions specifically related to Nvidia hardware. N.B. Questions about system configuration are usually off-topic here!
3,691
questions
0
votes
0
answers
11
views
Some people say it is bad to update graphics card regularly . Is the statement true ? As I am getting multiple bugs
Some of my friends says its not good update graphics regularly as new update can have some bugs that can damage your system hardware . Is it True ?
Some of the update gets bugs and glitches. Some of ...
-4
votes
0
answers
32
views
How to get nvidia driver/cuda setup for RTX A6000(fedora linux) [closed]
I am trying to install nvidia drivers, as well as cuda for my system, but am running into issues.
I am wondering basically do I have to install the data center drivers instead since I am using 2x ...
-1
votes
1
answer
65
views
Obtain real OpenGL texture format [closed]
In my application I need to update a texture every frame and to do this very fast I am using CUDA, also because my initial data are 24bit BGR.
I created a texture this way:
glTexImage2D(GL_TEXTURE_2D, ...
0
votes
0
answers
35
views
rtx 6000 ada vs rtx a6000
Two graphics cards installed in one computer.
and I checked with nvidia-smi.
I ran this simple code on both graphics cards to see if it worked.
model = YOLO('yolov8x-pose.pt')
def pose_detection(...
0
votes
0
answers
12
views
how to find the cause of software failure to start properly? [closed]
I can not start cs2 on my ubuntu22.04. Where can I find the error message and how can I troubleshoot problem step by step?
I tried to re-install the graphics card driver(nvidia server driver ...
-3
votes
0
answers
8
views
wine lutris bottle not working (garuda arch based linux) [closed]
Hello I'm relatively new to those stuff, but I know the basics I try every thing I can but wine it's not working on my Garuda Linux also bottle and Lutris, and I ran some tests with wine but when I ...
-2
votes
0
answers
36
views
NVIDIA CUDA Install issues:could not find compatible hardware [closed]
I want to install CUDA 11.2 to learn Python deeplearning. But when I install CUDA, it just cannot install the graphics driver, says that the graphics driver cannot find compatible hardware.
I've tried ...
0
votes
0
answers
28
views
Record a Video in Isaac Sim
In Isaac Sim it is possible to export individual frames via the Animation Recorder or Movie Capture. There are several forum posts concerning the question if entire videos can be recorded (see here, ...
1
vote
1
answer
27
views
Calculating Arithmetic Intensity
Nvidia's GPU Performance Background User's Guide (https://docs.nvidia.com/deeplearning/performance/dl-performance-gpu-background/index.html) lists the following arithmetic intensities for fp16 data ...
0
votes
0
answers
27
views
CUDA failed to initialize in docker container, Ubuntu22.04, WSL2
The pytorch code running in container seems not able to access my GPU.
I m running a pytorch mesh generation project, they provided a docker image like
FROM nvcr.io/nvidia/pytorch:23.04-py3
ARG ...
-1
votes
1
answer
26
views
How do I install a pip python fused_kernels library on a GPU CUDA machine?
https://github.com/EleutherAI/gpt-neox/blob/5dd366539803dbf1fd725cc057013fd002a4cfd4/requirements.txt#L28
fused-kernels @ file:///fsx/hailey/math-lm/gpt-neox/megatron/fused_kernels
Line 28 here is ...
0
votes
0
answers
27
views
GPU Passthrough in kvm, but dmesg reports arm-smmu-v3 CMD_SYNC timeout on host [closed]
For some reason I can only use iommu.passthrough to enable iommu on my arm64 borad. It seems I successfuly passthrough a Tesla P4 into my guest machine.
But after installing the Nvidia vgpu driver, ...
0
votes
0
answers
14
views
exiting app in a daemonset's pod does not create a new pod, but restart the existing one
I'm facing a problem with a kubernetes daemon set that may imply that I don't understand correctly how pods work
I have a daemonset which runs an app that requires nvidia's nvml library
I'm running ...
0
votes
0
answers
12
views
How to install and run docker on Google collab?
I wish to run this https://developer.nvidia.com/blog/optimizing-inference-on-llms-with-tensorrt-llm-now-publicly-available/ on google collab but unable to run docker after installing it not sure ...
0
votes
0
answers
5
views
When are glXQueryFrameCountNV wglQueryFrameCountNVupdated?
I am trying to synchronize rendering between multiple computers, for this I use the NVIDIA GLX_NV_swap_group and WGL_NV_swap_group extensions. The extensions also provide QueryFrameCountNV to access a ...
-1
votes
0
answers
10
views
my deep learning code is running slow and not using the gpu
i am new to deep learning and using gpu, i installed all the drivers and everything , and checked whether tensorflow is detecting the gpu or not and yes it is detecting, but when i am running my deep ...
-1
votes
0
answers
11
views
Visual Glitch When Opening Any App In FullScreen Mode, Windows 10 [closed]
I have this weird graphics glitch in my monitor when I open software in full screen. I use two monitors, but the glitch only appears in my main monitor. as you can see in this image the glitch appear ...
0
votes
1
answer
95
views
Docker Error - Unknown or Invalid Runtime Name: Nvidia
https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_visual_slam
Let's take a look at the Visual SLAM package above in the Isaac Sim environment. This package works in ROS2 environment.
Edit /etc/docker/...
0
votes
0
answers
71
views
How many banks in a shared memory of a Nvidia 3080
I'm currently learning CUDA and exploring how to implement shared memory. During my learning journey, I came across something called a 'bank conflict.' A key feature of CUDA architecture is parallel ...
-2
votes
0
answers
27
views
How to run deep learning frameworks on different CUDA versions in Docker container
I have the following problem: I've developed a deep learning pipeline in PyTorch (but the problem also exists for Tensorflow) which works on my computer with my GPU and CUDA version. That's all fine. ...
0
votes
1
answer
47
views
What version of TensorFlow+Keras should I install for nVidia GeForce GTX 480?
Microsoft Windows [Version 10.0.19045.2965]
(c) Microsoft Corporation. All rights reserved.
C:\Users\pc>nvcc -V
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2017 NVIDIA Corporation
...
0
votes
0
answers
52
views
Does the NVIDIA Tensor Core's wmma::fragment definition allocate register space?
I want to implement a complex function with tensor core (NVIDIA A100), for which I might define a large number of wmma::fragment register units, and I want different warps to perform different ...
0
votes
0
answers
97
views
RuntimeError: CUDA error: CUDA-capable device(s) is/are busy or unavailable while GPU utilization is 0% according to nvidia-smi
I'm trying to launch a gradio backend that uses the LLM calls from Facebook. But it tells me that GPUs are not available:
(.venv) reply@reply-GP66-Leopard-11UH:~/dev/chatbot-rag$ gradio gradio-chatbot....
-2
votes
1
answer
64
views
Error MSB3721 while building bandwithTest utility from samples by Nvidia CUDA
I have been trying to install CUDA. As mentioned in the docs I built and ran deviceQuery and nvcc command which worked perfectly. But when I tried to build bandwidthTest I got the error MSB3721. On ...
-1
votes
0
answers
27
views
Donkey car install is failing.- jetson nano
running
Pip install -e .[nano] fails. It looks like it tries about 10 versions of opencv but never finds a combination that works.
The only thing that I’ve noticed while attempting the install is the ...
-2
votes
0
answers
69
views
My CUDA implementation does not show performance improvement [on Windows OS]
I am trying to learn CUDA programming using the following CUDA tutorial. I am adding two arrays of size 20 million (approx.). I ran both CPU and GPU-based code on my personal laptop [Windows 10 OS]. ...
0
votes
0
answers
93
views
Runtime issues with L40 cufft out-of-place callbacks
Running out-of-place FFT transforms with callbacks enabled on L40 leads to slow runtime with occasional large runtime spikes.
I modified the simpleCUFFT_callback sample code to use a separate output ...
1
vote
0
answers
17
views
How out-of-order pixel warp completion affects warp occupancy?
Nvidia's document: https://developer.nvidia.com/blog/the-peak-performance-analysis-method-for-optimizing-any-gpu-workload/ says:
the following resources can also limit the SM occupancy: ...
For Pixel ...
-2
votes
0
answers
67
views
How to enable Tensor core for cublasSgemmBatched on H100?
I have tried to use cublasSetMathMode(blasHandle,CUBLAS_TF32_TENSOR_OP_MATH) to apply TF32 in cublasSgemmBatched.
Before I set TF32 mode, the Nsight Systems profiling shows:
4.0% ...
0
votes
0
answers
44
views
nvidia tensorflow, docker-compose and container communication with tensorflow
I have a server with an Nvidia GPU (rtx 3060), and I am setting up a tensorflow container with docker-compose, with support for the GPU with the official Nvidia image. So far so good. If I enter the ...
-5
votes
1
answer
83
views
Nvidia nppi function corrupting destination pointer [closed]
I am trying to run this 2d convolution filter from the nppi library, but for some reason it seems my destination pointer is getting corrupted.
#define KERNEL_WIDTH 3
#define KERNEL_HEIGHT 3
#define ...
0
votes
0
answers
25
views
NVIDIA Video Codec Samples giving ffmpeg errors while trying to build
My computer environment:
Driver:510.108.03
CUDA:11.1
NVIDIA Video Codec SDK:11.1.5
FFmpeg:4.4 (Comes with SDK)
When I compile SDK Samples, the following error occurs:
[ 15%] Building CXX object ...
0
votes
1
answer
42
views
Optimal CUDA thread/block count for a function with no inputs (random sampling)
There are a lot of questions about optimizing the number of threads and blocks in a CUDA function, but everything I've found is about matching them to the problem size.
I have a task with no problem ...
0
votes
0
answers
41
views
Couldn't create backend context from arcface engine file
I am implementing this face recognition repo https://github.com/zhouyuchong/face-recognition-deepstream/tree/main I have generated the trt engine file for both arcface and retinaface. Configured all ...
-1
votes
0
answers
53
views
CUDA blocks all threads when doing a Device to Host MemCpyAsync to a pageable host memory location
CUDA docs say that async mem copies to a pageable host location will behave in a synchronous manner, which means that the host thread calling that memcpy will block. However, im seeing that all other ...
-2
votes
0
answers
95
views
Issue while installing NVIDIA Container Toolkit
While installing NVIDIA Container Toolkit and running a sample workload. I am facing this error:
docker: Error response from daemon: failed to create task for container: failed to create shim task: ...
-4
votes
0
answers
53
views
Why the assignment in CUDA kernel doesn't work? [duplicate]
Here is the code, the key point is:
d_out[blockIdx.x] = 200;
printf("%d %d %d\n", i, tid, d_out[blockIdx.x]);
prints 0 for the third argument!
In no case should it be zero!
I don't know ...
0
votes
0
answers
87
views
ModuleNotFoundError: No module named 'pytorch_lightning.callbacks.base' when importing Nvidia Nemo's core package
I am trying to import Nvidia NeMo core package into my Google Colaboratory notebook (connected to local runtime) when this error pops up:
ModuleNotFoundError: No module named 'pytorch_lightning....
0
votes
1
answer
83
views
RTSP video feed and recording video with Gstreamer and Nvidia AGX Orin
I am trying to setup a gstreamer pipeline via gstreamer python bindings.
The pipeline should use the camera to record footage to files (and roll them), it should also support clients connecting to the ...
0
votes
1
answer
40
views
SageMaker Studio Lab, "Make AI Generated Images" lab, Error "Found no NVIDIA driver on your system"
During this lab while pipeline construction
(import torch
from diffusers import StableDiffusionPipeline
pipeline = StableDiffusionPipeline.from_pretrained(
"runwayml/stable-diffusion-v1-5", ...
0
votes
1
answer
25
views
Separate GPU based application build and test with docker
I would like to build and test my application within a CICD process. In order to reduce costs, I want to run the build and test as two separate jobs on two different machines. The build should only ...
0
votes
1
answer
44
views
Created docker container is not running AND cannot be removed or killed
I want to
run ubuntu container,
such that
it has a bind to an existing network storage located at "/mnt/datastore/Medical",
it has a mount to an existing docker volume named "...
0
votes
0
answers
118
views
BlockingIOError: [Errno 11] Resource temporarily unavailable while conda pytorch packages installation
I tried to install pytorch in a new conda environment.
So I did conda create --name nemo_venv python=3.8 and conda activate nemo_venv.
Then I did conda install pytorch==2.0.1 torchvision==0.15.2 ...
0
votes
2
answers
57
views
Cmake file for sycl CUDA backend
I am having trouble writing a CMake file to offload SYCL code to the NVIDIA backend. My CMake file currently looks like this
cmake_minimum_required(VERSION 3.22.1)
set(CMAKE_C_COMPILER /opt/intel/...
3
votes
1
answer
3k
views
Tensorflow 2.14.0 (with cuda) not registering CUDA?
I'm trying to use Tensorflow with my GPU. My system is Fedora Linux 38, NVIDIA drivers 535.113.01 (currently latest) working as expected on my system.
I created a Python environment with Python 3.9 (...
0
votes
0
answers
21
views
Lower resolutions of monitor get blurried screen using nvidia driver in Debian 11
The monitor of my laptop had several options for screen resolution before install nvidia driver on a Debian 11 system.
After installing the nvidia driver I get also several options but, besides the ...
1
vote
1
answer
85
views
How to find necessary entry in registry via powershell script?
I made a small PowerShell script that suppose to find uniquely named monitor folder in registry and then create a key in other pre-defined entry - https://github.com/SLStyler/Dithering-for-Windows-...
1
vote
1
answer
142
views
Add nvidia runtime to docker runtimes on windows WSL
I want to add the nvidia runtime to my docker.
Note that i am running windows 11.
Docker Desktop v.4.24.2 on Windows integrated on WSL 2
NVIDIA Drivers 545.84
I installed everything as nvidia-...
0
votes
1
answer
68
views
contained runtime configuration does not persist after AMI creation
I have created an AMI image to be deployed in my AWS EKS. The image has been created from a EC2 instance type P3.2xLarge, I have installed CUDA drivers and Nvidia-container-toolkit and I have ...
0
votes
1
answer
91
views
CudaMalloc not allocating to shared GPU memory on Ampere micro-architectures in opposite to Turing
I am using CUDA Toolkit 11.8 - operation system - Windows.
The program is compiled on Windows with Nvidia T1200.
I use CMAKE 3.15.7 with flag:
CMAKE_CUDA_ARCH_BIN: 3.5 5.0 5.2 5.3 6.0 6.1 6.2 7.0 7....