Questions tagged [gpu]

Acronym for "Graphics Processing Unit". For programming traditional graphical applications, see the tag entry for "graphics programming". For general-purpose programming using GPUs, see the tag entry for "gpgpu". For specific GPU programming technologies, see the popular tag entries for "opencl", "cuda" and "thrust".

Filter by
Sorted by
Tagged with
0 votes
0 answers
5 views

Tensorflow GPU memory allocation issue

I found something interesting: With TensorFlow, the code does not run when the memory is not sufficient to allocate on Windows and WSL2; it runs on MacBook even though it is very slow. Is anyone aware ...
Sol's user avatar
  • 13
0 votes
0 answers
12 views

Tensorflow is not using/seeing my GPU! (on windows)

After an update of my tensorflow version, I was not able to use my GPU for eg NN training. Tensorflow was not seeing and not using my GPU, even though CUDA drivers were updated, correctly installed ...
Dimitris's user avatar
0 votes
1 answer
30 views

How many GPUs have support for a particular feature?

At this site under Core 1.2 you can see that descriptorIndexing has 93.67% support across all platforms. Then under extensions page you can see that under VK_EXT_descriptor_indexing all the features ...
Zebrafish's user avatar
  • 11.9k
0 votes
0 answers
4 views

while using Pretrained LLM - RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu

I am new to LLM and colab notebook, I'm trying to use opensource large language model for my task, but while processing on google colab, Its getting crashed, may be because of limited RAM. So I'm ...
j k's user avatar
  • 51
-3 votes
0 answers
15 views

How to run GPU-enabled Tensorflow on ARM devices?

I am trying to run a model on my Jetson Nano (ARM64) by simply downloading Tensorflow using the pip package. It works, but it uses the CPU instead of the GPU, which slows down the prediction time by a ...
benjmerales's user avatar
1 vote
0 answers
18 views

Can NVIDIA Nsight still be used to debug shaders?

Numerous online resources claim it is possible to debug OpenGL shaders using NVIDIA Nsight Visual Studio Edition. Here is an old video of it being done. However, the Nsight VSE page mentions "the ...
Leon Frickenschmidt's user avatar
-2 votes
1 answer
62 views

Llama 2 Local AI using CPU instead of GPU - i5 10th Gen, RTX 3060 Ti, 48GB RAM

I have a setup with an Intel i5 10th Gen processor, an NVIDIA RTX 3060 Ti GPU, and 48GB of RAM running at 3200MHz, Windows 11. I recently downloaded the LLama 2 model from TheBloke, but it seems like ...
AntoineCra's user avatar
0 votes
0 answers
25 views

CUDA Out of Memory Error When Training a Large Language Model on Single GPU

I'm trying to fine-tune a large language model called Bloom, which has approximately 7 billion parameters, on my machine equipped with two NVIDIA RTX A5000 GPUs. However, I'm encountering a CUDA out-...
hasib_ullah's user avatar
0 votes
0 answers
22 views

K3s . NViDIA Container Runtime Support not detecting GPU

I’m trying to play around with automatic NVIDIA container runtime detection on my personal k3s cluster (running a desktop ubuntu variant) as described in Advanced Options / Configuration | K3s. I ...
Vinay B's user avatar
  • 683
-1 votes
0 answers
14 views

How can I run a PyTorch code in my AMD GPU (Radeon 6600)?

I wrote code using PyTorch on a computer that had an NVIDIA card, so it was easy to use CUDA. But now I'm programming on a computer that has an AMD card and I don't know how to convert it. I know ...
Rafael Rincon's user avatar
0 votes
0 answers
8 views

How can I convert onnx model to engine model supporting a GPU with different compute capability on another pc

I’m using a laptop to convert an onnx model to engine model, and then run the engine model on a gpu. My laptop’s GPU is “NVIDIA GeForce RTX 3060 Laptop GPU“, which’s compute capability is 8.6.” The ...
kevinshift's user avatar
-1 votes
0 answers
30 views

Startx black screen on Debian [closed]

I have a Debian OS with the KDE desktop environment. I was in the process of disabling hardware acceleration or direct rendering because it caused screen shuttering. I used the command: sudo startx -- ...
Justin Villerot SleepyEyes's user avatar
-2 votes
0 answers
18 views

Combining 2 or more GPUs all-together [closed]

I have to train my AI model and I have 3 GPUs of NVIDIA with 24 GB each. My model's requirement is to train it on single GPU otherwise it won't get trained. I tried the drivers and everything pre-...
Joel Christopher's user avatar
0 votes
1 answer
101 views

troubleshooting PyTorch and Hugging Face's Pre-trained deBerta Model on Windows 11 with an RTX 3070 GPU

I'm running Windows 11 on my desktop, which has an NVIDIA RTX 3070 GPU. I'm working on an NLP task using Hugging Face's AutoModelForSequenceClassification and I want to utilize my GPU for training. I'...
yts61's user avatar
  • 1,212
1 vote
1 answer
47 views

How to avoid upper limit of repetitions in loops when using float variables as iterators in GLSL?

I'm making a simple fragment shader visualizer tool with OpenGL to easily display and work with GLSL fragment shaders. I'm making it in C using GLFW. Of course, my reference is shadertoy which I think ...
LogicEu's user avatar
  • 11
-2 votes
0 answers
27 views

Google Cloud Platform: NVIDIA K80 vs NVIDIA T4 [closed]

I created an instance on GCP with NVIDIA K80 as my GPU. When I run the code it is working fine. However I was notified by GCP that NVIDIA K80 will be ending in 2024. They suggested I transfer to T4, ...
Dominique Barnes's user avatar
0 votes
0 answers
57 views

How to understand the the saying "cuda programming model does not guarantee threads in a warp..."

I read this blogtext and it said: It assumes that threads in the same warp that are once synchronized will stay synchronized until the next thread-divergent branch. Although it is often true, it is ...
spring_wind's user avatar
2 votes
0 answers
25 views
+100

Access Adreno GPU inside a Docker container

I recently bought this edge computer: https://www.thundercomm.com/product/eb5-edge-ai-box/ I has an Adreno 650 GPU. I'm using SNPE (Snap Dragon Neural Processing Engine) to run AI models on it. ...
mbenencase's user avatar
0 votes
0 answers
16 views

How to retrieve GPU utilization or similar GPU metrics on Android?

I have problem retrieving GPU utilization or similar GPU metrics. Is there a way of reading this data from application code? I tried looking for specific files from this answer (How do I know GPU ...
janezbozic's user avatar
-1 votes
1 answer
60 views

CUDA __shfl_down_sync does not work with __match_any_sync

Kernel foo's goal is to compute the sum of values that has the same id as id[0]. I checked that the mask acquired from __match_any_sync correctly identifies all other threads in the warp with the same ...
SnowSR's user avatar
  • 3
0 votes
0 answers
20 views

Get value for gpu current and max frequency in android

I am able to get gpu max frequency /sys/class/kgsl/kgsl-3d0/max_gpuclk which is 840000000 for me But when i try to get gpu current frequency from this /sys/class/kgsl/kgsl-3d0/gpuclk i get error this ...
Kunal Kalwar's user avatar
-1 votes
0 answers
40 views

Dask-Cuda running out of memory with Cupy Sobel

I have the issue of running out of memory when I try the following program with a large dataset. I think im not using the dask-cuda utils correctly... import dask.array as da import dask.distributed ...
jyt's user avatar
  • 17
0 votes
0 answers
15 views

Resource (GPU) locking across docker swarm stacks

I've got multiple instances of the same stack running on a (currently single-node) swarm. They're logically totally separate and therefore should remain different stacks. The only thing they share is ...
Johannes Bauer's user avatar
-2 votes
1 answer
155 views

Installing torch with GPU support but without downloading 3 GB of duplicated siloed CUDA libraries?

I'm trying to make CUDA containers for DNN less heavy. PyTorch goes against my efforts, as it seems to come bundled with its own siloed copy of a large subset of CUDA libraries. But what if we have ...
mirekphd's user avatar
  • 4,943
-4 votes
0 answers
39 views

Cuda is available but not recognised [closed]

CUDA is available, by running nvidia-smi command. Attached screen shot: But when running torch.cuda.is_available() it returns: UserWarning: CUDA initialization: CUDA unknown error - this may be due ...
Sherlock holmes's user avatar
-3 votes
1 answer
40 views

CUDA 11 runs out of memory when running mae_vit_* models but CUDA 10 works

I'm encountering a memory issue while trying to run the mae_vit_large_patch16_dec512d8 and mae_vit_huge_patch16_dec512d8 models from the Mae repository on GitHub. I am training on a single 112x112 ...
dimes's user avatar
  • 39
-1 votes
1 answer
60 views

In V100 GPU or A100 GPU, CUDA COREs- data movement path - where do they look first for data in Shared Memory or L1 cache

I assume in context to data fetch for CUDA core - registers are the fastest, next shared memory , then L1 cache, next L2 cache and then global memory is the slowest. I assume in a GPU data moves in ...
user2166888's user avatar
0 votes
0 answers
9 views

Microk8s gpu alloc by vram size

I have microk8s node with different type gpu. ( RTX A5000, Rtx A2000) I install nvidia-gpu-operator and it reports this node has two "nvidia.com/gpu" my labelallocatable gpu is 2 Two gpu has ...
Chaosdragon's user avatar
1 vote
1 answer
42 views

Flickering in metal rendered view (MTKView)

I'm trying to create an "infinite grid" for some kind of graphic software, similar to the one in Desmos or Geogebra. I want the view to be rendered using metal. My problem is that, although ...
Mattia Marini's user avatar
0 votes
1 answer
10 views

Different MAE values from XGBoost.regressor between a GPU and a CPU notebooks, why?

I'm looking for better XGBoost.regressor options using optune. I have one instance of the laptop running on a local computer (on the processor, my video card does not support machine learning), one on ...
Linxusr's user avatar
-3 votes
1 answer
43 views

Tensorflow Warning: TensorFlow was not built with CUDA kernel binaries compatible with compute capability 8.6

I have an old Intel Core i7 950 CPU with no AVX support, a newer NVIDIA RTX 3060 Ti GPU with compute capability 8.6, and the Windows 10 OS. Despite the default Tensorflow distribution requiring AVX ...
Thot's user avatar
  • 45
0 votes
1 answer
24 views

How to set batch size in Google Colab notebook according to allocated node specs

It is related to this question. @Vladimir Sotnikov 's answer gave insctruction to get the config information of the allocated colab node. He also showed how to get such information with pytorch and ...
jerron's user avatar
  • 301
0 votes
0 answers
98 views

Efficiently Using Hugging Face Transformers Pipelines on GPU with Large Datasets

I'm relatively new to Python and facing some performance issues while using Hugging Face Transformers for sentiment analysis on a relatively large dataset. I've created a DataFrame with 6000 rows of ...
R_Student's user avatar
  • 721
0 votes
0 answers
25 views

How to activate the use of a GPU on AWS?

I am using AWS to make some predictions using a NLP model I have trained. I activated a compute environment using: min vCPU = 0 max vCPU = 5 instance type = g4dn.xlarge I am now running my code with ...
manuela's user avatar
  • 49
0 votes
1 answer
42 views

Pytorch: torch.cuda.memory_allocated() returns 0 if PYTORCH_NO_CUDA_MEMORY_CACHING=1

There are clearly tensors allocated in my GPU memory. When I turn PYTORCH_NO_CUDA_MEMORY_CACHING enviroment variable back to 0 it works seemingly fine. Is this a bug? I've read pytorch documentation ...
harsanyidani's user avatar
-3 votes
0 answers
24 views

Failed building wheel for PyCUDA error Windows

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for PyCUDA Failed to build PyCUDA ERROR: Could not build wheels for PyCUDA, which is ...
George Gaate's user avatar
-2 votes
0 answers
20 views

volatile gpu-util is always zero during training

I just started learning about computer vision research based on deep learning methods not long. Running a 3D reconstruction model called DISN on remote server. Hoping to accelerate training by using ...
Gwyn's user avatar
  • 1
-2 votes
0 answers
41 views

TensorFlow drivers for running the CNN in GTX 1650 [closed]

I have created a CNN model using TensorFlow. My model is running well, but it shows some comments when I import the libraries. I tensorflow/tsl/cuda/cudart_stub.cc:28] Could not find cuda drivers on ...
Murali Krishna's user avatar
-1 votes
1 answer
26 views

Using CPU memory to store GPU output

I was wondering whether it could be possible to tell cupy to store the output of some calculation (carried on the GPU) directly on the CPU memory. I am currently trying to use cupy.scipy.sparse.eigsh ...
Oti Dioti's user avatar
-3 votes
0 answers
46 views

How can I iterate through a CUDA Tensor (Torch C++) using a raw pointer?

I've created a wrapper class that manages Torch Tensors, and I need to implement certain functions to make this class compatible with boost::odeint::integrate method. Specifically, I require an ...
Hermann Tamilia's user avatar
0 votes
0 answers
27 views

LightGBM Classifier faster on CPU than on GPU

I've followed instructions in official documentation of LightGBM. I followed each step and when I tried to make the speed test on both GPU and CPU I noticed that CPU computation is faster than GPU. ...
M. Merida-Floriano's user avatar
1 vote
0 answers
38 views

Getting "Error applying delegate" exception when applying GPU delegates on Android [closed]

I am getting an error on applying GPU delegates on my Samsung Galaxy S22. I have that checked that the GPU is present on the device. I have to run inferencing on Android Mobile. I have updated all the ...
James Clinton's user avatar
0 votes
0 answers
26 views

How do I correctly reference gpu-browser.js?

This might sound like a stupid question but anyways; When I try to reference the gpu-browser.js file in my html it doesn't affect my other scripts. Its as if I never put it in, when I try to do the ...
merb's user avatar
  • 33
3 votes
1 answer
172 views

GPU ran out of memory. How to invoke garbage collector for cleaning the GPU memory at each combination of hyperparameters using GridSearchCV?

I am training my model on a remote server using GridSearchCV API for tuning some hyper parameters such as epochs, l_rate, batch_size and patience. Unfortunately while tuning them, after few iterations,...
tail's user avatar
  • 347
0 votes
1 answer
68 views

GPU coherence and power consumption: does it save power to run code only on one thread per warp?

In GPU programming, one cares a lot about "coherence": threads are executed in so called "warps" (each roughly 32 threads large). All threads of a warp run in "lockstep" ...
Lukas Kalbertodt's user avatar
0 votes
1 answer
37 views

Drop in scikit-learn KMeans replacement for GPU

I was wondering what is a good drop in replacement for from sklearn.cluster import KMeans. Others online have suggested using cuML from Nvidia's RAPIDS package, but this wasn't able to compile or ...
nini2352's user avatar
-3 votes
0 answers
77 views

How to optimise this nested loop in CUDA?

I aim to improve my N-body problem where I have a nested loop for the computation of the interactions between source and target terms. In c++ this looks a lot like: #include <math.h> #include &...
Johan Valentin's user avatar
0 votes
0 answers
38 views

How to draw shader / image by data using gpu in moderngl?

So I am working on a raycasting project and first of all I need to know is how to render shader / image using GPU and moderngl on python. import moderngl def noise(size): return [(random.randint(0,...
Nikita Re's user avatar
1 vote
1 answer
26 views

Pytorch lobpcg not working with complex sparse arrays?

I am currently trying to use Pytorch "lobpcg" to diagonalize a large sparse array using my GPU. The function seems to be working just fine when diagonalizing arrays comprised of real values, ...
Oti Dioti's user avatar
1 vote
0 answers
45 views

GPU on AzureML running out of memory even with very small batch size

I'm finetuning a HuggingFace model with my own data using AzureML. The size of the dataset is 1.7 MB, and even when I've made batches of 5, I still get the same out of memory errors. The VM I ...
matsuo_basho's user avatar
  • 2,753

1
2 3 4 5
178