Questions tagged [rapids]
RAPIDS is a framework for accelerated machine learning and data science on GPUs
194
questions
0
votes
1
answer
63
views
Solving environment: failed when install RAPIDS using conda
In order to install RAPIDS, I get the command from the site below and run it, but the following error occurs.
https://docs.rapids.ai/install
conda create --solver=libmamba -n rapids-23.08 -c rapidsai -...
0
votes
0
answers
57
views
Can I run the cuML RandomForestClassifier with a sklearn MultiOutputClassifier wrapper on a dataset for a multilabel classification task?
I am currently working on an Excel datasheet where I have rows with several features for which I want to predict multiple labels.
The features are either 0 or 1 because they describe whether ...
0
votes
0
answers
19
views
Huge variance for RandomForestRegressor models
The experiment is the following:
train a RFR with a 15k train rows
get predictions on 8k test rows, save predictions as y_hat0
remove 1 random row from the training set and retrain the RFR
save ...
0
votes
1
answer
37
views
Multiple Spark Executors on single GPU
We are trying to improve the Spark Job processing performance by introducing GPUs to the nodes. But after enabling Spark3 with GPUs we are seeing downtrend in spark job performance, due to limited ...
0
votes
0
answers
35
views
Feature Selection, Outlier Removal, Target Transformer for Dask-ML pipelines
While FS, OR, TT have well-established components in "classic" scikit-learn pipelines, documentation of dask-ml and RAPIDS totally omits them.
What are the best practices to implement ...
0
votes
1
answer
319
views
RAPIDS pip installation issue
I've been trying to install RAPIDS in my Docker environment, which initially went smoothly. However, over the past one or two weeks, I've been encountering an error.
The issue seems to be that pip is ...
0
votes
1
answer
98
views
NVidia Rapids: Non-Euclidean metric in cuml UMAP
I am trying to use GPU (A100) to perform UMAP for speedup. I am facing problem as Euclidean metric does not seem to work for me at all but correlation/cosine are promising. However, the code I am ...
1
vote
1
answer
80
views
How to parallel GPU processing of Dask dataframe
I would like to use dask to parallelize the data processing for dask cudf from Jupyter notebook on multiple GPUs.
import cudf from dask.distributed
import Client, wait, get_worker, get_client
from ...
0
votes
1
answer
174
views
Why can't I install cuML on wsl?
Installing rapids and cuML is not working
I have Cuda installed (Cuda compilation tools, release 11.8, V11.8.89) in a Python 3.10.11 env in JN in VSC on wsl2 on a desktop running Windows 11, with the ...
0
votes
1
answer
30
views
Troubleshooting cudf.tokenize(): 'Length Mismatch' error with non-space delimiters
Cudf Tokenize Element Length Mismatch
This is the expected result for tokenize(' ') on space character:
0 Due
0 to
0 being
0 ...
1
vote
1
answer
50
views
NVidia Rapids filter neither works nor raises warn/errors
I am using Rapids 23.04 and trying to select reading from parquet/orc files based on select columns and rows. However, strangely the row filter is not working and I am unable to find the cause. Any ...
1
vote
1
answer
200
views
Google Colab: cannot install cudf
I need help. I am using Google Colab with Python 3.10.11 and I have a Colab with CUDA Version: 12.0 , Nvidia driver version 525.85.12 and I am following this tutorial on how to install cuDF https://...
0
votes
0
answers
46
views
RAPIDS cuML linear regression running slower than statsmodels.api equivalent?
This is my first time posting on here so my apologies if this is the wrong place to ask or if I'm missing info. Basically I have the following code for a linear regression model using statsmodels and ...
0
votes
1
answer
46
views
Rapidsai (DGA Streamz): ERROR- module dask has no attribute distributed
I have been trying to run the dga detection streamz on the rapidsai clx streamz docker container for the last few days without any resolution.I'm following the instructions on the rapids website: ...
2
votes
0
answers
56
views
how to convert 'dask_cudf' column to datetime?
How can we convert a dask_cudf column of string or nanoseconds to a datetime object? to_datetime is available in pandas and cudf. See sample data below
import pandas
import cudf
# with pandas
df = ...
0
votes
0
answers
301
views
create conda enviroment with cuml and tensorflow-gpu dependencies got error
I try to create conda env with the following environment.yml file
name: myenv
channels:
- rapidsai
- conda-forge
- nvidia
dependencies:
- python=3.10
- cudf=23.04
- cuml=23.04
- cugraph=...
0
votes
1
answer
71
views
Install older version of Rapids AI using Docker
how do I install an older version of Rapids AI using Docker such as 22.06? The newest version 23.02 doesn't work on any VAST AI (https://vast.ai/) machine.
0
votes
0
answers
88
views
Latest version of RAPIDS cuML in Kaggle notebooks
First of all, I am fairly new to running models on GPU, so sorry in advance for stupid questions.
I use RAPIDS cuML to GPU-accelerate some algorithms, but I noticed I cannot use the latest version (23....
1
vote
0
answers
93
views
dask_cudf/dask read_parquet failed with NotImplementedError: large_string
I am a new user of dask/dask_cudf.
I have a parquet files of various sizes (11GB, 2.5GB, 1.1GB), all of which failed with NotImplementedError: large_string. My dask.dataframe backend is cudf. When the ...
1
vote
0
answers
100
views
dask_cudf dataframe convert column of datetime string to column of datetime object
I am a new user of Dask and RapidsAI.
An exerpt of my data (in csv format):
Symbol,Date,Open,High,Low,Close,Volume
AADR,17-Oct-2017 09:00,57.47,58.3844,57.3645,58.3844,2094
AADR,17-Oct-2017 10:00,57....
0
votes
1
answer
60
views
Correctly zipping two columns with different data types in cuDF
I have the following DataFrame in cuDF:
Context Questions
0 Architecturally, the school has a Catholic ...
0
votes
1
answer
68
views
Using Rapids with kmeans imputation in python
I was just wondering if anyone has been able to successfully use rapids with knn imputation. I know cuml.impute was avaliable perviously but is seems like it has not been removed. If anyone has a ...
0
votes
0
answers
49
views
can I use custom tokenizer using tf-idf vectorizer in cuml library?
I have tried to make tf-idf embeddings but my corpus isn't small.
the amount I would use is about 300~500k and the max lenght of input I would set is 450.
I got to know that I can deal with large ...
1
vote
1
answer
432
views
RuntimeError: Cluster failed to start with dask LocalCudaCluster example setup
I am new to Dask and I run into problems when executing the example code:
from dask.distributed import Client
from dask_cuda import LocalCUDACluster
cluster = LocalCUDACluster()
client = Client(...
0
votes
0
answers
29
views
How to improve GPU utilization for a faster calculation?
I am a new Rapids learner. I installed a Rapids-23.02 framework with 6G GPU, and 32G RAM on ubantu . When I run a program that only uses rapids for acceleration, the GPU memories only used 3G (nvidia-...
0
votes
1
answer
113
views
How do I use RAPIDS on python if it is not working
Hi guys I am trying to acces gpu accelerated regression trees through cuml from rapids. However I can't seem to be able to download rapids as instructed> I am trying to dwonload through anaconds ...
2
votes
2
answers
2k
views
RAPIDS installation issue
I have executed the pip install commands from RAPIDS into Google Colab ipynb jupyter notebook. They are:
pip install cudf-cu11 dask-cudf-cu11 --extra-index-url=https://pypi.ngc.nvidia.com
pip install ...
0
votes
1
answer
206
views
How can I get cuML RandomForestClassifier leafs?
I'm new to cuML and I have a decision tree classifier using scikit learn. I would like to perform some hyperparameter search using the GPU, so I started looking cuML. There is no ...
1
vote
0
answers
93
views
How to run query with lists and sets in cuDF
I am using cudf (dask-cudf) to handle tens~billions of data for social media. I'm trying to use query in extracting only the relevant users from the mother data set.
However, unlike pandas, cudf's ...
0
votes
1
answer
36
views
How to save the data drawn by cuxfilter as an image
I am considering drawing a network.
For example, as shown in the demo, we can use the dashboard to get the chart, but there is no "save button" on the right side, as is often the case.
...
1
vote
2
answers
433
views
conda error on install for RAPIDS fails due to incompatible glib
OS: Linux 4.18.0-193.28.1.el8_2.x86_64
anaconda: anaconda3/2022.10
Trying to install RAPIDS, I get:
$ conda install -c rapidsai rapids
Collecting package metadata (current_repodata.json): done
...
0
votes
1
answer
266
views
Cupy config shows no cuda device
I built a docker contaiener to be deployed on HPC+GPU via singularity. when i run
cp.show_config()
OS: Linux-5.4.0-135-generic-x86_64-with-glibc2.31
Python Version: 3.9.12
CuPy Version: 9.6.0
CuPy ...
0
votes
0
answers
677
views
Docker exec container pytest fail
I am using the dev image so i can have the cuda compiler, now the issue is that when running the CI, as below I get that error, but if I build the standard container (commented line in dockerfile).
...
0
votes
1
answer
144
views
Clear all cached kernels from CuPY to force kernel compilation
In the CuPY documentation, it is stated that
"CuPy caches the kernel code sent to GPU device within the process, which reduces the kernel compilation time on further calls."
This means that ...
0
votes
1
answer
428
views
RuntimeError: CUDA error encountered, when using cuml
When I use rapids I always meet errors:
Now, I run:
from cuml.datasets.regression import make_regression
data, values = make_regression(n_samples=200000, n_features=50,
...
0
votes
0
answers
372
views
Error while importing cuml, ModuleNotFoundError: No module named 'pylibraft'
While importing the library cuml in WSL Ubuntu.
import cuml
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.8/dist-...
0
votes
0
answers
63
views
Fail to extend existing docker file - rapidsai/rapidsai - adding packages that would be installed using conda
I am trying create a new docker file, that uses existing docker file: rapidsai/rapidsai:22.04-cuda11.0-runtime-ubuntu18.04-py3.8
and install two new packages on the existing Conda environment.
What I ...
0
votes
1
answer
143
views
apache-spark GPU installation with RAPIDS
sorry i'm new to the world spark,
I should install it on a cluster that has a node with 2 nvidia AMPERE GPUs, I find written in this NVIDIA link in the Install Spark paragraph that: "note that ...
1
vote
1
answer
274
views
'Cannot convert value of type NotImplementedType to cudf scalar' appearing on trivial sort_values example in cudf 22.08, python 3.9
Apologies - I'm aware there's a similar question, however I'm new to SO, so I'm unable to comment underneath the answer.
I'm having issues with sort_values in a vanilla install of cudf as per the ...
0
votes
2
answers
103
views
cugraph create NoneType
I tried to create a Graph from a dask_cudf DataFrame, but the Graph get Nonetype without error Message. I tried it with the same data set also with a pandas dataframe. Then I tried it with three ...
0
votes
1
answer
331
views
User defined function to combine CUDF dataframe columns
As per the title, I am trying to combine the row values from different cudf.DataFrame columns. The following code works for a standard pandas.DataFrame:
import pandas as pd
data = {'a': [1], 'b': [2], ...
0
votes
1
answer
336
views
GPU vs CPU memory usage in RAPIDS
I understand that GPU and CPU have their own RAM, but what I dont understand is why the same dataframe, when loaded in pandas vs RAPIDS cuDF, have drastically different memory usage. Can somebody ...
0
votes
1
answer
83
views
Merge output from cugraph over vertex_id with input data
If I create a graph with cugraph and then calculate position from the nodes or communities, I get a dataframe with information and a vertex id.
So I have three questions:
How is the vertex id created?...
0
votes
1
answer
683
views
Installing the cuda rapids + xgboost stack through conda
I'm trying to install install the RAPIDS stack with CUDA through conda in a jupyter notebook inside an AWS Sagemaker Studio instance:
conda install -y -c conda-forge -c rapidsai-nightly -c nvidia ...
1
vote
1
answer
145
views
CUDF not reading columns properly
I'm trying to read a csv with cudf. It work nicely but when I try to get the content of the columns, it seems that cudf is not recognizing them at all. It's a very odd behavior :
Here is the code :
...
0
votes
1
answer
2k
views
RAPIDS, CUML on google colab
I'm installing RAPIDS on google colab pro but it takes a lot of time, last 2 instalations took over an hour instead of about 15 minutes as said during instalation "Starting the RAPIDS install on ...
0
votes
1
answer
341
views
Install RAPIDS on WSL2 Ubuntu 20.04 distribution in Windows 11
I followed the updated instructions, available here, to install RAPIDS on WSL2 Windows 11. As indicated in the instructions, I have not installed CUDA on the Ubuntu distribution. I copied the ...
1
vote
1
answer
451
views
Dask-cuDF to CuDF dataframe conversion
Is there any function, that convert Dask-cudf dataframe to Cudf dataframe?Like from_cudf for cudf to dask-cudf.
dgdf = dask_cudf.from_cudf(df, npartitions=2)
0
votes
2
answers
637
views
Spark RAPIDS does not load (unsupported file format error for CSV and no error for parquet )
I am using a Ubuntu 20.04.4 server with 2xNVidia A100 GPUs. Spark (3.3.0) works fine normally, but when I try to use GPUs through RAPIDS, it just keeps waiting without loading data. I tried loading ...
2
votes
1
answer
126
views
how to use rapids in colab easily
When i use rapids (cudf) in colaboratory, I execute commands as follows.But this commands usually takes about 20 minutes,so I have to wait everytime to use cudf.
https://colab.research.google.com/...