Questions tagged [rapids]

RAPIDS is a framework for accelerated machine learning and data science on GPUs

Filter by
Sorted by
Tagged with
0 votes
1 answer
63 views

Solving environment: failed when install RAPIDS using conda

In order to install RAPIDS, I get the command from the site below and run it, but the following error occurs. https://docs.rapids.ai/install conda create --solver=libmamba -n rapids-23.08 -c rapidsai -...
Tio's user avatar
  • 944
0 votes
0 answers
57 views

Can I run the cuML RandomForestClassifier with a sklearn MultiOutputClassifier wrapper on a dataset for a multilabel classification task?

I am currently working on an Excel datasheet where I have rows with several features for which I want to predict multiple labels. The features are either 0 or 1 because they describe whether ...
Shagadelic's user avatar
0 votes
0 answers
19 views

Huge variance for RandomForestRegressor models

The experiment is the following: train a RFR with a 15k train rows get predictions on 8k test rows, save predictions as y_hat0 remove 1 random row from the training set and retrain the RFR save ...
Oleg's user avatar
  • 161
0 votes
1 answer
37 views

Multiple Spark Executors on single GPU

We are trying to improve the Spark Job processing performance by introducing GPUs to the nodes. But after enabling Spark3 with GPUs we are seeing downtrend in spark job performance, due to limited ...
Manju N's user avatar
  • 896
0 votes
0 answers
35 views

Feature Selection, Outlier Removal, Target Transformer for Dask-ML pipelines

While FS, OR, TT have well-established components in "classic" scikit-learn pipelines, documentation of dask-ml and RAPIDS totally omits them. What are the best practices to implement ...
Anatoly Alekseev's user avatar
0 votes
1 answer
319 views

RAPIDS pip installation issue

I've been trying to install RAPIDS in my Docker environment, which initially went smoothly. However, over the past one or two weeks, I've been encountering an error. The issue seems to be that pip is ...
Steven's user avatar
  • 170
0 votes
1 answer
98 views

NVidia Rapids: Non-Euclidean metric in cuml UMAP

I am trying to use GPU (A100) to perform UMAP for speedup. I am facing problem as Euclidean metric does not seem to work for me at all but correlation/cosine are promising. However, the code I am ...
Quiescent's user avatar
  • 1,078
1 vote
1 answer
80 views

How to parallel GPU processing of Dask dataframe

I would like to use dask to parallelize the data processing for dask cudf from Jupyter notebook on multiple GPUs. import cudf from dask.distributed import Client, wait, get_worker, get_client from ...
mtnt's user avatar
  • 31
0 votes
1 answer
174 views

Why can't I install cuML on wsl?

Installing rapids and cuML is not working I have Cuda installed (Cuda compilation tools, release 11.8, V11.8.89) in a Python 3.10.11 env in JN in VSC on wsl2 on a desktop running Windows 11, with the ...
Stephan De Spiegeleire's user avatar
0 votes
1 answer
30 views

Troubleshooting cudf.tokenize(): 'Length Mismatch' error with non-space delimiters

Cudf Tokenize Element Length Mismatch This is the expected result for tokenize(' ') on space character: 0 Due 0 to 0 being 0 ...
Using_System's user avatar
1 vote
1 answer
50 views

NVidia Rapids filter neither works nor raises warn/errors

I am using Rapids 23.04 and trying to select reading from parquet/orc files based on select columns and rows. However, strangely the row filter is not working and I am unable to find the cause. Any ...
Quiescent's user avatar
  • 1,078
1 vote
1 answer
200 views

Google Colab: cannot install cudf

I need help. I am using Google Colab with Python 3.10.11 and I have a Colab with CUDA Version: 12.0 , Nvidia driver version 525.85.12 and I am following this tutorial on how to install cuDF https://...
Nata107's user avatar
  • 31
0 votes
0 answers
46 views

RAPIDS cuML linear regression running slower than statsmodels.api equivalent?

This is my first time posting on here so my apologies if this is the wrong place to ask or if I'm missing info. Basically I have the following code for a linear regression model using statsmodels and ...
Resh's user avatar
  • 1
0 votes
1 answer
46 views

Rapidsai (DGA Streamz): ERROR- module dask has no attribute distributed

I have been trying to run the dga detection streamz on the rapidsai clx streamz docker container for the last few days without any resolution.I'm following the instructions on the rapids website: ...
Swooz's user avatar
  • 5
2 votes
0 answers
56 views

how to convert 'dask_cudf' column to datetime?

How can we convert a dask_cudf column of string or nanoseconds to a datetime object? to_datetime is available in pandas and cudf. See sample data below import pandas import cudf # with pandas df = ...
dleal's user avatar
  • 2,244
0 votes
0 answers
301 views

create conda enviroment with cuml and tensorflow-gpu dependencies got error

I try to create conda env with the following environment.yml file name: myenv channels: - rapidsai - conda-forge - nvidia dependencies: - python=3.10 - cudf=23.04 - cuml=23.04 - cugraph=...
raymond.mh.ng's user avatar
0 votes
1 answer
71 views

Install older version of Rapids AI using Docker

how do I install an older version of Rapids AI using Docker such as 22.06? The newest version 23.02 doesn't work on any VAST AI (https://vast.ai/) machine.
user1361488's user avatar
0 votes
0 answers
88 views

Latest version of RAPIDS cuML in Kaggle notebooks

First of all, I am fairly new to running models on GPU, so sorry in advance for stupid questions. I use RAPIDS cuML to GPU-accelerate some algorithms, but I noticed I cannot use the latest version (23....
svaladou's user avatar
1 vote
0 answers
93 views

dask_cudf/dask read_parquet failed with NotImplementedError: large_string

I am a new user of dask/dask_cudf. I have a parquet files of various sizes (11GB, 2.5GB, 1.1GB), all of which failed with NotImplementedError: large_string. My dask.dataframe backend is cudf. When the ...
stucash's user avatar
  • 1,088
1 vote
0 answers
100 views

dask_cudf dataframe convert column of datetime string to column of datetime object

I am a new user of Dask and RapidsAI. An exerpt of my data (in csv format): Symbol,Date,Open,High,Low,Close,Volume AADR,17-Oct-2017 09:00,57.47,58.3844,57.3645,58.3844,2094 AADR,17-Oct-2017 10:00,57....
stucash's user avatar
  • 1,088
0 votes
1 answer
60 views

Correctly zipping two columns with different data types in cuDF

I have the following DataFrame in cuDF: Context Questions 0 Architecturally, the school has a Catholic ...
JOKKINATOR's user avatar
0 votes
1 answer
68 views

Using Rapids with kmeans imputation in python

I was just wondering if anyone has been able to successfully use rapids with knn imputation. I know cuml.impute was avaliable perviously but is seems like it has not been removed. If anyone has a ...
Omar Eweis's user avatar
0 votes
0 answers
49 views

can I use custom tokenizer using tf-idf vectorizer in cuml library?

I have tried to make tf-idf embeddings but my corpus isn't small. the amount I would use is about 300~500k and the max lenght of input I would set is 450. I got to know that I can deal with large ...
Tae-su's user avatar
  • 1
1 vote
1 answer
432 views

RuntimeError: Cluster failed to start with dask LocalCudaCluster example setup

I am new to Dask and I run into problems when executing the example code: from dask.distributed import Client from dask_cuda import LocalCUDACluster cluster = LocalCUDACluster() client = Client(...
LRyougiShikiZ's user avatar
0 votes
0 answers
29 views

How to improve GPU utilization for a faster calculation?

I am a new Rapids learner. I installed a Rapids-23.02 framework with 6G GPU, and 32G RAM on ubantu . When I run a program that only uses rapids for acceleration, the GPU memories only used 3G (nvidia-...
Sumuses's user avatar
0 votes
1 answer
113 views

How do I use RAPIDS on python if it is not working

Hi guys I am trying to acces gpu accelerated regression trees through cuml from rapids. However I can't seem to be able to download rapids as instructed> I am trying to dwonload through anaconds ...
Omar Eweis's user avatar
2 votes
2 answers
2k views

RAPIDS installation issue

I have executed the pip install commands from RAPIDS into Google Colab ipynb jupyter notebook. They are: pip install cudf-cu11 dask-cudf-cu11 --extra-index-url=https://pypi.ngc.nvidia.com pip install ...
Ric SG's user avatar
  • 23
0 votes
1 answer
206 views

How can I get cuML RandomForestClassifier leafs?

I'm new to cuML and I have a decision tree classifier using scikit learn. I would like to perform some hyperparameter search using the GPU, so I started looking cuML. There is no ...
xerac's user avatar
  • 157
1 vote
0 answers
93 views

How to run query with lists and sets in cuDF

I am using cudf (dask-cudf) to handle tens~billions of data for social media. I'm trying to use query in extracting only the relevant users from the mother data set. However, unlike pandas, cudf's ...
felntc's user avatar
  • 13
0 votes
1 answer
36 views

How to save the data drawn by cuxfilter as an image

I am considering drawing a network. For example, as shown in the demo, we can use the dashboard to get the chart, but there is no "save button" on the right side, as is often the case. ...
felntc's user avatar
  • 13
1 vote
2 answers
433 views

conda error on install for RAPIDS fails due to incompatible glib

OS: Linux 4.18.0-193.28.1.el8_2.x86_64 anaconda: anaconda3/2022.10 Trying to install RAPIDS, I get: $ conda install -c rapidsai rapids Collecting package metadata (current_repodata.json): done ...
Mark Bower's user avatar
0 votes
1 answer
266 views

Cupy config shows no cuda device

I built a docker contaiener to be deployed on HPC+GPU via singularity. when i run cp.show_config() OS: Linux-5.4.0-135-generic-x86_64-with-glibc2.31 Python Version: 3.9.12 CuPy Version: 9.6.0 CuPy ...
fabio.geraci's user avatar
0 votes
0 answers
677 views

Docker exec container pytest fail

I am using the dev image so i can have the cuda compiler, now the issue is that when running the CI, as below I get that error, but if I build the standard container (commented line in dockerfile). ...
fabio.geraci's user avatar
0 votes
1 answer
144 views

Clear all cached kernels from CuPY to force kernel compilation

In the CuPY documentation, it is stated that "CuPy caches the kernel code sent to GPU device within the process, which reduces the kernel compilation time on further calls." This means that ...
JOKKINATOR's user avatar
0 votes
1 answer
428 views

RuntimeError: CUDA error encountered, when using cuml

When I use rapids I always meet errors: Now, I run: from cuml.datasets.regression import make_regression data, values = make_regression(n_samples=200000, n_features=50, ...
Chao Li's user avatar
  • 11
0 votes
0 answers
372 views

Error while importing cuml, ModuleNotFoundError: No module named 'pylibraft'

While importing the library cuml in WSL Ubuntu. import cuml Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/usr/local/lib/python3.8/dist-...
abhipraja's user avatar
0 votes
0 answers
63 views

Fail to extend existing docker file - rapidsai/rapidsai - adding packages that would be installed using conda

I am trying create a new docker file, that uses existing docker file: rapidsai/rapidsai:22.04-cuda11.0-runtime-ubuntu18.04-py3.8 and install two new packages on the existing Conda environment. What I ...
Ilan Geffen's user avatar
0 votes
1 answer
143 views

apache-spark GPU installation with RAPIDS

sorry i'm new to the world spark, I should install it on a cluster that has a node with 2 nvidia AMPERE GPUs, I find written in this NVIDIA link in the Install Spark paragraph that: "note that ...
chpiero's user avatar
  • 41
1 vote
1 answer
274 views

'Cannot convert value of type NotImplementedType to cudf scalar' appearing on trivial sort_values example in cudf 22.08, python 3.9

Apologies - I'm aware there's a similar question, however I'm new to SO, so I'm unable to comment underneath the answer. I'm having issues with sort_values in a vanilla install of cudf as per the ...
dcgt1's user avatar
  • 33
0 votes
2 answers
103 views

cugraph create NoneType

I tried to create a Graph from a dask_cudf DataFrame, but the Graph get Nonetype without error Message. I tried it with the same data set also with a pandas dataframe. Then I tried it with three ...
padul's user avatar
  • 134
0 votes
1 answer
331 views

User defined function to combine CUDF dataframe columns

As per the title, I am trying to combine the row values from different cudf.DataFrame columns. The following code works for a standard pandas.DataFrame: import pandas as pd data = {'a': [1], 'b': [2], ...
epifanio's user avatar
  • 1,238
0 votes
1 answer
336 views

GPU vs CPU memory usage in RAPIDS

I understand that GPU and CPU have their own RAM, but what I dont understand is why the same dataframe, when loaded in pandas vs RAPIDS cuDF, have drastically different memory usage. Can somebody ...
ZooPanda's user avatar
  • 311
0 votes
1 answer
83 views

Merge output from cugraph over vertex_id with input data

If I create a graph with cugraph and then calculate position from the nodes or communities, I get a dataframe with information and a vertex id. So I have three questions: How is the vertex id created?...
padul's user avatar
  • 134
0 votes
1 answer
683 views

Installing the cuda rapids + xgboost stack through conda

I'm trying to install install the RAPIDS stack with CUDA through conda in a jupyter notebook inside an AWS Sagemaker Studio instance: conda install -y -c conda-forge -c rapidsai-nightly -c nvidia ...
alvas's user avatar
  • 116k
1 vote
1 answer
145 views

CUDF not reading columns properly

I'm trying to read a csv with cudf. It work nicely but when I try to get the content of the columns, it seems that cudf is not recognizing them at all. It's a very odd behavior : Here is the code : ...
Soufiane Fadili's user avatar
0 votes
1 answer
2k views

RAPIDS, CUML on google colab

I'm installing RAPIDS on google colab pro but it takes a lot of time, last 2 instalations took over an hour instead of about 15 minutes as said during instalation "Starting the RAPIDS install on ...
Gozdi's user avatar
  • 41
0 votes
1 answer
341 views

Install RAPIDS on WSL2 Ubuntu 20.04 distribution in Windows 11

I followed the updated instructions, available here, to install RAPIDS on WSL2 Windows 11. As indicated in the instructions, I have not installed CUDA on the Ubuntu distribution. I copied the ...
Angel's user avatar
  • 193
1 vote
1 answer
451 views

Dask-cuDF to CuDF dataframe conversion

Is there any function, that convert Dask-cudf dataframe to Cudf dataframe?Like from_cudf for cudf to dask-cudf. dgdf = dask_cudf.from_cudf(df, npartitions=2)
Nidhi Kumari's user avatar
0 votes
2 answers
637 views

Spark RAPIDS does not load (unsupported file format error for CSV and no error for parquet )

I am using a Ubuntu 20.04.4 server with 2xNVidia A100 GPUs. Spark (3.3.0) works fine normally, but when I try to use GPUs through RAPIDS, it just keeps waiting without loading data. I tried loading ...
Quiescent's user avatar
  • 1,078
2 votes
1 answer
126 views

how to use rapids in colab easily

When i use rapids (cudf) in colaboratory, I execute commands as follows.But this commands usually takes about 20 minutes,so I have to wait everytime to use cudf. https://colab.research.google.com/...
nish's user avatar
  • 29