Questions tagged [catboost]
CatBoost is an open-source gradient boosting on decision trees library with categorical features support out of the box for Python, R
359
questions
0
votes
0
answers
18
views
catboost java prediction slow at high scale
I am trying to use catboost java API but facing high latency issues at a large scale. I currently run a high-scale multi-threaded system with around 300+ worker threads that query the catboost model ...
0
votes
0
answers
17
views
Polynomialize dataset for selected columns of pd.Dataframe
I am new to regression concepts. I have a dataset which has a text column
I am using CatboostRegressor to regress the transaction time based on the other 3 features
Ticket text
Created Hour (Between ...
2
votes
1
answer
49
views
Using weigths in model for unbalanced data
I'd like to know if you have any way to control catboost weights in the function of unbalanced sample size. In my case I have a dataset of 2 areas "a" and "b"(x_categorical_1), ...
0
votes
0
answers
13
views
Find out if Catboost regression works well for Time estimation
I have a use case to predict the estimated time of resolution for my IT ticketing data that has the below features
Ticket title and description in text format
Created hour (ETR would be lesser for ...
0
votes
0
answers
4
views
sample_weight parameter with select_features method of CatboostRegressor
I am trying to use select_features from CatboostRegressor but I am getting an error that it does not support the sample_weight parameter. I need this to input exposures/offset for a Poisson loss model....
0
votes
0
answers
14
views
Understanding the output of plot_tree in catboost
a = catboost.plot_tree(tree_idx = 100, pool = test_pool)
a.render()
I am trying to visualise the trees created by catboost model.
But I am unable to understand the output being rendered.
For eg: The ...
0
votes
0
answers
8
views
Error using catboost-spark recommended quickstart (CatBoostClassifier.fit() got an unexpected keyword argument 'eval_set')
I've been trying to set up Catboost to work with Pyspark in a Colab notebook (specifically a Kaggle integrated notebook).
As a starting point I've pip installed pyspark 3.1 and copied the "Binary ...
0
votes
1
answer
958
views
AttributeError: cython_sources [duplicate]
I am using:
python: 3.12
OS: Windows 11 Home
I tried to install catboost==1.2.2
I am getting this error:
C:\Windows\System32>py -3 -m pip install catboost==1.2.2
Collecting catboost==1.2.2
...
-1
votes
0
answers
12
views
Non Symmetric XGBoost, Tennis Match Predictions
I'm developing an algorithm to predict the outcomes of tennis matches, focusing on player matchups. The core of my model is an XGBoost classifier. I've encountered a puzzling issue in the predictions ...
0
votes
0
answers
8
views
Non Symmetric XGBoost – Tennis Match Predictions
I'm working on developing an algorithm to predict the outcomes of tennis matches, focusing on player matchups. The core of my model is an XGBoost classifier. I've encountered a puzzling issue in the ...
0
votes
1
answer
41
views
Catboost runs correctly on onnx but does not work on OpenVINO
I tried to implement on OpenVINO a Catboost implemented by me, before I had to transform the Catboost to ONNX, I used the code found at the following link: https://catboost.ai/en/docs/concepts/apply-...
0
votes
0
answers
38
views
Catboost hyperparameter tuning with mlflow
Hi I'm triying to hyperparameter tune a catboost binary classification model and to store the logs metrics and experiments with mlflow but I keep getting the following error. This is the code
...
1
vote
0
answers
72
views
Python catboost custom loss function
I know that there is built-in Poisson loss function in catboost. I want to try to reproduce it. I used the tutorial example https://github.com/catboost/catboost/blob/...
0
votes
0
answers
40
views
How to create custom loss function in catboost?
I want to optimize SMAPE in my catboost model. When I pass the parameter loss_function = 'SMAPE' I get an error.
CatBoostError: Invalid loss_function='SMAPE': for regressor use RMSE, MultiRMSE, ...
1
vote
0
answers
120
views
I downloaded Python 3.12, but I'm unable to install CatBoost and Jieba using pip [duplicate]
I've tried running the following commands:
pip install catboost
pip install jieba
However, both of these commands return an error. Can someone please assist me in resolving this installation issue ...
0
votes
0
answers
96
views
SHAP is not working with CatBoost categorical features
I encountered a problem with categorical features while training the CatBoost model.
CatBoostError: Bad value for num_feature[non_default_doc_idx=0,feature_idx=23]="100+ доступны после заявки на ...
0
votes
0
answers
55
views
How to get PFound metric score with YetiRank loss in CatBoost Ranker for Optuna?
I train CatBoost Ranker in Optuna with YetiRank and want to optimize Pfound. If I write params such way (as on 1 screen) and then I want to pull out the metric after fitting - I try to use ranker....
0
votes
1
answer
71
views
How does CatBoost perform multiclass classification?
I am trying to figure out how CatBoost performs multiclass classification with MultiClass loss function. As I understand it, for each prediction MultiClass requires M values for each of M classes. My ...
0
votes
0
answers
66
views
Training Biased/Uneven Categorical Data with CatBoost, Unbalanced/Unseen Categories Handling
Summary:
I am training a discount eligibility model where the dataset represents historical data for products where people availed discounts based on simple features like product category, discount ...
0
votes
0
answers
33
views
How to obtain a dataframe of trees from a CatBoost model similar to XGBoost's model.get_booster().trees_to_dataframe()
I'm working with CatBoost and I need to extract information about the trees generated by a trained CatBoost model in the form of a dataframe, similar to how it can be done with XGBoost using model....
-1
votes
1
answer
70
views
transform a non callable function into a callable function
To explain: I use optuna on 5 classifier who are store in a dictionnary.
To select one model, I use this:
models={"CatBoostClassifier":CatBoostClassifier,"DecisionTreeClassifier":...
0
votes
0
answers
559
views
ERROR while using " pip install catboost " : Failed building wheel for catboost
I'm trying to install the catboost package through a requirements.txt file in my virtual environment, but while building the wheel for catboost (pyproject.toml), an error occurs.
Environment:
Python: ...
-1
votes
1
answer
58
views
What is the order in catboost's select_features mean?
I came across Catboost's select_features function that uses RFE. Is the order of eliminated features represent the order in which features were removed? Or, is it random?
https://catboost.ai/en/docs/...
0
votes
0
answers
83
views
Save Catboost model in Python and load in Spark
I have a use-case where model training is a Python process.
The model is a Catboost Regressor with categorical features.
In general, language agnostic model binary formats like ONNX and PMML work well ...
0
votes
1
answer
59
views
ML Classification for categorical data
I came across a problem that needed programming a ML model for classification between 2 classes. Now the problems we faced are mentioned below in points:
Data points for Class A were somewhere around ...
0
votes
0
answers
66
views
CatBoost Grid Search usage with SMOTE and get_dummies
I try to use the grid_search method from catboost library to pick the best parameters and do a cross validation, but for some reason it doesn't work well - roc_auc_score is awful and confusion matrix ...
1
vote
1
answer
97
views
Not able to install catboost version 1.0.4 using conda
I was using catboost v1.0.4 in a Conda environment. Recently, I had to recreate the environment, then it is showing the folllowing error.
Error with conda install
PackagesNotFoundError: The following ...
1
vote
0
answers
221
views
Unable to draw in jupyter notebook
I am using the catboost model for training, using
model. fit (train_pool, eval_set=val_pool, early_stopping_rounds=150, plot=True)'
, but in jupyternotebook
Open Browser Console for more detailed log ...
0
votes
0
answers
27
views
hyper parameter of loocv - performance reduce
I Try to hyper parameter tuning over my model , I have small dataset thus the basic model is evaluatred by LOOCV. for better performance I want to hyper parameter tune the model thus I did the next ...
0
votes
0
answers
69
views
Catboost Missing Values Processing
According to catboost docs (python package), the algorithm handles numerical missing features in training by inputting the minimal value for the feature. But is does not mention if the same is true in ...
0
votes
0
answers
44
views
Combine time series data as input for CatBoost/XGboost
I have time series data in a pandas dataframe. This is not only one time series data but different ones depending on the ID. I want to now train a CatBoost model with a rolling window approach. ...
0
votes
0
answers
102
views
CatBoostRegressor with loss_function='Lq'
I am not sure how to specify the "q" variable in the "Lq" loss function. I receive the following error message:
CatBoostError: /src/catboost/catboost/private/libs/options/...
0
votes
2
answers
62
views
Understanding the Substantial Performance Discrepancy between Stratified K-Fold Cross Validation and No Cross Validation in my Prediction
: I have developed two versions of my code where one incorporates stratified k-fold cross validation, while the other lacks any form of cross validation. To my surprise, the results achieved using ...
0
votes
0
answers
66
views
Overcoming the 'not implemented yet' error when combining model shrinkage with learning continuation in CatBoost
First of all, thanks to the people that worked on the catboost library, it's amazing!
I am researching the combination of learning continuation, posterior sampling and model shrinkage in gradient ...
0
votes
1
answer
41
views
How can to access the CTR values in Catboost?
When using Catboost on data with a categorical variable, CTR values are calculated during training for each value of this categorical feature. These values are then used to determine paths through ...
0
votes
0
answers
18
views
My Telegram bot throws an error when working with my model
I was able to connect a model trained on Catboost with my bot, but when I enter data for analysis, an error pops up.
raise CatBoostError("Invalid {}[{}] = {} value: index must be < {}."....
0
votes
0
answers
13
views
Implementing a non continuous loss function
I am trying to implement a custom loss function with the following reasoning:
If the predicted value is higher then the target then the loss ther difference
If the predicted value is lower than the ...
0
votes
1
answer
273
views
Interpreting SHAP summary plots
I am working on an attrition model. I have multiple categorical features with high cardinality. Hence I attempted Catboost and LightGBM for it.
I am also finding the SHAP plots for both. Following are ...
0
votes
0
answers
124
views
How to get predictions using cross-validation with catboost?
I'm looking at documentation
https://catboost.ai/en/docs/concepts/python-reference_cv
the function returns scores (metrics) and can return models (using return_models), but how to get predictions for ...
0
votes
0
answers
113
views
CatBoost and LightGBM: training a classifier with weights
I am training a (binary) classifier with sample weights. The distribution of the weights is skewed. While half of the training samples have weight 1, the other half has weights greater than 1 (300 - ...
0
votes
0
answers
58
views
Catboost iteration results meaning
I am fitting CatBoostClassifier like this:
clf = CatBoostClassifier(cat_features=cols_cat, random_seed=11, verbose=50)
clf.fit(X_train, y_train)
Learning rate set to 0.132799
0: learn: 0.5495892 ...
1
vote
1
answer
234
views
Is it possible to get feature importance in CatBoost for a prediction
I want to know the feature importance for a particular prediction made by the CatBoost model. I know we can get feature importance at the data set level but I want to see if we can do so at each ...
0
votes
1
answer
402
views
Visualizing Catboost plot_tree in Python
I'm trying to visualize my Catboost model in Python with the code:
model_CBC.plot_tree(tree_idx=0, pool=pool)
plt.show()
I am getting the output of the rest of the code but I cannot see any tree. ...
1
vote
1
answer
381
views
Why are the SHAP values of a feature with mostly invalid values all positive?
I have a CatboostRanker (with groups) model trained on a dataset of ~1m rows of ~300 features. Three such features are ~90% invalid (have a special category denoting such). My data is time series ...
0
votes
1
answer
385
views
Custom metric for a CatBoost classifier using GPU & optuna
I have the following objective function to run in an Optuna hyper parameter optimization:
def objective(trial, data=data):
num_train_pool = data["num_train_pool"]
num_test_pool = ...
0
votes
1
answer
59
views
In ClickHouse, catboostEvaluate method for catboost classification model returning values like regression models
I'm using catboostEvaluate method to predict a classification problem.
In Catboost, the evaluation result is like this:
model.predict(X_validation)
array([0, 0, 0, ..., 1, 0, 0])
However, in ...
0
votes
0
answers
153
views
CatBoostError: Bad value for num_feature
I have code:
from sklearn.model_selection import KFold, cross_val_predict
from catboost import Pool, CatBoostRegressor, cv
from sklearn.metrics import mean_squared_error
import matplotlib.pyplot as ...
0
votes
1
answer
221
views
How to correctly save a CatBoost to Google Cloud Storage in Python
How do I save a trained CatBoost model to Google Cloud Storage?
I have the following CatBoost model training code:
bst_model = _get_catboost_classifier(setting)
bst_model.fit(train_x, train_y,...
0
votes
0
answers
73
views
What is the purpose of showing the learning rate for CatBoost?
I'm using a multiclass classifier CatBoost model for the first time. When I fit my CatBoost model, it goes through multiple iterations (1000 in this case) each with its own learning rate. However, ...
1
vote
1
answer
110
views
deploy catboost model shinyapps.io
I have a shiny app that I'm trying to deploy on the https://shinyapps.io page, however the app uses the catboost package. Which can be installed in R as indicated in https://catboost.ai/en/docs/...