Questions tagged [adaboost]

AdaBoost is a meta machine learning algorithm. It performs several rounds of training in which the best weak classifiers are selected. At the end of each round, the still misclassified training samples are given a higher weight, resulting in more focus on these samples during the next round of selecting a weak classifier.

adaboost
Filter by
Sorted by
Tagged with
-2 votes
0 answers
13 views

Is it possible to use adaBoosting in the core of random forest instead of bootstrap? [closed]

Random forest uses Bagging(Bootstrapping) to select the samples for each of its trees, right? Is it possible to use adaBoosting instead? What are the pros & cons? Why haven't I seen this? I saw ...
-1 votes
0 answers
12 views

Combination of Reweighing as pre-processing technique and AdaBoost

I used the pre-processing technique Reweighing to debias my dataset. The technique gives me a column with weights for each instance. For the Reweighing I used AIF 360. For the model I want to use ...
0 votes
0 answers
20 views

ada.staged_predict does not run for my specified number of trees

I am trying to test the performance of adaboost as I vary tree depths. I have it looping as i change the depth of the tress. It is then supposed to go through 300 rounds of boosting. I know this might ...
0 votes
1 answer
50 views

'AdaBoostClassifier' object has no attribute 'estimator_'

I am trying to time each round of an adaboost algorithm (how long each additional tree takes to build). I conda installed scikit-learn 1.4.0 (because on their website it says this version) and all the ...
1 vote
1 answer
52 views

Python adaBoost all predicts are same class

### my dataset import pandas as pd csv_url = 'https://raw.githubusercontent.com/ga59wig/419B/main/data.csv?token=GHSAT0AAAAAACKSAONPXCVHO2L4IGQCID72ZK3422Q' gdf = pd.read_csv(csv_url) gdf = gdf....
0 votes
1 answer
93 views

AdaBoostClassifier with algorithm='SAMME.R' requires. But I already add algorithm='SAMME.R'

from sklearn.svm import SVC from sklearn import metrics from sklearn.metrics import accuracy_score from sklearn.model_selection import train_test_split from sklearn.neighbors import ...
3 votes
3 answers
5k views

How to calculate shap values for ADABoost model?

I am running 3 different model (Random forest, Gradient Boosting, Ada Boost) and a model ensemble based on these 3 models. I managed to use SHAP for GB and RF but not for ADA with the following error:...
0 votes
0 answers
62 views

How should i speed up my AdaBoost implementation?

For I school project I've created the following AdaBoost classifier implemententation with Python: from DecisionStump import * from sklearn.base import BaseEstimator class AdaBoost(BaseEstimator): ...
0 votes
0 answers
42 views

Confusion about the code for choosing "stumps" in Adaboost algorithm

This question refers to the following step in the classical procedure of Adaboost classification. Suppose that we assign an array W and generate training points x and y (with y only taking values -1, ...
0 votes
0 answers
29 views

Estimation of error in Multiclass Adaboost gives me problems

I'm using a multiclass implementation of multiclass Adaboot by Xin Jin https://github.com/jinxin0924/multi-adaboost/tree/master I want to make use of the SAMME algorithm to solve my problem. Inside ...
0 votes
1 answer
2k views

Training sets for AdaBoost algorithm

How do you find the negative and positive training data sets of Haar features for the AdaBoost algorithm? So say you have a certain type of blob that you want to locate in an image and there are ...
0 votes
3 answers
3k views

using random forest as base classifier with adaboost

Can I use AdaBoost with random forest as a base classifier? I searched on the internet and I didn't find anyone who does it. Like in the following code; I try to run it but it takes a lot of time: ...
0 votes
1 answer
294 views

Using AdaBoostClassifier with null values

I'm trying to implement a AdaBoostClassifier model in Python. I'm using a dataset where all columns are numbers and in some cases the numbers are null. Using adaboost in R, it seams that R deals with ...
2 votes
1 answer
2k views

How to use AdaBoost on multiple different types of fitted classifiers (like SVM, Decision Tree, Neural Network, etc.)?

I'm working on a classification problem and have multiple fitted sklearn classifiers, like svm = SVC().fit(X_train, y_train) dt = tree.DecisionTreeClassifier(criterion='entropy',max_depth=4000).fit(...
0 votes
1 answer
3k views

How to get best estimator parameters using AdaBoost and GridSearchCV

I'm using AdaBoost and I'd like to see which estimator parameters work best using GridSearchCV. Is it possible to include the estimator parameters in my 'parameters' variable? For instance, how can I ...
0 votes
1 answer
784 views

How to display model parameter in Python Sklearn RandomForestRegressor

I'm comparing different ensemble models including: from sklearn.tree import DecisionTreeRegressor from sklearn.linear_model import Lasso from sklearn.ensemble import RandomForestRegressor from sklearn....
1 vote
1 answer
550 views

Adaboost vs. Gaussian Naive Bayes

I'm new to Adaboost, but have been reading about it, and it seemed like the perfect solution for a problem I've been working on. I have a data set where the classes are 'UP' and 'DOWN'. The Gaussian ...
1 vote
0 answers
88 views

What should I do in order to use LSTM as a weak learner for adaboostregressor

The specific implementation of base_estimator is not mentioned in the sklearn documentation. I want to use LSTM as base_estimator of adaboostregressor, but the way in the picture doesn't work, how can ...
-1 votes
1 answer
170 views

How can i combine xgboost with adaboost?

I have combined random forest with adaboost as clf = AdaBoostClassifier(n_estimators=10, base_estimator=RandomForestClassifier(n_estimators=10,max_depth=20)) now i want to combine adaboost with ...
5 votes
2 answers
21k views

How to use adaboost with different base estimator in scikit-learn?

I want to use adaboost with several base estimators for regression in scikit-learning, but I don't find any class that can do it. Is there any way to do this things except changing source code?
0 votes
1 answer
233 views

Adaboost: Problem with confusion matrix - `data` and `reference` should be factors with the same levels

Im new in ML and I have a problem with my confusion matrix. Unfortunatelly, I have this error (The error occurs when generating the confusion matrix.): data and reference should be factors with the ...
1 vote
0 answers
213 views

Unexpected poor performance of AdaBoost compared to Random Forest

I am working on a lithology identification project similar to the one described here. So far the Random Forest method has yielded satisfying results. I decided to compare its performance with that of ...
1 vote
2 answers
209 views

Configuration of GridSearchCV for AdaBoost and its base learner

I'm running grid search on AdaBoost with DecisionTreeClassifier as its base learner to get the best parameters for AdaBoost and DecisionTree. The search on a dataset (130000, 22) has been running for ...
0 votes
2 answers
161 views

Getting feature importances out of an Adaboosted linear regression

I have the following code: modelClf = AdaBoostRegressor(base_estimator=LinearRegression(), learning_rate=2, n_estimators=427, random_state=42) modelClf.fit(X_train, y_train) While trying to ...
1 vote
2 answers
1k views

Adaboost Sklearn Feature Importance NaN

I am building an Ada boost model with Sklearn. Last year I made the same model with the same data, and I was able to access the feature importances. This year when I build the model with the same data ...
1 vote
1 answer
698 views

How to use the 'adaboost' method to Build Classification Trees wthin the Caret and fastAdaboost Packages in R

Issue I'm attempting to use the 'adaboost' method within the Caret and fastAdaboost packages. My objective is to build a classification tree using `machine learning techniques in R for an upcoming ...
1 vote
1 answer
247 views

Why does AdaBoost or GradientBoosting ensemble with a single estimator give different values than the single estimator?

I'm curious why a single-estimator Adaboost "ensemble", a single-estimator Gradient Boosted "ensemble" and a single decision tree give different values. The code below compares ...
3 votes
1 answer
2k views

unable to use Adaboost with R's caret package

I'm using R's caret package for implementing adaboost technique. But I'm getting an error while executing it. > str(my_data) 'data.frame': 3885 obs. of 10 variables: $ Date : Factor w/ 12 ...
0 votes
1 answer
51 views

How Adaboost and decision tree features importances differ?

I have a multiclass classification problem and I extracted features importances based on impurity decrease. I compared a decision tree and AdaBoost classifiers and I ovserved that there is a feature ...
0 votes
1 answer
175 views

How to increase the weight of observation in boosting regression

How to increase the weight of observation in boosting regression, like for boosting classification, you could add more weights to the observations who predict wrong but for boosting regression, how ...
1 vote
2 answers
681 views

How to perform incremental training of large data set using (scikit) Adaboost classifier?

I have a large size of the training dataset, so in order to fit it into the AdaBoost classifier, I would like to do incremental training. Like in xgb we have a parameter called xgb_model to use the ...
0 votes
0 answers
174 views

AdaBoostClassifier feature_importances_ parameter returns nan

I have mixed data features (3 continuous, 2 binomial, and 3 ordinal categorial) and the binomial (1,0) target. I have label-encoded the ordinal categorical features (e.g. instead of very low/low/...
1 vote
1 answer
85 views

(matlab) how to load adaboost model so that coder compatible?

I save my adaboot model as .mat file. I use this to load the model: load('adaboost_23.mat') But matlab coder cannot generate C/C++ code. So I change to: coder.load('adaboost_23.mat') Still not ...
19 votes
3 answers
19k views

AdaBoostClassifier with different base learners

I am trying to use AdaBoostClassifier with a base learner other than DecisionTree. I have tried SVM and KNeighborsClassifier but I get errors. What are the classifiers that can be used with ...
-2 votes
1 answer
107 views

Improving Machine learning model for trading and trend prediction [closed]

I am working on making predictions and decisions based on stocks and crypto data. First I implemented a decision tree model and I had Model Accuracy: 0.5. After that I did some research and found out ...
0 votes
1 answer
34 views

Search and Push n elements into custom_arr from x_arr where condition with y_arr

Sorry if the title is a bit confusing, I don't know how else can I make this question more specific. I am trying to create an Adaboost implementation in Python, I am using the MNIST from Keras ...
3 votes
3 answers
2k views

How to interpret (unexpected) values of sklearn.tree.tree_tree.value attribute?

The values of the value attribute corresponding to the decision tree classifier stubs being used with an AdaBoostClassifier are not matching expectations and I can not determine what the values are ...
0 votes
1 answer
508 views

No difference between Logistic Regression model and Ensemble models (Bagging and Boosting)

I was trying to compare a logistic regression model and some ensemble models (bagging and boosting) with logistic regression as their base estimator. But, surprisingly, I got the same score for all ...
1 vote
0 answers
80 views

R: adaboost (JOUSBoost package) giving 'Not compatible with requested type'

I have the classic titanic data. Here is the description of the cleaned data. > str(titanic) 'data.frame': 887 obs. of 7 variables: $ Survived : Factor w/ 2 levels "No",&...
0 votes
2 answers
8k views

AttributeError: 'str' object has no attribute 'fit'

Hi I want to use a simple AdaBoostClassifier on the mushroom dataset which lools smth. like: target cap-shape cap-surface cap-color bruises odor \ 3059 0 2 3 ...
0 votes
1 answer
138 views

Hyperparameter tuning; what parameter space for ML algorithms (rf, adaboost, xgboost)

Im trying to tune the hyperparameters of several ML algorithms (rf, adaboost and xgboost) to train a model with a multiclass classification variable as target. Im working with the MLR package in R. ...
1 vote
1 answer
416 views

AdaBoost algorithm Hyperparameter Tuning MLR

Im trying to tune the hyperparameters of the AdaBoost algorithm. The goal is to train a model with a multiclass classification variable as target. Im working with the MLR package in R. However, MLR ...
0 votes
0 answers
28 views

Use Adaboost with random forest base classifiers? [duplicate]

Does anyone know whether one could use Adaboost with random forest base classifiers? I searched the web to learn more about this, but most webpages provided comparisons of the two as ensemble learning ...
0 votes
1 answer
679 views

How to use a Keras model inside of sklearn's AdaBoost?

I have a Keras model and want to boost it using sklearn's AdaBootClassifier. Unfortunately I get the following error message and have no idea how to solve it. I would be very happy about any help! ...
0 votes
2 answers
834 views

unable to pass check_estimator()

I was trying to write AdaBoostClassifier by myself and wanna make it scikit-learn compatible. However, my estimator can't pass check_estimator(). I've checked my code and the classifier works very ...
15 votes
2 answers
22k views

Weak Classifier

I am trying to implement an application that uses AdaBoost algorithm. I know that AdaBoost uses set of weak classifiers, but I don't know what these weak classifiers are. Can you explain it to me with ...
32 votes
2 answers
52k views

Using GridSearchCV with AdaBoost and DecisionTreeClassifier

I am attempting to tune an AdaBoost Classifier ("ABT") using a DecisionTreeClassifier ("DTC") as the base_estimator. I would like to tune both ABT and DTC parameters simultaneously, but am not sure ...
3 votes
2 answers
2k views

Execution time of AdaBoost with SVM base classifier

I just made a Adaboost Classifier with these parameters, 1.n_estimators = 50 2.base_estimator = svc (support vector classifier) 3.learning_rate = 1 here is my code: from sklearn.ensemble import ...
2 votes
2 answers
246 views

Why's there a difference in prediction result between AdaBoost with n_estimators=1 that uses SVC as a base estimator, and just SVC

I am currently using daily financial data to fit my SVM and AdaBoost. To check my result, I tried AdaBoost with n_estimators=1 so that it would return same result as I just run a single SVM. from ...
0 votes
0 answers
37 views

How to extract AdaBoosts outputs that have made the classifiers decision?

I am using AdaBoost in scikit-learn to separate some signal and background data. From my understanding of AdaBoost at the end of each iteration each data item is assigned +1 for signal and -1 for ...

1
2 3 4 5 6