Questions tagged [vowpalwabbit]
Vowpal Wabbit is a highly scalable, open source, online machine learning software written in C++. It supports, amongst other features, classification, regression, matrix-factorization, multiple loss functions, multiple update strategies, and regularization.
294
questions
0
votes
0
answers
12
views
How do I get the "platform specific library" for vowpal wabbit installation onto java.library.path for MacOS? Where is 'libvw_jni.dylib'?
I'm following the instructions here. I am trying to compile code locally on my ARM Mac.
The instructions say:
This wrapper requires that the vw_jni platform specific library is installed on your java....
-1
votes
0
answers
22
views
zsh: command not found: vw macOS Monterey
I built vw from source as mentioned in the official repository on MacOS Monterey.
https://github.com/VowpalWabbit/vowpal_wabbit/wiki/Building
Cloned it to my home directory.
Used vcpkg and CMake ...
0
votes
0
answers
61
views
Intuition behind action predicted by Contextual Bandit on Training dataset
Doing the Contextual Bandit tutorial https://vowpalwabbit.org/docs/vowpal_wabbit/python/latest/tutorials/python_Contextual_bandits_and_Vowpal_Wabbit.html I wanted to try what would the predicted ...
0
votes
1
answer
136
views
Could NOT find Boost (missing: python37) (found version "1.80.0")
Not able to install vowpalwabbit on Apple M1 MacBook Pro with Python 3.7.16. Getting the following error instead. I have tried the following but was not able to import the package successfully.
...
0
votes
0
answers
39
views
Vowpal wabbit - Model's output distribution (for action set) is same for all epsilon values [0.2, 0.5, 0.9] when using --cb_explore -- epsilon <val>
I am trying to run epsilon-greedy contextual bandit for my problem.
Contextual_model = vowpalwabbit.Workspace("--cb_explore 29 --epsilon 0.2 ")
I am able to train the model successfully.
...
0
votes
1
answer
15
views
How the losses are being computed for CATS algorithm
I am struggling when trying to compute the losses when using CATS algorithm in VowpalWabit library.
Does anyone knows how it is computed (the average and the last)
I tried to calculate the average of ...
1
vote
1
answer
213
views
Vowpal Wabbit Contextual Bandit correct usage
I am currently using the Vowpal Wabbit package in order to simulate a Contextual Bandit. I had a couple of questions regarding the usage of the library:
I have multiple contexts/categories where the ...
-1
votes
1
answer
114
views
VowpalWabbit Contextual wabbit generating just single action irrespective of context
I am using vowpalwabbit in contextual bandit settings. But I am struck with a strange issue where vowpalwabbit just generating same PMF irrespective of context. Ideally it should generate different ...
0
votes
0
answers
61
views
Vowpal Wabbit C API getting 0 as prediction
I want to make a C program that loads a trained vw model and returns predictions in real time. For this, I am using libvw_c_wrapper and using methods described here.
The model was trained and saved ...
0
votes
0
answers
34
views
Vowpal Wabbit: "number of examples" in logs instead of "number of examples per pass"
I have ran VW twice with exact same parameters, but differently ordered data. The logs for both show slightly different average loss and the two models perform very differently on the test set. One ...
0
votes
1
answer
110
views
how to print a vowpal wabbit regression model in contextual bandits setting
I am using vowpal wabbit for contextual bandit problem, in python.
Vowpal wabbit has a prediction model that uses the doubly robust method to build a regression model to predict the cost for different ...
2
votes
0
answers
116
views
Warm start a conditional contextual bandit (Vowpal Wabbit)
I am currently building a contextual bandit.
Since I neet to get the top 4 actions I am using the conditional contextual bandit in the Vowpal Wabbit framework.
I like to warm start my model but as far ...
1
vote
0
answers
148
views
How to handle huge imbalance with rewards in contextual bandits in vowpal wabbit
I am using vowpal wabbit to train and learn a contextual bandit algorithm. My use case is for email marketing, learning which email variants perform better. Since the email reward proportion will be ...
0
votes
1
answer
118
views
How to do warm start and use vowpal wabbit for contextual bandits
I wanted to implement contextual bandits in vowpal wabbit. I wanted to use it for an email campaign (new) which have 5 different variants of emails.
I have historical data of the past email campaigns (...
1
vote
1
answer
172
views
In contextual bandit for Vowpal wabbit, does the --cb_explore option includes training an optimum predictor (--cb option) as well?
When using Vowpal wabbit for contextual bandits, here is my understanding so far,
We can build a predictor model for predicting the rewards
We can also then use an exploration strategy to choose ...
0
votes
1
answer
66
views
vowpal wabbit java: get raw predictions
I am using Java API of vowpal wabbit to get predictions. I need raw prediction (same as -r output.txt) but I couldn't find any such method in VWMulticlassLearner class. I am using below arg to train ...
0
votes
0
answers
92
views
Vowpal Wabbit - Slates (Combinatorial Bandit) with semi feedback
We are evaluating to use Vowpal Wabbit for our recommender system. We want to show different image (combinatorial) and see with which the user interacts.
Going through the documentation, Vowpal Wabbit ...
1
vote
1
answer
85
views
Will learning_rate be automatically adjusted using "adaptive" strategy for VowpalWabbit Python online learning?
I see that the documentation at VowpalWabbit command-line has mentioned about --adaptive learning rate strategy as the default. I am not using the command line utility to train, i.e: passing the whole ...
0
votes
1
answer
98
views
Vowpal Wabbit negative weights significance
I'm doing a feature study and I was wondering what the negative feature weights in the audit output signify. I'm currently using the contextual bandits function with the following parameters:
from vw....
1
vote
0
answers
66
views
How to split dataset (that's been already fromatted into vowpal wabbit input format ) into train and test set?
I'm doing a program which predicts rating of a movie based on its title, year, director, actor and budget. I've web-scraped info about 990 movies from a page and decided to try vowpal wabbit. I've ...
0
votes
2
answers
755
views
Issue with numpy dependency when building docker image
I am trying to create a Sagemaker endpoint for model inference using the Build your own algorithm container (https://sagemaker-examples.readthedocs.io/en/latest/advanced_functionality/...
-1
votes
1
answer
65
views
Custom loss for vowpal wabbit
Vowpal Wabbit currently offers 5 losses... I was looking to implement a new loss that match my problem. How one could do that ? How one could do that using the python (pyvw) wrapper ?
1
vote
1
answer
197
views
Can contextual bandit rewards be changed over time?
I am working on implementing a contextual bandit with Vowpal Wabbit for dynamic pricing where arms represent price margins. The cost/reward is determined by taking price – expected cost. Cost is not ...
0
votes
1
answer
286
views
How to understand the slots in the vw.format - Vowpal Wabbit Conditional Contextual Bandit
I am trying to build a contextual bandit. Since I like to rank the actions, I want to switch to an conditional contextual bandit (as I have read here).
But now I have trouble understanding the new vw ...
0
votes
3
answers
131
views
Issue saving Vowpal Wabbit model to S3
I'm trying to save a learned VW model using the Python wrapper to an S3 bucket but am getting a Runtime Error.
Code is:
# directory
model_dir_test = f"s3://{bucket}/{model_dir}"
# model
vw =...
0
votes
1
answer
39
views
VowpalWabbit - how to set third order interactions only for categorical features for tabular data with both continues and categorical features
for VowpalWabbit - how to set third order interactions only for categorical features for tabular data with both continues and categorical features , for example how to change : vw_squared = ...
1
vote
1
answer
259
views
How to properly train batch-wise in VowpalWabbit?
We are trying to train a VowpalWabbit (VW) model in an online-fashion. However, due to our system architecture and needs to scale, we have to train batch-wise and cannot do an online-update each time ...
0
votes
1
answer
167
views
numerical training data format of contextual bandit in Vowpal Wabbit
I have plan to use contextual bandit of Vowpal Wabbit(VW) for building the recommend system.
I have M(26 in this case) dimensional numerical feature of N users, and have the feedback logs that ...
0
votes
1
answer
268
views
Proper way to evaluate policy + exploration offline in Vowlpal Wabbit
My use case is to retrain/make predictions using VW CB in batch mode (retrain/inference occurs nightly).
I'm reading this tutorial for offline policy evaluation in the batch scenario. I'm training on ...
0
votes
1
answer
65
views
How to limit possible arm recommendations to a subset of items?
I have the following scenario:
There is a universe of items to recommend [i1....iN] where N is quite large (say 1 million).
There are categories [c1...cK]. Each category consists of a subset of the ...
0
votes
1
answer
278
views
Optimizing CTR (click through rate) with VowpalWabbit: How to choose suitable parameters?
I am trying to optimize the click rate of some article or advertisement (action) given a device type (context) with VowpalWabbit (following this article vw tutorial). However, I am not able to make it ...
0
votes
1
answer
170
views
How does cb_adf algorithm know a new action is available in the data if no feature is associated with arms?
From the documentations I have read, cb_adf format multiline data is suitable for scenarios where number of actions are changing over time. My questions is, how does the algorithm know if a new action ...
0
votes
1
answer
561
views
Saving and Loading a Vowpal Wabbit model in python with --safe_resume --cb_explore
I would like to do online training with a contextual Vowpal Wabbit model, so I need to save and reload frequently. However, whenever I try to reload a model (which was initialized with --save_resume), ...
0
votes
2
answers
139
views
Failed to run vowpal wabbit contextual bandit in daemon mode
I am trying to stream my data to vw in --daemon mode. Right now I'm using just a toy example.
For some reasons I failed to use any of strategies that VW has (epsilon, bag, first). I always get an ...
1
vote
1
answer
611
views
Confusion with Vowpal Wabbit Contextual Bandit training data formatting
I am new to Vowpal Wabbit and am working on a multi-arm bandit model to recommend different CTAs for sign up pop ups. I already completed the walkthrough on the main site but am a bit confuse on what ...
-2
votes
1
answer
149
views
Issues running basic Vowpal Wabbit
I am new to Vowpal Wabbit. I already build a base Multi-Arm Bandit model but I want to try using the VW Contextual Bandit, but am having issues with the command line arguments.
I am a little confused ...
4
votes
1
answer
444
views
Using Softmax Explorer (--cb_explore_adf) for Ranking in VowpalWabbit
I am trying to use VW to perform ranking using the contextual bandit framework, specifically using --cb_explore_adf --softmax --lambda X. The choice of softmax is because, according to VW's docs: &...
0
votes
0
answers
245
views
Vowpal Wabbit - badly formatted example, only one line can have a cost (Contextual Bandits)
I am new to Vowpal Wabbit. I have successfully tested a VW agent/learner for a small subset of data from a DataFrame (~20 rows). But when I increase the dataset to 2000 rows, I get a formatting error?
...
0
votes
1
answer
125
views
How to transform the action Dependent Feature (ADF) from categorical to continuos/discrete?
I am following the Vowpalwabbit tutorial on contextual MABs using cb_explore_adf and I was wondering how to transform the actions namespace feature into numeric so it could generialize better for a ...
0
votes
1
answer
59
views
Using VW to add noise to reward distribution
I want to add noise to the reward distribution I have.
In what format should the reward distribution be represented for VW to understand and
what methods are available in VW to induce the noise?
For ...
0
votes
2
answers
62
views
Using VowpalWabbit's hypersearch always output the same results
I was trying to use VW's hypersearch script for hyperparameter optimization. However, I noticed that regardless of what parameters I was trying to optimize, results were always the same:
vw-...
1
vote
1
answer
80
views
Can LDAvis analyse the results of vowpal_wabbit LDA?
LDAvis provides a excellent way of visualsing and exploring topic models. LDAvis requires 5 parameters:
phi (matrix with dimensions number of terms times number of topics)
theta (matrix with ...
0
votes
1
answer
138
views
Algorithms for Contextual Bandits (a.k.a. where is UCB?)
Hello and let me start by saying I haven't really worked with contextual bandits before; I've worked a lot with multi-armed bandits, as well as with Monte-Carlo Tree Search. Anyway, I'm used to using ...
0
votes
1
answer
98
views
Is learning rate automatically decreased between passes when vw LDA is run with `--save_resume`
vowpal wabbit (vw) supports out-of-core learning with --save_resume. This is what the --help options tells the end user about the --save_resume option:
--save_resume save extra ...
1
vote
2
answers
579
views
How to convert CSV columns into Vowpal Wabbit txt input file
I am trying to convert csv (with 10 columns) to vowpal wabbit input format txt file. Some csv columns has integer values and some have strings (like: com.12346.xyz). For example if my csv columns look ...
0
votes
1
answer
175
views
What is Vowpal Wabbit’s default learner for CMAB Framework?
I’m checking Vowpal Wabbit’s documentation for how it’s actually learning. Traditional Contextual Bandits learn by having F(context, action) = Reward, find action that maximizes Reward, and returns ...
0
votes
1
answer
93
views
Confusing cb results with ips cb_type
Is cb_type ips expected to be much better than dm or dr?
I wrote the script here (results included) https://gist.github.com/travisbrady/546b40a0ed328d8f83dbc6230ee83fec using the personalization ...
0
votes
1
answer
63
views
Cant install Vowpal Wabbit on Mac
I am trying to install Vowpal Wabbit via pipenv install. But failed with the following error.
ERROR: Command errored out with exit status 1: /Users/johnchan/.local/share/virtualenvs/ATEC-s3CStNz5/bin/...
2
votes
1
answer
87
views
unexpected predictions behavior using VW cover
I am using vowpalwabbit for a contextual bandit problem. I want to use the cover option as explained here.
I am facing 2 issues with this:
once the learning phase is over and I use the vw model to ...
0
votes
1
answer
152
views
Is it possible to run Vowpal Wabbit daemon with file socket instead of using a port?
Official VW documentation has an example of how to run Vowpal Wabbit in daemon mode.
https://github.com/VowpalWabbit/vowpal_wabbit/wiki/Daemon-example
But it seems that VW always binds a particular ...