Questions tagged [fairlearn]
A community-driven open source project and Python package to assess and improve fairness of machine learning models.
10
questions
1
vote
1
answer
61
views
Sensitive feature in Fairlearn
I am using the Fairlearn functions similar to this:
eor = fairlearn.metrics.equalized_odds_ratio(y_true, y_pred, sensitive_features=sensitive_feature)
dpd = fairlearn.metrics....
1
vote
1
answer
60
views
Mitigation for imblearn pipelines
I'm trying to mitigate unfairness for a model I trained using an imblearn pipeline with ADASYN. My pipeline looks like this:
loaded_model = Pipeline(steps=[('feature_scaler', StandardScaler()),
...
1
vote
0
answers
60
views
'GridSearchCV' object has no attribute 'cv_results_' when fitting ExponentiatedGradient from fairlearn
The GridSearchCV is passed to ExponentiatedGradient. But after fitting the ExponentiatedGradient, cv_results_ are not returned.
gs = GridSearchCV(
estimator=model,
...
1
vote
1
answer
214
views
Regularizing the constraints in fairlearn's ThresholdOptimizer
Is there a way to have a lambda regularizer value on the constraints in the ThresholdOptimizer? For instance if we want to create accuracy vs SPD curves I want to have different thresholds enforced on ...
0
votes
1
answer
57
views
Can you use fairlearn for non-parity constraints? (binned monotonicity)
I'd like to use fairlearn to encode a binned monotonicity constraint on a binned continuous feature, e.g. income. That is, for input x, model h, and income groups {G_1...G_k}, I'd like to enforce:
E[h(...
1
vote
1
answer
704
views
Fairness metrics for multi-class classification
Are there any metrics implemented in Fairlearn or any published papers that I can refer to for use-cases around fairness measurement of multi-class classification where the metrics are AP and not ...
0
votes
1
answer
257
views
Selection Rate in selection_rate_group_summary in fairlearn
How does selection_rate_group_summary decide the cutoff value when we pass the output of a mitigated model to it in fairlearn module.
The selection rate in one of our data is really high all the time ...
2
votes
1
answer
229
views
How does one use the Fairlearn metrics to make a decision on whether a feature is biased or not?
Can anyone suggest best practice guidelines on selecting thresholds for the disparity metrics to determine if a sensitive attribute is biased or not?
0
votes
1
answer
815
views
How to handle 'Widget Loading...' Message in Google Cloud's JupyterLab AI Platform?
I am working on getting to know FairLearn in Google Cloud's AI Platform (via JupyterLab). For now, I am starting with the tutorial and when I run the code for the Fairlearn Dashboard, I get an ...
0
votes
1
answer
345
views
How can I use Fairlearn with custom fairness constraints?
Fairlearn currently provides Demographic Parity, Equalized Odds, True Positive Parity as fairness constraints for the ExponentiatedGradient unfairness mitigation technique. If I want to use a custom ...