2

such as AUC have a metrics

a good model will be over 0.7 great one will be over 0.85.

I want to know mean reciprocal rank(mrr) metrics evaluation.

how to define this is a good model.

very thanks!!

1 Answer 1

3

The metric MRR take values from 0 (worst) to 1 (best), as described here. However, the definition of a good (or acceptable) MRR depends on your use case. For example, if you build a model to be used in a recommender system, and from thousands of possible items, recommend a set of five items to users, then an MRR of 0.2 could be defined as acceptable. This means that on average, the correct item the user bought was part of the top 5 items, predicted by your model.

All in all, it mostly depends on how many possible classes are possible to predict, as well as your use case.

0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.