❓ how to use AUPIMO correctly for validation and testing?

[bananaspirit-nasonov]

Your Question

I want to use AUPIMO on validation to select models, what should be the validation sample? Should it contain abnormal examples or only normal ones?
Logically, I understand that abnormal examples are needed to calculate per-image Recall, and normal examples are needed to calculate shared_TPR, so a valid sample should contain both. However, studying the original article, I still did not understand what was needed and how to do it correctly.

Forum Check

• I have searched the discussions forum for an answer to my question.

[github-actions]

Thanks for submitting this issue! It has been added to our triage queue. A maintainer will review it shortly.

[ashwinvaidya17]

@jpcbertoldo can you maybe answer this?