problem with grounding_dino and sam

[torsteinelv]

Hello, have been tring for some time to get grounding dino and sam to work.

first I need to run this in order for it to run at all:
containers:
- name: label-studio-ml-grounding-dino
image: heartexlabs/label-studio-ml-backend:grnddino-20250430.130621-master-4db70b4
command:
- sh
- -c
- |
pip install "numpy<2"
/app/start.sh

Now i works i can add prompt to the picture and it finds bounding boksens for all my wanted objects and it works perfekt.

But it do not match the labels I have configured. why is that so? also is it possible to keep the prompt for the next picture? So i can just can click next approve next approve?

[heidi-humansignal]

Hello,

Why your detected boxes don’t match your configured labels

Grounding DINO (and SAM) uses your prompt to find objects but doesn’t automatically map that prompt text to one of your <Label> values unless they exactly match. You’ll see bounding-box suggestions, but you must either:

• Use a prompt that exactly equals a <Label value="…"> in your config (including case).

• Or use the “underscore” mapping trick so the backend assigns your Label value to its detections. For example, if your config has <Label value="Container"/> you can prompt:

  containers_Container

This tells the model “find containers” but tag them as “Container” in Label Studio.

Thank you,
Abu

Comment by Abubakar Saad
Workflow Run