bug: misclassified

[RuixiangMa]

Describe the bug

I'm new to this project, but during debugging I noticed that a math problem was misclassified as a chemistry problem.

To Reproduce

curl -X POST http://localhost:8801/v1/chat/completions -H "Content-Type: application/json" -d '{ "model": "MoM", "messages": [{"role": "user", "content": "Solve: x^2 + 5x + 6 = 0"}] }'

Expected behavior

No response

Additional context

No response

[Xunzhuo]

can you share the config?

[rootfs]

@yossiovadia had some similar experiences and he fixed the issue by enforcing lora based models.

[RuixiangMa]

can you share the config?

Thanks! Here is the configuration file

config.yaml

[rootfs]

@RuixiangMa can you check if the config tested by this PR can help?
#726

[rootfs]

@RuixiangMa PR 726 is merged, can you try again? Thanks

cc @yossiovadia

[RuixiangMa]

PR 726 is merged, can you try again? Thanks

Got it，thanks! I'll give it a try