SemDeduplicator算子能支持什么嵌入模型

[edc3000]

System Info

last

Reproduction

请问一下，SemDeduplicator算子能支持什么嵌入模型，是不是sentence_transformers能加载的嵌入模型都能支持呢

Others

No response

[SunnyHaze]

@zzy1127 Please resonse to this issue.

[zzy1127]

Semdeduplicator theoretically supports computing vector embeddings for any BertModel, but it is still recommended to use the default 'sentence-transformers/all-MiniLM-L6-v2' model, as using others may result in unexpected errors.