Different languages in the pipeline STT-ChatGPT-TTS.

[KnezKiev]

I'm creating an interactive assistant in the VR virtual showroom for furniture. I'm using Metahuman for NPC and this plugin for voice interaction. However, I have an unresolved issue regarding how to handle different languages. The assistant should be bilingual, supporting both English and Ukrainian.

Whisper is capable of understanding both languages, but it doesn't indicate which language has been recognized. ChatGPT comprehends everything and responds in the same language. However, it also doesn't specify the language of the response.

On the other hand, Google TTS relies on the language manually selected. Therefore, if Ukrainian is chosen but the reply is in English, the voice response will have a distinct Ukrainian accent.

Do you have any ideas on how to configure the TTS language to match the language of the STT prompt?