I would like you to add an option that allows me to specify AmazonOpenSearch for the Knowledge (Vector DB).

[tatsuyoshi-mashiko]

Vector DB is RDS by default, but I would like to see an option to select Amazon OpenSearchServerless added.

OpenSearchServerless is a very useful option for Vector DB because it enables a very good hybrid search.

It is definitely a valid option when building an AI execution environment (RAG) on AWS.

At present, it seems that OpenSearchServerless cannot be selected as an option, so it seems that the only way is to build Amazon Bedrock separately and connect it using Dify's custom tool. (I would like to be able to select Amazon OpenSearchServerless for deployment of the relevant CDK, as it is time-consuming and labor-intensive.)

To begin with, it is unclear whether OpenSearchServerless can be set up for the knowledge (vector DB) of Dify's Community Edition...

[tmokmss]

Hi @tatsuyoshi-mashiko thank you for the feature request!

Do you have any particular example of when opensearch works better while pgvector misbehaves?

A current workaround would be to use Bedrock Knowledge Base, which automatically provisions OpenSearch without configuration and can be referenced from Dify by both knowledge and a tool.

[tatsuyoshi-mashiko]

@tmokmss Thank you for your reply.
There is no objective quantitative data or evidence to suggest that Amazon OpenSearch is superior to Postgreth, which is what you are looking for.

We assume that Amazon OpenSearch will be effective in hybrid searches because the full-text search accuracy of ElasticSearch, which is the basis of Amazon OpenSearch, is excellent. Therefore, this is a qualitative evaluation based on our past development cases.

[tatsuyoshi-mashiko]

@tmokmss
I feel that it should be possible to choose optionally, as it is pointless to argue about which is better, as it requires things like use cases, etc., but what do you think?

[tmokmss]

Yes it is definitely better to have OpenSearch availability. Since the current postgres implementation works and users can use Bedrock Knowledge Base with OpenSearch, I put less priority on this issue . Of course PR is welcome! Thanks.