Description

What: We want to inform our customer how they can utilize vLLM to run OSS models similar to the instructions we published to use LMStudio.

Resources

Instructions are being finalized in the doc linked here.

Which documentation set does this change impact?

Elastic On-Prem and Cloud (all)

Feature differences

n.a

What release is this request related to?

N/A

Serverless release

n/a

Collaboration model

The documentation team

Point of contact.

Main contact: @dhru42 @jamesspi

Stakeholders: @jamesspi