Skip to content

Conversation

14pankaj
Copy link
Contributor

@14pankaj 14pankaj commented Sep 18, 2025

Description

Adding a new Microservice Model Download

  1. Model Download Microservice with plugin architecture.
  2. Added pre-configured model hubs like huggingface,ollama,ultralytics models download is supported.
  3. Possible to convert huggingface models to Openvino.
  4. Supported two types of plugin Conversion and hub plugins.

To-do

  1. Adding/Updating the unit testcases.
  2. Updating documentations.
  3. Simplified deployment steps for docker.
  4. Deployment with helm.

Fixes # (issue)

Any Newly Introduced Dependencies

Please describe any newly introduced 3rd party dependencies in this change. List their name, license information and how they are used in the project.

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

Checklist:

  • I agree to use the APACHE-2.0 license for my code changes.
  • I have not introduced any 3rd party components incompatible with APACHE-2.0.
  • I have not included any company confidential information, trade secret, password or security token.
  • I have performed a self-review of my code.

14pankaj and others added 30 commits June 6, 2025 11:18
Added ollama hub support to model download
Added non-root user for the working directory in the container
Add revision + rename ovms_config to config
⚡️VLM model download and compress
refactor - Model download - plugin registry
@14pankaj 14pankaj marked this pull request as ready for review September 26, 2025 05:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants