This repository was archived by the owner on Aug 7, 2025. It is now read-only.
feature/add torchserve detectron2 #3355
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
agunapal
suggested changes
Dec 19, 2024
|
|
||
| --- | ||
|
|
||
| ## Contributors |
There was a problem hiding this comment.
Please remove this section
|
|
||
| --- | ||
|
|
||
| ## Usage |
There was a problem hiding this comment.
Please take a look at other examples and show all the steps in this README. Anyone should be able to replicate the example looking at just the README.
There was a problem hiding this comment.
Thank you for the guidance! I’ve now updated the README file.
| logger.info(f"Inference started for a batch of {len(model_input)}.") | ||
|
|
||
| outputs = [] | ||
| for idx, image in enumerate(model_input): |
There was a problem hiding this comment.
Can detectron2 process a batch of images? Can we send the batch instead of looping over each image
There was a problem hiding this comment.
Yes, Detectron2 can process a batch of images, and we can send them.
|
HI @Mudassar-MLE Thanks for the PR. Can you please add some context in the PR and write a short description |
…dassar-MLE/serve into feature/torchserve-detectron2
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add Detectron2 Support to TorchServe Object Detection Examples (#3344)
This pull request introduces support for Detectron2 models in TorchServe, addressing issue #3344. It includes a custom handler designed to ensure seamless deployment on both CPU and GPU environments, automatically managing device compatibility. Additionally, the example provides a requirements.txt file for dependencies and a detailed README to guide users in deploying pre-trained models from the Detectron2 Model Zoo as well as custom fine-tuned models. The updates are placed under examples/object_detector/detectron2 as suggested by the maintainers.
The contribution aims to simplify the deployment process for Detectron2 models in TorchServe, enhancing its usability for developers and making it a more commercially viable option for object detection tasks.