Skip to content

Conversation

AlexKer
Copy link
Contributor

@AlexKer AlexKer commented Sep 30, 2025

This PR adds Baseten as a new inference provider for conversational tasks.
Route: /v1/chat/completions (OpenAI Compatible)
Added tests to InferenceClient.spec.ts. Ran tests locally to check they're all passing.

@SBrandeis SBrandeis requested a review from Wauplin October 1, 2025 10:18
Copy link
Contributor

@Wauplin Wauplin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! I left a minor comment regarding overriding default route but otherwise should be fine :)

Note that I did not try the client myself yet.

@AlexKer AlexKer requested a review from Wauplin October 1, 2025 13:34
@AlexKer
Copy link
Contributor Author

AlexKer commented Oct 1, 2025

@Wauplin just fixed, thanks for pointing it out. I tested the integration myself after this change and all tests are still passing.

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Contributor

@Wauplin Wauplin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pre-approving, (once test comment is addressed :) )

Copy link
Contributor

@Wauplin Wauplin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! 🤗 Let's wait a second pair of eyes on this :)

@AlexKer
Copy link
Contributor Author

AlexKer commented Oct 1, 2025

great thanks @Wauplin!

Copy link
Contributor

@SBrandeis SBrandeis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@SBrandeis SBrandeis merged commit c242011 into huggingface:main Oct 1, 2025
5 checks passed
@AlexKer AlexKer changed the title Feat/add baseten provider feat/add baseten provider Oct 3, 2025
@AlexKer AlexKer changed the title feat/add baseten provider feat/add baseten provider (js) Oct 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants