HoneyHive is a model observability and evaluation platform that helps you continuously improve your models in production. We help you evaluate, deploy, monitor and fine-tune both closed and open-source large language models for production use-cases, allowing you to optimize model performance & align your models with your users’ preferences.
go get github.com/speakeasy-sdks/honeyhive-go-sdkAfter signing up on the app, you can find your API key in the Settings page.
package main
import (
"context"
"log"
"github.com/speakeasy-sdks/honeyhive-go-sdk"
"github.com/speakeasy-sdks/honeyhive-go-sdk/pkg/models/shared"
"github.com/speakeasy-sdks/honeyhive-go-sdk/pkg/models/operations"
)
func main() {
s := honeyhive.New(honeyhive.WithSecurity(
shared.Security{
BearerAuth: shared.SchemeBearerAuth{
Authorization: "Bearer YOUR_BEARER_TOKEN_HERE",
},
},
))
req := operations.CreateDatasetRequest{
Request: shared.Dataset{
Description: "unde",
File: "deserunt",
Name: "porro",
Purpose: "nulla",
Task: "id",
},
}
ctx := context.Background()
res, err := s.Dataset.CreateDataset(ctx, req)
if err != nil {
log.Fatal(err)
}
if res.CreateDatasetResponse != nil {
// handle response
}
}CreateDataset- Create DatasetDeleteDataset- Delete DatasetsFindDatasets- Get Datasets
CreateFeedback- Create Feedback
FindFineTunedModels- This endpoint gets the fine-tuned models being managed by the user.
GetGeneration- Get GenerationsIngestGenerations- Create Generation for TaskModelPromptCreateGeneration- Create Generation for Model and PromptTaskCreateGeneration- Create Generation for Task
CreateMetric- Create MetricFindMetrics- Get Metrics
ChangePrompt- Update PromptsCreatePrompt- Create PromptDeletePrompt- Delete PromptsFindPrompts- Get Prompts
CreateTask- Create a new taskFindAllTasks- Find all TasksUpdateTask- Update an existing task