Skip to content

Commit 0b7f1d7

Browse files
geromegrignondevversion
authored andcommitted
docs: add autorater option docs
1 parent 9298147 commit 0b7f1d7

File tree

2 files changed

+5
-1
lines changed

2 files changed

+5
-1
lines changed

README.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -77,6 +77,10 @@ You can customize the `web-codegen-scorer eval` script with the following flags:
7777
`DEFAULT_MODEL_NAME`.
7878
- Example: `web-codegen-scorer eval --model=gemini-2.5-flash --env=<config path>`
7979

80+
- `--autorater-model=<name>`: Specifies the model to use when automatically rating generated code. Defaults to the value of
81+
`DEFAULT_AUTORATER_MODEL_NAME`.
82+
- Example: `web-codegen-scorer eval --model=gemini-2.5-flash --autorater-model=gemini-2.5-flash --env=<config path>`
83+
8084
- `--runner=<name>`: Specifies the runner to use to execute the eval. Supported runners are
8185
`genkit` (default) or `gemini-cli`.
8286

runner/eval-cli.ts

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -152,7 +152,7 @@ function builder(argv: Argv): Argv<Options> {
152152
.option('autorater-model', {
153153
type: 'string',
154154
default: DEFAULT_AUTORATER_MODEL_NAME,
155-
descript: 'Model to use when automatically rating generated code',
155+
description: 'Model to use when automatically rating generated code',
156156
})
157157
.strict()
158158
.version(false)

0 commit comments

Comments
 (0)