-
Notifications
You must be signed in to change notification settings - Fork 23
Open
Description
This line panicked during a bench:
inference-benchmarker/src/results.rs
Line 252 in 687e477
| + delta * data[i as usize + 1].as_secs_f64(); |
The error:
thread 'tokio-r53time912808222panicked at src/results.rs:252:11:0
index out of bou5ds6 8he445n48s 1 but the index is 1
These were the parameters:
"--prompt-options num_tokens=1000,max_tokens=1200,min_tokens=800,variance=100",
"--decode-options num_tokens=50,max_tokens=70,min_tokens=30,variance=15",
"--dataset hlarcher/inference-benchmarker",
"--dataset-file share_gpt_turns.json",
"--benchmark-kind rate",
"--rates 0.016", # One per minute
"--rates 0.1", # One per 10 seconds
"--rates 1", # One per second
"--rates 10", # 10 per second
As a side note, the script should really save the progress as it's computed, lost all the bench because of this failure
Metadata
Metadata
Assignees
Labels
No labels