Skip to content

Panic during normal execution #36

@dominusmi

Description

@dominusmi

This line panicked during a bench:

+ delta * data[i as usize + 1].as_secs_f64();

The error:

thread 'tokio-r53time912808222panicked at src/results.rs:252:11:0
index out of bou5ds6 8he445n48s 1 but the index is 1 

These were the parameters:

            "--prompt-options num_tokens=1000,max_tokens=1200,min_tokens=800,variance=100",
            "--decode-options num_tokens=50,max_tokens=70,min_tokens=30,variance=15",
            "--dataset hlarcher/inference-benchmarker",
            "--dataset-file share_gpt_turns.json",
            "--benchmark-kind rate",
            "--rates 0.016",  # One per minute
            "--rates 0.1",  # One per 10 seconds
            "--rates 1",  # One per second
            "--rates 10",  # 10 per second

As a side note, the script should really save the progress as it's computed, lost all the bench because of this failure

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions