Tracking the time consumption #29
Description
What would you like to be added:
Not only the TTFT/TPOT/E2E-Latency, we also need to track the time consumption for each part, for example, evaluation code, how many times to run the evaluation.
Why is this needed:
Completion requirements:
This feature requires the following artifacts:
- Design doc
- API change
- Docs update
The artifacts should be linked in subsequent comments.