Skip to content

Conversation

@szedan-rh
Copy link
Collaborator

Intial PR for performance test on integration test and generate report.

@netlify
Copy link

netlify bot commented Dec 5, 2025

Deploy Preview for vllm-semantic-router ready!

Name Link
🔨 Latest commit 9e3ef4d
🔍 Latest deploy log https://app.netlify.com/projects/vllm-semantic-router/deploys/6937fc7dabadb50008b1498c
😎 Deploy Preview https://deploy-preview-778--vllm-semantic-router.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@github-actions
Copy link

github-actions bot commented Dec 5, 2025

👥 vLLM Semantic Team Notification

The following members have been identified for the changed files in this PR and have been automatically assigned:

📁 Root Directory

Owners: @rootfs, @Xunzhuo
Files changed:

  • .github/workflows/performance-nightly.yml
  • .github/workflows/performance-test.yml
  • Makefile
  • perf/CI-STRATEGY.md
  • perf/QUICKSTART.md
  • perf/README.md
  • perf/benchmarks/cache_bench_test.go
  • perf/benchmarks/classification_bench_test.go
  • perf/benchmarks/decision_bench_test.go
  • perf/benchmarks/extproc_bench_test.go
  • perf/cmd/perftest/main.go
  • perf/config/perf.yaml
  • perf/config/thresholds.yaml
  • perf/go.mod
  • perf/go.sum
  • perf/pkg/benchmark/baseline.go
  • perf/pkg/benchmark/config.go
  • perf/pkg/benchmark/report.go
  • perf/pkg/benchmark/runner.go
  • perf/pkg/profiler/profiler.go
  • perf/scripts/update-baseline.sh
  • perf/testdata/examples/README.md
  • perf/testdata/examples/benchmark-output-example.txt
  • perf/testdata/examples/comparison-example.txt
  • perf/testdata/examples/example-report.html
  • perf/testdata/examples/example-report.json
  • perf/testdata/examples/example-report.md
  • perf/testdata/examples/pprof-example.txt
  • perf/testdata/examples/pr-comment-example.md

📁 e2e

Owners: @Xunzhuo
Files changed:

  • e2e/pkg/performance/load_generator.go
  • e2e/pkg/performance/metrics_collector.go

📁 tools

Owners: @yuluo-yx, @rootfs, @Xunzhuo
Files changed:

  • tools/make/performance.mk

vLLM

🎉 Thanks for your contributions!

This comment was automatically generated based on the OWNER files in the repository.

@Xunzhuo
Copy link
Member

Xunzhuo commented Dec 5, 2025

fixes: #41

@szedan-rh szedan-rh marked this pull request as ready for review December 8, 2025 15:56
The PR comment step can fail when running on pull requests from forks
due to GitHub's security restrictions. Even with write permissions
specified, GITHUB_TOKEN is read-only for fork PRs to prevent malicious
code from writing to the base repository.

Added 'continue-on-error: true' to make this step optional. The
performance results will still be available in the workflow artifacts
even if commenting fails.

Fixes the '403 Resource not accessible by integration' error on fork PRs.

Signed-off-by: Senan Zedan <[email protected]>
@szedan-rh
Copy link
Collaborator Author

@Xunzhuo - Could you please review

@rootfs
Copy link
Collaborator

rootfs commented Dec 9, 2025

merging it for testing now

@rootfs rootfs merged commit 34bdc84 into vllm-project:main Dec 9, 2025
26 checks passed
@rootfs
Copy link
Collaborator

rootfs commented Dec 9, 2025

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants