Skip to content

🤖 Update Benchmark Results#5242

Merged
thomhurst merged 1 commit intomainfrom
automated-benchmarks-update
Mar 25, 2026
Merged

🤖 Update Benchmark Results#5242
thomhurst merged 1 commit intomainfrom
automated-benchmarks-update

Conversation

@thomhurst
Copy link
Owner

Automated Benchmark Update

This PR updates the benchmark documentation with the latest results from the Speed Comparison workflow.

Benchmarks Produced

Individual benchmark artifacts are available for download:

  • benchmark-DataDrivenTests
  • benchmark-AsyncTests
  • benchmark-ScaleTests
  • benchmark-MatrixTests
  • benchmark-MassiveParallelTests
  • benchmark-SetupTeardownTests
  • benchmark-BuildTime
  • benchmark-summary (aggregated overview)

Runtime Benchmarks

  • AsyncTests
  • DataDrivenTests
  • MassiveParallelTests
  • MatrixTests
  • ScaleTests
  • SetupTeardownTests

Build Benchmarks

  • BuildTime
  • 2026-03-25
  • Ubuntu Latest • .NET SDK 10.0.201

Changes

  • Updated benchmark data in docs/static/benchmarks/latest.json
  • Updated historical trends in docs/static/benchmarks/historical.json
  • Regenerated benchmark documentation in docs/docs/benchmarks/index.md
  • Updated benchmark summary in docs/static/benchmarks/summary.json

Workflow Run

  • Run ID: 23518969957
  • Triggered: schedule
  • Date:

🤖 This PR was automatically created and will be merged automatically once CI checks pass.

@thomhurst thomhurst added automated benchmarks documentation Improvements or additions to documentation ignore-for-release labels Mar 25, 2026
@thomhurst thomhurst merged commit 14cdb39 into main Mar 25, 2026
10 of 12 checks passed
@thomhurst thomhurst deleted the automated-benchmarks-update branch March 25, 2026 00:37
Copy link
Contributor

@claude claude bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated Benchmark Update Review

This is a fully automated PR that updates benchmark documentation with daily CI results. There are no code changes — only data and documentation updates in docs/.

Summary of Changes

  • Benchmark dates: Updated from 2026-03-24 to 2026-03-25 across all benchmark .md files and JSON data files.
  • TUnit version: Bumped from 1.21.6 to 1.21.20 across all benchmark tables.
  • Performance data: Fresh measurements for all benchmark categories (AsyncTests, DataDrivenTests, MassiveParallelTests, MatrixTests, ScaleTests, SetupTeardownTests, BuildTime).
  • JSON files updated: latest.json, historical.json, summary.json.

Notable Observations

Build time improvement: TUnit's build time dropped from 2.580 s to 2.406 s (mean) — a ~7% improvement since yesterday's run.

Runtime performance: TUnit maintains its performance lead over NUnit, MSTest, and xUnit3 across all runtime benchmark categories. Numbers are within normal variance from the prior run.

AOT performance: Stable — TUnit (AOT) AsyncTests mean went from 122.4 ms to 122.9 ms, well within measurement noise.

Assessment

The PR is a mechanical, automated data refresh with no design or architectural concerns. The automation pipeline (scheduled workflow → generate docs → PR → auto-merge) is working as intended. No issues to flag.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automated benchmarks documentation Improvements or additions to documentation ignore-for-release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant