Skip to content

Conversation

@bhirsz
Copy link
Member

@bhirsz bhirsz commented Jan 2, 2026

Draft PR for testing.

Closes #1596

For now instead of commit file the repository - which makes the result often stale and it's highly environment dependant - we run tests for the past 5 versions. The results are published in the release PR.

@bhirsz bhirsz force-pushed the chore/performance_test_ci branch 5 times, most recently from 4fc21ed to c7900c9 Compare January 2, 2026 14:23
@bhirsz
Copy link
Member Author

bhirsz commented Jan 2, 2026

There are some bugs to be fixed but summary is now available in job summary. Hopefully I will move it into the PR itself:

image

@bhirsz bhirsz force-pushed the chore/performance_test_ci branch from c7900c9 to a87cf61 Compare January 2, 2026 17:55
@github-actions
Copy link
Contributor

github-actions bot commented Jan 2, 2026

Performance Report

Version Project traversal Linting (print+cache) Linting (print+no cache) Linting (no print+cache) Linting (no print+no cache) Linting (large file with print) Formatting
7.2.0 0.268s (-29.19%) 1.701s (-26.29%) 3.458s (1.59%) 0.404s (-52.8%) 2.064s (6.04%) 4.942s (58.4%) 0.513s (22.46%)
7.1.0 0.379s (-33.38%) 2.307s (9.49%) 3.404s (0.0%) 0.856s (-3.39%) 1.946s (-50.68%) 3.120s (-24.27%) 0.419s (0.0%)
7.0.0 0.569s (76.17%) 2.107s 3.404s 0.886s 3.946s 4.120s 0.419s (50.03%)
6.12.0 0.323s (3.55%) - - - - - 0.279s
6.11.0 0.312s (-93.89%) - - - - - -
6.9.0 5.110s - - - - - -

@bhirsz bhirsz force-pushed the chore/performance_test_ci branch from a87cf61 to 549a5cb Compare January 2, 2026 18:02
@github-actions
Copy link
Contributor

github-actions bot commented Jan 2, 2026

Performance Report

Version Project traversal Linting (print+cache) Linting (print+no cache) Linting (no print+cache) Linting (no print+no cache) Linting (large file with print) Formatting
7.2.0 0.269s (-94.74%) 1.629s 3.263s 0.388s 1.986s 4.808s 0.501s
6.9.0 5.110s - - - - - -

@bhirsz bhirsz force-pushed the chore/performance_test_ci branch 8 times, most recently from bf699b3 to 47812b7 Compare January 5, 2026 09:32
@github-actions
Copy link
Contributor

github-actions bot commented Jan 5, 2026

Performance Report

Version Project traversal Linting (print+cache) Linting (print+no cache) Linting (no print+cache) Linting (no print+no cache) Linting (large file with print) Formatting
7.2.0 0.373s (-92.7%) 2.763s 4.551s 0.556s 2.768s 6.872s 0.727s
6.9.0 5.110s - - - - - -

@bhirsz bhirsz force-pushed the chore/performance_test_ci branch 2 times, most recently from f2ce828 to 5c04d91 Compare January 5, 2026 10:38
@github-actions
Copy link
Contributor

github-actions bot commented Jan 5, 2026

Performance Report

Version Project traversal Linting (print+cache) Linting (print+no cache) Linting (no print+cache) Linting (no print+no cache) Linting (large file with print) Formatting
7.2.0 0.372s (0.46%) 2.694s (-41.05%) 4.485s (-29.8%) 0.547s (-3.41%) 2.746s (-3.83%) 6.831s (-3.67%) 0.502s (-0.78%)
7.1.0 0.371s (-2.27%) 4.569s 6.389s (22.61%) 0.566s 2.855s (16.12%) 7.092s (3.65%) 0.506s (-0.06%)
7.0.0 0.379s (1.56%) - 5.211s (0.61%) - 2.459s (2.99%) 6.842s (1.46%) 0.507s (0.59%)
6.13.0 0.373s (-92.69%) - 5.180s - 2.387s 6.744s 0.504s
6.9.0 5.110s - - - - - -

@bhirsz bhirsz force-pushed the chore/performance_test_ci branch from 5c04d91 to c35c4f0 Compare January 5, 2026 11:05
@bhirsz bhirsz merged commit eea1c56 into main Jan 5, 2026
11 checks passed
@bhirsz bhirsz deleted the chore/performance_test_ci branch January 5, 2026 11:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Publish performance benchmarks for each release

2 participants