This commit is contained in:
Benchmark
2025-11-05 02:11:21 +00:00
parent 448026b5b6
commit 6172906cab
4 changed files with 90 additions and 0 deletions

View File

@@ -0,0 +1,2 @@
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2025/2025_11_05_00_50_17_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.147-172.266.amzn2023.x86_64 Amazon Linux 2023.8.20250818 14.2.1 1 0 0 0 2025-11-05 00:50:17
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2 2025/2025_11_05_00_50_17_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.147-172.266.amzn2023.x86_64 Amazon Linux 2023.8.20250818 14.2.1 1 0 0 0 2025-11-05 00:50:17

View File

@@ -0,0 +1,51 @@
### AWS x86_64 (c7i.24xl)
| Attribute | Value |
|---------------|----------------|
| Environment |aws|
| Runner |host|
| Instance type |c7i.metal-24xl (dedicated)|
| Architecture |x86_64
| CPU |48 cores|
| CPU settings |disabled deeper C-states, disabled turbo boost, disabled hyper-threading|
| RAM |188 GB|
| Kernel |6.1.147-172.266.amzn2023.x86_64|
| OS |Amazon Linux 2023.8.20250818|
| GCC |14.2.1|
| Time |2025-11-05 00:50:17 UTC|
### Laravel 12.2.0 demo app - 100 consecutive runs, 50 warmups, 100 requests (sec)
| PHP | Min | Max | Std dev | Rel std dev % | Mean | Mean diff % | Median | Median diff % | Skew | P-value | Instr count | Memory |
|-------------|-------------|-------------|--------------|---------------|--------|-------------|------------|---------------|---------|---------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.47564|0.47898|0.00057|0.12%|0.47688|0.00%|0.47683|0.00%|0.977|0.999|180948733|43.67 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/67e5d6cc2d)|0.46790|0.47284|0.00082|0.18%|0.46908|-1.64%|0.46891|-1.66%|1.624|0.000|176382309|44.19 MB|
|[PHP - master](https://github.com/php/php-src/commit/1cf63a9380)|0.46822|0.47171|0.00061|0.13%|0.46941|-1.57%|0.46932|-1.57%|1.027|0.000|176445617|44.25 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/1cf63a9380)|0.44826|0.45128|0.00045|0.10%|0.44909|-5.83%|0.44906|-5.82%|1.395|0.000|147928244|53.38 MB|
### Symfony 2.7.0 demo app - 100 consecutive runs, 50 warmups, 100 requests (sec)
| PHP | Min | Max | Std dev | Rel std dev % | Mean | Mean diff % | Median | Median diff % | Skew | P-value | Instr count | Memory |
|-------------|-------------|-------------|--------------|---------------|--------|-------------|------------|---------------|---------|---------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.74070|0.75344|0.00172|0.23%|0.74278|0.00%|0.74261|0.00%|4.346|0.999|291621225|40.27 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/67e5d6cc2d)|0.73970|0.74841|0.00158|0.21%|0.74281|0.00%|0.74250|-0.01%|1.337|0.823|290444939|40.42 MB|
|[PHP - master](https://github.com/php/php-src/commit/1cf63a9380)|0.73990|0.75282|0.00203|0.27%|0.74262|-0.02%|0.74211|-0.07%|2.586|0.037|290445828|40.73 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/1cf63a9380)|0.71767|0.72207|0.00089|0.12%|0.71941|-3.15%|0.71917|-3.16%|0.606|0.000|270808070|47.85 MB|
### Wordpress 6.2 main page - 100 consecutive runs, 20 warmups, 20 requests (sec)
| PHP | Min | Max | Std dev | Rel std dev % | Mean | Mean diff % | Median | Median diff % | Skew | P-value | Instr count | Memory |
|-------------|-------------|-------------|--------------|---------------|--------|-------------|------------|---------------|---------|---------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.57974|0.58473|0.00113|0.19%|0.58171|0.00%|0.58144|0.00%|0.610|0.999|1123344266|43.79 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/67e5d6cc2d)|0.57844|0.58295|0.00105|0.18%|0.58019|-0.26%|0.58002|-0.24%|0.481|0.000|1120016258|44.02 MB|
|[PHP - master](https://github.com/php/php-src/commit/1cf63a9380)|0.57789|0.58276|0.00116|0.20%|0.57999|-0.30%|0.57980|-0.28%|0.374|0.000|1119881362|44.07 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/1cf63a9380)|0.51458|0.51994|0.00096|0.19%|0.51759|-11.02%|0.51748|-11.00%|0.092|0.000|865931202|61.49 MB|
### bench.php - 100 consecutive runs, 10 warmups, 2 requests (sec)
| PHP | Min | Max | Std dev | Rel std dev % | Mean | Mean diff % | Median | Median diff % | Skew | P-value | Instr count | Memory |
|-------------|-------------|-------------|--------------|---------------|--------|-------------|------------|---------------|---------|---------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.42472|0.44601|0.00272|0.63%|0.43361|0.00%|0.43333|0.00%|0.981|0.999|2020638169|26.61 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/67e5d6cc2d)|0.42511|0.48552|0.00653|1.52%|0.42920|-1.02%|0.42768|-1.31%|6.772|0.000|2020586645|26.91 MB|
|[PHP - master](https://github.com/php/php-src/commit/1cf63a9380)|0.42399|0.43566|0.00264|0.62%|0.42687|-1.55%|0.42590|-1.71%|1.763|0.000|2020586588|26.95 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/1cf63a9380)|0.14701|0.15290|0.00095|0.64%|0.14892|-65.66%|0.14881|-65.66%|0.941|0.000|536605597|27.73 MB|

View File

@@ -0,0 +1,17 @@
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Rel std dev % Mean Mean diff % Median Median diff % Skew P-value Instruction count Memory usage
Laravel 12.2.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.47564 0.47898 0.00057 0.11851 0.47688 0.00 0.47683 0.00 0.977 0.999 180948733 43.67
Laravel 12.2.0 demo app 50 100 100 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.46790 0.47284 0.00082 0.17571 0.46908 -1.64 0.46891 -1.66 1.624 0.000 176382309 44.19
Laravel 12.2.0 demo app 50 100 100 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.46822 0.47171 0.00061 0.12906 0.46941 -1.57 0.46932 -1.57 1.027 0.000 176445617 44.25
Laravel 12.2.0 demo app 50 100 100 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.44826 0.45128 0.00045 0.09935 0.44909 -5.83 0.44906 -5.82 1.395 0.000 147928244 53.38
Symfony 2.7.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.74070 0.75344 0.00172 0.23108 0.74278 0.00 0.74261 0.00 4.346 0.999 291621225 40.27
Symfony 2.7.0 demo app 50 100 100 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.73970 0.74841 0.00158 0.21292 0.74281 0.00 0.74250 -0.01 1.337 0.823 290444939 40.42
Symfony 2.7.0 demo app 50 100 100 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.73990 0.75282 0.00203 0.27321 0.74262 -0.02 0.74211 -0.07 2.586 0.037 290445828 40.73
Symfony 2.7.0 demo app 50 100 100 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.71767 0.72207 0.00089 0.12322 0.71941 -3.15 0.71917 -3.16 0.606 0.000 270808070 47.85
Wordpress 6.2 main page 20 100 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.57974 0.58473 0.00113 0.19460 0.58171 0.00 0.58144 0.00 0.610 0.999 1123344266 43.79
Wordpress 6.2 main page 20 100 20 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.57844 0.58295 0.00105 0.18042 0.58019 -0.26 0.58002 -0.24 0.481 0.000 1120016258 44.02
Wordpress 6.2 main page 20 100 20 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.57789 0.58276 0.00116 0.20034 0.57999 -0.30 0.57980 -0.28 0.374 0.000 1119881362 44.07
Wordpress 6.2 main page 20 100 20 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.51458 0.51994 0.00096 0.18522 0.51759 -11.02 0.51748 -11.00 0.092 0.000 865931202 61.49
bench.php 10 100 2 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.42472 0.44601 0.00272 0.62666 0.43361 0.00 0.43333 0.00 0.981 0.999 2020638169 26.61
bench.php 10 100 2 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.42511 0.48552 0.00653 1.52071 0.42920 -1.02 0.42768 -1.31 6.772 0.000 2020586645 26.91
bench.php 10 100 2 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.42399 0.43566 0.00264 0.61943 0.42687 -1.55 0.42590 -1.71 1.763 0.000 2020586588 26.95
bench.php 10 100 2 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.14701 0.15290 0.00095 0.63751 0.14892 -65.66 0.14881 -65.66 0.941 0.000 536605597 27.73
1 Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Rel std dev % Mean Mean diff % Median Median diff % Skew P-value Instruction count Memory usage
2 Laravel 12.2.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.47564 0.47898 0.00057 0.11851 0.47688 0.00 0.47683 0.00 0.977 0.999 180948733 43.67
3 Laravel 12.2.0 demo app 50 100 100 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.46790 0.47284 0.00082 0.17571 0.46908 -1.64 0.46891 -1.66 1.624 0.000 176382309 44.19
4 Laravel 12.2.0 demo app 50 100 100 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.46822 0.47171 0.00061 0.12906 0.46941 -1.57 0.46932 -1.57 1.027 0.000 176445617 44.25
5 Laravel 12.2.0 demo app 50 100 100 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.44826 0.45128 0.00045 0.09935 0.44909 -5.83 0.44906 -5.82 1.395 0.000 147928244 53.38
6 Symfony 2.7.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.74070 0.75344 0.00172 0.23108 0.74278 0.00 0.74261 0.00 4.346 0.999 291621225 40.27
7 Symfony 2.7.0 demo app 50 100 100 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.73970 0.74841 0.00158 0.21292 0.74281 0.00 0.74250 -0.01 1.337 0.823 290444939 40.42
8 Symfony 2.7.0 demo app 50 100 100 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.73990 0.75282 0.00203 0.27321 0.74262 -0.02 0.74211 -0.07 2.586 0.037 290445828 40.73
9 Symfony 2.7.0 demo app 50 100 100 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.71767 0.72207 0.00089 0.12322 0.71941 -3.15 0.71917 -3.16 0.606 0.000 270808070 47.85
10 Wordpress 6.2 main page 20 100 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.57974 0.58473 0.00113 0.19460 0.58171 0.00 0.58144 0.00 0.610 0.999 1123344266 43.79
11 Wordpress 6.2 main page 20 100 20 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.57844 0.58295 0.00105 0.18042 0.58019 -0.26 0.58002 -0.24 0.481 0.000 1120016258 44.02
12 Wordpress 6.2 main page 20 100 20 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.57789 0.58276 0.00116 0.20034 0.57999 -0.30 0.57980 -0.28 0.374 0.000 1119881362 44.07
13 Wordpress 6.2 main page 20 100 20 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.51458 0.51994 0.00096 0.18522 0.51759 -11.02 0.51748 -11.00 0.092 0.000 865931202 61.49
14 bench.php 10 100 2 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.42472 0.44601 0.00272 0.62666 0.43361 0.00 0.43333 0.00 0.981 0.999 2020638169 26.61
15 bench.php 10 100 2 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.42511 0.48552 0.00653 1.52071 0.42920 -1.02 0.42768 -1.31 6.772 0.000 2020586645 26.91
16 bench.php 10 100 2 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.42399 0.43566 0.00264 0.61943 0.42687 -1.55 0.42590 -1.71 1.763 0.000 2020586588 26.95
17 bench.php 10 100 2 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.14701 0.15290 0.00095 0.63751 0.14892 -65.66 0.14881 -65.66 0.941 0.000 536605597 27.73

View File

@@ -6506,3 +6506,23 @@ bench.php 10 100 2 PHP - previous master 49c3ff6c89 https://github.com/php/php-s
bench.php 10 100 2 PHP - master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.42373 0.47727 0.00554 1.29482 0.42783 -1.34 0.42660 -1.62 7.394 0.000 2020586576 26.91
bench.php 10 100 2 PHP - master (JIT) 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.14668 0.15156 0.00095 0.63772 0.14872 -65.70 0.14872 -65.70 0.152 0.000 536605538 27.69
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2025/2025_11_05_00_50_17_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.147-172.266.amzn2023.x86_64 Amazon Linux 2023.8.20250818 14.2.1 1 0 0 0 2025-11-05 00:50:17
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Rel std dev % Mean Mean diff % Median Median diff % Skew P-value Instruction count Memory usage
Laravel 12.2.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.47564 0.47898 0.00057 0.11851 0.47688 0.00 0.47683 0.00 0.977 0.999 180948733 43.67
Laravel 12.2.0 demo app 50 100 100 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.46790 0.47284 0.00082 0.17571 0.46908 -1.64 0.46891 -1.66 1.624 0.000 176382309 44.19
Laravel 12.2.0 demo app 50 100 100 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.46822 0.47171 0.00061 0.12906 0.46941 -1.57 0.46932 -1.57 1.027 0.000 176445617 44.25
Laravel 12.2.0 demo app 50 100 100 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.44826 0.45128 0.00045 0.09935 0.44909 -5.83 0.44906 -5.82 1.395 0.000 147928244 53.38
Symfony 2.7.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.74070 0.75344 0.00172 0.23108 0.74278 0.00 0.74261 0.00 4.346 0.999 291621225 40.27
Symfony 2.7.0 demo app 50 100 100 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.73970 0.74841 0.00158 0.21292 0.74281 0.00 0.74250 -0.01 1.337 0.823 290444939 40.42
Symfony 2.7.0 demo app 50 100 100 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.73990 0.75282 0.00203 0.27321 0.74262 -0.02 0.74211 -0.07 2.586 0.037 290445828 40.73
Symfony 2.7.0 demo app 50 100 100 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.71767 0.72207 0.00089 0.12322 0.71941 -3.15 0.71917 -3.16 0.606 0.000 270808070 47.85
Wordpress 6.2 main page 20 100 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.57974 0.58473 0.00113 0.19460 0.58171 0.00 0.58144 0.00 0.610 0.999 1123344266 43.79
Wordpress 6.2 main page 20 100 20 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.57844 0.58295 0.00105 0.18042 0.58019 -0.26 0.58002 -0.24 0.481 0.000 1120016258 44.02
Wordpress 6.2 main page 20 100 20 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.57789 0.58276 0.00116 0.20034 0.57999 -0.30 0.57980 -0.28 0.374 0.000 1119881362 44.07
Wordpress 6.2 main page 20 100 20 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.51458 0.51994 0.00096 0.18522 0.51759 -11.02 0.51748 -11.00 0.092 0.000 865931202 61.49
bench.php 10 100 2 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.42472 0.44601 0.00272 0.62666 0.43361 0.00 0.43333 0.00 0.981 0.999 2020638169 26.61
bench.php 10 100 2 PHP - previous master 67e5d6cc2d https://github.com/php/php-src/commit/67e5d6cc2d 0.42511 0.48552 0.00653 1.52071 0.42920 -1.02 0.42768 -1.31 6.772 0.000 2020586645 26.91
bench.php 10 100 2 PHP - master 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.42399 0.43566 0.00264 0.61943 0.42687 -1.55 0.42590 -1.71 1.763 0.000 2020586588 26.95
bench.php 10 100 2 PHP - master (JIT) 1cf63a9380 https://github.com/php/php-src/commit/1cf63a9380 0.14701 0.15290 0.00095 0.63751 0.14892 -65.66 0.14881 -65.66 0.941 0.000 536605597 27.73
Can't render this file because it is too large.