This commit is contained in:
Benchmark
2025-11-19 02:11:07 +00:00
parent 91b3f5edec
commit 7598318f3f
4 changed files with 90 additions and 0 deletions

View File

@@ -0,0 +1,2 @@
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2025/2025_11_19_00_50_19_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.158-178.288.amzn2023.x86_64 Amazon Linux 2023.9.20251117 14.2.1 1 0 0 0 2025-11-19 00:50:19
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2 2025/2025_11_19_00_50_19_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.158-178.288.amzn2023.x86_64 Amazon Linux 2023.9.20251117 14.2.1 1 0 0 0 2025-11-19 00:50:19

View File

@@ -0,0 +1,51 @@
### AWS x86_64 (c7i.24xl)
| Attribute | Value |
|---------------|----------------|
| Environment |aws|
| Runner |host|
| Instance type |c7i.metal-24xl (dedicated)|
| Architecture |x86_64
| CPU |48 cores|
| CPU settings |disabled deeper C-states, disabled turbo boost, disabled hyper-threading|
| RAM |188 GB|
| Kernel |6.1.158-178.288.amzn2023.x86_64|
| OS |Amazon Linux 2023.9.20251117|
| GCC |14.2.1|
| Time |2025-11-19 00:50:19 UTC|
### Laravel 12.2.0 demo app - 100 consecutive runs, 50 warmups, 100 requests (sec)
| PHP | Min | Max | Std dev | Rel std dev % | Mean | Mean diff % | Median | Median diff % | Skew | P-value | Instr count | Memory |
|-------------|-------------|-------------|--------------|---------------|--------|-------------|------------|---------------|---------|---------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.47454|0.47753|0.00054|0.11%|0.47566|0.00%|0.47555|0.00%|0.686|0.999|180943900|43.62 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/d750d30a62)|0.46713|0.47184|0.00106|0.23%|0.46858|-1.49%|0.46820|-1.55%|1.661|0.000|176333430|44.27 MB|
|[PHP - master](https://github.com/php/php-src/commit/9762c446f0)|0.46643|0.47214|0.00071|0.15%|0.46753|-1.71%|0.46743|-1.71%|3.145|0.000|176406029|44.27 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/9762c446f0)|0.44827|0.45036|0.00048|0.11%|0.44908|-5.59%|0.44897|-5.59%|0.700|0.000|147884866|53.39 MB|
### Symfony 2.7.0 demo app - 100 consecutive runs, 50 warmups, 100 requests (sec)
| PHP | Min | Max | Std dev | Rel std dev % | Mean | Mean diff % | Median | Median diff % | Skew | P-value | Instr count | Memory |
|-------------|-------------|-------------|--------------|---------------|--------|-------------|------------|---------------|---------|---------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.74192|0.74530|0.00075|0.10%|0.74315|0.00%|0.74302|0.00%|0.640|0.999|291621929|40.10 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/d750d30a62)|0.73961|0.75044|0.00140|0.19%|0.74145|-0.23%|0.74126|-0.24%|3.044|0.000|290398583|40.50 MB|
|[PHP - master](https://github.com/php/php-src/commit/9762c446f0)|0.74078|0.75200|0.00195|0.26%|0.74281|-0.05%|0.74233|-0.09%|2.718|0.000|290399697|40.75 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/9762c446f0)|0.71159|0.71732|0.00094|0.13%|0.71316|-4.04%|0.71293|-4.05%|1.394|0.000|270758365|47.86 MB|
### Wordpress 6.2 main page - 100 consecutive runs, 20 warmups, 20 requests (sec)
| PHP | Min | Max | Std dev | Rel std dev % | Mean | Mean diff % | Median | Median diff % | Skew | P-value | Instr count | Memory |
|-------------|-------------|-------------|--------------|---------------|--------|-------------|------------|---------------|---------|---------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.57984|0.59115|0.00156|0.27%|0.58133|0.00%|0.58101|0.00%|4.938|0.999|1123344467|43.74 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/d750d30a62)|0.57872|0.58274|0.00074|0.13%|0.58061|-0.12%|0.58050|-0.09%|0.559|0.000|1119620949|44.10 MB|
|[PHP - master](https://github.com/php/php-src/commit/9762c446f0)|0.57795|0.58967|0.00125|0.22%|0.57991|-0.24%|0.57970|-0.23%|5.079|0.000|1119630528|44.10 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/9762c446f0)|0.51279|0.51799|0.00064|0.12%|0.51582|-11.27%|0.51577|-11.23%|-0.686|0.000|865682454|61.50 MB|
### bench.php - 100 consecutive runs, 10 warmups, 2 requests (sec)
| PHP | Min | Max | Std dev | Rel std dev % | Mean | Mean diff % | Median | Median diff % | Skew | P-value | Instr count | Memory |
|-------------|-------------|-------------|--------------|---------------|--------|-------------|------------|---------------|---------|---------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.42914|0.44979|0.00256|0.59%|0.43468|0.00%|0.43467|0.00%|2.130|0.999|2020638166|26.57 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/d750d30a62)|0.42457|0.47857|0.00600|1.40%|0.42839|-1.45%|0.42692|-1.78%|6.300|0.000|2020586699|26.99 MB|
|[PHP - master](https://github.com/php/php-src/commit/9762c446f0)|0.42430|0.43622|0.00225|0.53%|0.42738|-1.68%|0.42693|-1.78%|2.005|0.000|2020586669|26.98 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/9762c446f0)|0.14636|0.15079|0.00100|0.67%|0.14847|-65.84%|0.14850|-65.83%|0.067|0.000|536605621|27.74 MB|

View File

@@ -0,0 +1,17 @@
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Rel std dev % Mean Mean diff % Median Median diff % Skew P-value Instruction count Memory usage
Laravel 12.2.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.47454 0.47753 0.00054 0.11348 0.47566 0.00 0.47555 0.00 0.686 0.999 180943900 43.62
Laravel 12.2.0 demo app 50 100 100 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.46713 0.47184 0.00106 0.22660 0.46858 -1.49 0.46820 -1.55 1.661 0.000 176333430 44.27
Laravel 12.2.0 demo app 50 100 100 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.46643 0.47214 0.00071 0.15184 0.46753 -1.71 0.46743 -1.71 3.145 0.000 176406029 44.27
Laravel 12.2.0 demo app 50 100 100 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.44827 0.45036 0.00048 0.10712 0.44908 -5.59 0.44897 -5.59 0.700 0.000 147884866 53.39
Symfony 2.7.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.74192 0.74530 0.00075 0.10130 0.74315 0.00 0.74302 0.00 0.640 0.999 291621929 40.10
Symfony 2.7.0 demo app 50 100 100 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.73961 0.75044 0.00140 0.18906 0.74145 -0.23 0.74126 -0.24 3.044 0.000 290398583 40.50
Symfony 2.7.0 demo app 50 100 100 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.74078 0.75200 0.00195 0.26313 0.74281 -0.05 0.74233 -0.09 2.718 0.000 290399697 40.75
Symfony 2.7.0 demo app 50 100 100 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.71159 0.71732 0.00094 0.13181 0.71316 -4.04 0.71293 -4.05 1.394 0.000 270758365 47.86
Wordpress 6.2 main page 20 100 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.57984 0.59115 0.00156 0.26782 0.58133 0.00 0.58101 0.00 4.938 0.999 1123344467 43.74
Wordpress 6.2 main page 20 100 20 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.57872 0.58274 0.00074 0.12690 0.58061 -0.12 0.58050 -0.09 0.559 0.000 1119620949 44.10
Wordpress 6.2 main page 20 100 20 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.57795 0.58967 0.00125 0.21525 0.57991 -0.24 0.57970 -0.23 5.079 0.000 1119630528 44.10
Wordpress 6.2 main page 20 100 20 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.51279 0.51799 0.00064 0.12355 0.51582 -11.27 0.51577 -11.23 -0.686 0.000 865682454 61.50
bench.php 10 100 2 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.42914 0.44979 0.00256 0.58830 0.43468 0.00 0.43467 0.00 2.130 0.999 2020638166 26.57
bench.php 10 100 2 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.42457 0.47857 0.00600 1.40031 0.42839 -1.45 0.42692 -1.78 6.300 0.000 2020586699 26.99
bench.php 10 100 2 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.42430 0.43622 0.00225 0.52761 0.42738 -1.68 0.42693 -1.78 2.005 0.000 2020586669 26.98
bench.php 10 100 2 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.14636 0.15079 0.00100 0.67213 0.14847 -65.84 0.14850 -65.83 0.067 0.000 536605621 27.74
1 Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Rel std dev % Mean Mean diff % Median Median diff % Skew P-value Instruction count Memory usage
2 Laravel 12.2.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.47454 0.47753 0.00054 0.11348 0.47566 0.00 0.47555 0.00 0.686 0.999 180943900 43.62
3 Laravel 12.2.0 demo app 50 100 100 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.46713 0.47184 0.00106 0.22660 0.46858 -1.49 0.46820 -1.55 1.661 0.000 176333430 44.27
4 Laravel 12.2.0 demo app 50 100 100 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.46643 0.47214 0.00071 0.15184 0.46753 -1.71 0.46743 -1.71 3.145 0.000 176406029 44.27
5 Laravel 12.2.0 demo app 50 100 100 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.44827 0.45036 0.00048 0.10712 0.44908 -5.59 0.44897 -5.59 0.700 0.000 147884866 53.39
6 Symfony 2.7.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.74192 0.74530 0.00075 0.10130 0.74315 0.00 0.74302 0.00 0.640 0.999 291621929 40.10
7 Symfony 2.7.0 demo app 50 100 100 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.73961 0.75044 0.00140 0.18906 0.74145 -0.23 0.74126 -0.24 3.044 0.000 290398583 40.50
8 Symfony 2.7.0 demo app 50 100 100 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.74078 0.75200 0.00195 0.26313 0.74281 -0.05 0.74233 -0.09 2.718 0.000 290399697 40.75
9 Symfony 2.7.0 demo app 50 100 100 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.71159 0.71732 0.00094 0.13181 0.71316 -4.04 0.71293 -4.05 1.394 0.000 270758365 47.86
10 Wordpress 6.2 main page 20 100 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.57984 0.59115 0.00156 0.26782 0.58133 0.00 0.58101 0.00 4.938 0.999 1123344467 43.74
11 Wordpress 6.2 main page 20 100 20 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.57872 0.58274 0.00074 0.12690 0.58061 -0.12 0.58050 -0.09 0.559 0.000 1119620949 44.10
12 Wordpress 6.2 main page 20 100 20 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.57795 0.58967 0.00125 0.21525 0.57991 -0.24 0.57970 -0.23 5.079 0.000 1119630528 44.10
13 Wordpress 6.2 main page 20 100 20 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.51279 0.51799 0.00064 0.12355 0.51582 -11.27 0.51577 -11.23 -0.686 0.000 865682454 61.50
14 bench.php 10 100 2 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.42914 0.44979 0.00256 0.58830 0.43468 0.00 0.43467 0.00 2.130 0.999 2020638166 26.57
15 bench.php 10 100 2 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.42457 0.47857 0.00600 1.40031 0.42839 -1.45 0.42692 -1.78 6.300 0.000 2020586699 26.99
16 bench.php 10 100 2 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.42430 0.43622 0.00225 0.52761 0.42738 -1.68 0.42693 -1.78 2.005 0.000 2020586669 26.98
17 bench.php 10 100 2 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.14636 0.15079 0.00100 0.67213 0.14847 -65.84 0.14850 -65.83 0.067 0.000 536605621 27.74

View File

@@ -6746,3 +6746,23 @@ bench.php 10 100 2 PHP - previous master 3977650820 https://github.com/php/php-s
bench.php 10 100 2 PHP - master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.42334 0.47907 0.00595 1.39037 0.42826 -1.52 0.42677 -1.80 6.534 0.000 2020586658 26.99
bench.php 10 100 2 PHP - master (JIT) d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.14621 0.15165 0.00088 0.59038 0.14865 -65.82 0.14866 -65.79 -0.011 0.000 536605646 27.75
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2025/2025_11_19_00_50_19_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.158-178.288.amzn2023.x86_64 Amazon Linux 2023.9.20251117 14.2.1 1 0 0 0 2025-11-19 00:50:19
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Rel std dev % Mean Mean diff % Median Median diff % Skew P-value Instruction count Memory usage
Laravel 12.2.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.47454 0.47753 0.00054 0.11348 0.47566 0.00 0.47555 0.00 0.686 0.999 180943900 43.62
Laravel 12.2.0 demo app 50 100 100 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.46713 0.47184 0.00106 0.22660 0.46858 -1.49 0.46820 -1.55 1.661 0.000 176333430 44.27
Laravel 12.2.0 demo app 50 100 100 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.46643 0.47214 0.00071 0.15184 0.46753 -1.71 0.46743 -1.71 3.145 0.000 176406029 44.27
Laravel 12.2.0 demo app 50 100 100 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.44827 0.45036 0.00048 0.10712 0.44908 -5.59 0.44897 -5.59 0.700 0.000 147884866 53.39
Symfony 2.7.0 demo app 50 100 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.74192 0.74530 0.00075 0.10130 0.74315 0.00 0.74302 0.00 0.640 0.999 291621929 40.10
Symfony 2.7.0 demo app 50 100 100 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.73961 0.75044 0.00140 0.18906 0.74145 -0.23 0.74126 -0.24 3.044 0.000 290398583 40.50
Symfony 2.7.0 demo app 50 100 100 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.74078 0.75200 0.00195 0.26313 0.74281 -0.05 0.74233 -0.09 2.718 0.000 290399697 40.75
Symfony 2.7.0 demo app 50 100 100 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.71159 0.71732 0.00094 0.13181 0.71316 -4.04 0.71293 -4.05 1.394 0.000 270758365 47.86
Wordpress 6.2 main page 20 100 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.57984 0.59115 0.00156 0.26782 0.58133 0.00 0.58101 0.00 4.938 0.999 1123344467 43.74
Wordpress 6.2 main page 20 100 20 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.57872 0.58274 0.00074 0.12690 0.58061 -0.12 0.58050 -0.09 0.559 0.000 1119620949 44.10
Wordpress 6.2 main page 20 100 20 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.57795 0.58967 0.00125 0.21525 0.57991 -0.24 0.57970 -0.23 5.079 0.000 1119630528 44.10
Wordpress 6.2 main page 20 100 20 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.51279 0.51799 0.00064 0.12355 0.51582 -11.27 0.51577 -11.23 -0.686 0.000 865682454 61.50
bench.php 10 100 2 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.42914 0.44979 0.00256 0.58830 0.43468 0.00 0.43467 0.00 2.130 0.999 2020638166 26.57
bench.php 10 100 2 PHP - previous master d750d30a62 https://github.com/php/php-src/commit/d750d30a62 0.42457 0.47857 0.00600 1.40031 0.42839 -1.45 0.42692 -1.78 6.300 0.000 2020586699 26.99
bench.php 10 100 2 PHP - master 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.42430 0.43622 0.00225 0.52761 0.42738 -1.68 0.42693 -1.78 2.005 0.000 2020586669 26.98
bench.php 10 100 2 PHP - master (JIT) 9762c446f0 https://github.com/php/php-src/commit/9762c446f0 0.14636 0.15079 0.00100 0.67213 0.14847 -65.84 0.14850 -65.83 0.067 0.000 536605621 27.74
Can't render this file because it is too large.