This commit is contained in:
Benchmark
2024-12-08 01:28:00 +00:00
parent dd60a81c32
commit 018fb4aa79
4 changed files with 107 additions and 0 deletions

View File

@@ -0,0 +1,2 @@
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2024/2024_12_08_00_49_54_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.115-126.197.amzn2023.x86_64 Amazon Linux 2023.6.20241121 11.4.1 1 0 0 0 2024-12-08 00:49:54
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2 2024/2024_12_08_00_49_54_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.115-126.197.amzn2023.x86_64 Amazon Linux 2023.6.20241121 11.4.1 1 0 0 0 2024-12-08 00:49:54

View File

@@ -0,0 +1,60 @@
### AWS x86_64 (c7i.24xl)
| Attribute | Value |
|---------------|----------------|
| Environment |aws|
| Runner |host|
| Instance type |c7i.metal-24xl (dedicated)|
| Architecture |x86_64
| CPU |48 cores|
| CPU settings |disabled deeper C-states, disabled turbo boost, disabled hyper-threading|
| RAM |188 GB|
| Kernel |6.1.115-126.197.amzn2023.x86_64|
| OS |Amazon Linux 2023.6.20241121|
| GCC |11.4.1|
| Time |2024-12-08 00:49:54 UTC|
### Laravel 11.1.2 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.43972|0.44448|0.00107|0.44206|0.00%|0.44232|0.00%|41.83 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/a7aba3571f)|0.44084|0.44329|0.00058|0.44186|-0.05%|0.44180|-0.12%|41.70 MB|
|[PHP - master](https://github.com/php/php-src/commit/c5d9c7da9e)|0.44094|0.44319|0.00044|0.44218|0.03%|0.44213|-0.04%|41.70 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c5d9c7da9e)|0.42795|0.43054|0.00049|0.42881|-3.00%|0.42880|-3.06%|50.76 MB|
### Symfony 2.6.0 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.71686|0.72070|0.00085|0.71851|0.00%|0.71851|0.00%|37.35 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/a7aba3571f)|0.71507|0.71888|0.00086|0.71667|-0.26%|0.71655|-0.27%|37.40 MB|
|[PHP - master](https://github.com/php/php-src/commit/c5d9c7da9e)|0.71524|0.71953|0.00103|0.71686|-0.23%|0.71674|-0.25%|37.40 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c5d9c7da9e)|0.68749|0.69059|0.00066|0.68862|-4.16%|0.68857|-4.17%|44.47 MB|
### Wordpress 6.2 main page - 50 consecutive runs, 20 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.58255|0.58549|0.00062|0.58382|0.00%|0.58380|0.00%|42.96 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/a7aba3571f)|0.57888|0.58247|0.00082|0.58057|-0.56%|0.58067|-0.54%|42.83 MB|
|[PHP - master](https://github.com/php/php-src/commit/c5d9c7da9e)|0.57907|0.58361|0.00080|0.58014|-0.63%|0.57999|-0.65%|42.83 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c5d9c7da9e)|0.52022|0.52235|0.00053|0.52129|-10.71%|0.52122|-10.72%|61.64 MB|
### bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.21539|0.22230|0.00116|0.21717|0.00%|0.21689|0.00%|26.13 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/a7aba3571f)|0.21518|0.21911|0.00083|0.21621|-0.44%|0.21600|-0.41%|26.07 MB|
|[PHP - master](https://github.com/php/php-src/commit/c5d9c7da9e)|0.21491|0.21760|0.00064|0.21620|-0.45%|0.21626|-0.29%|26.07 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c5d9c7da9e)|0.07405|0.07752|0.00084|0.07531|-65.32%|0.07518|-65.34%|27.24 MB|
### micro_bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|1.34711|1.36954|0.00617|1.35793|0.00%|1.35724|0.00%|20.39 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/a7aba3571f)|1.25338|1.27544|0.00417|1.26419|-6.90%|1.26418|-6.86%|20.32 MB|
|[PHP - master](https://github.com/php/php-src/commit/c5d9c7da9e)|1.25607|1.27897|0.00494|1.26488|-6.85%|1.26475|-6.81%|20.33 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c5d9c7da9e)|0.53465|0.55395|0.00408|0.54585|-59.80%|0.54646|-59.74%|21.65 MB|

View File

@@ -0,0 +1,21 @@
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43972 0.44448 0.00107 0.44206 0.00 0.44232 0.00 0 41.83
Laravel 11.1.2 demo app 50 50 100 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.44084 0.44329 0.00058 0.44186 -0.05 0.44180 -0.12 0 41.70
Laravel 11.1.2 demo app 50 50 100 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.44094 0.44319 0.00044 0.44218 0.03 0.44213 -0.04 0 41.70
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.42795 0.43054 0.00049 0.42881 -3.00 0.42880 -3.06 0 50.76
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71686 0.72070 0.00085 0.71851 0.00 0.71851 0.00 0 37.35
Symfony 2.6.0 demo app 50 50 100 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.71507 0.71888 0.00086 0.71667 -0.26 0.71655 -0.27 0 37.40
Symfony 2.6.0 demo app 50 50 100 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.71524 0.71953 0.00103 0.71686 -0.23 0.71674 -0.25 0 37.40
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.68749 0.69059 0.00066 0.68862 -4.16 0.68857 -4.17 0 44.47
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58255 0.58549 0.00062 0.58382 0.00 0.58380 0.00 0 42.96
Wordpress 6.2 main page 10 50 20 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.57888 0.58247 0.00082 0.58057 -0.56 0.58067 -0.54 0 42.83
Wordpress 6.2 main page 10 50 20 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.57907 0.58361 0.00080 0.58014 -0.63 0.57999 -0.65 0 42.83
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.52022 0.52235 0.00053 0.52129 -10.71 0.52122 -10.72 0 61.64
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21539 0.22230 0.00116 0.21717 0.00 0.21689 0.00 0 26.13
bench.php 10 50 0 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.21518 0.21911 0.00083 0.21621 -0.44 0.21600 -0.41 0 26.07
bench.php 10 50 0 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.21491 0.21760 0.00064 0.21620 -0.45 0.21626 -0.29 0 26.07
bench.php 10 50 0 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.07405 0.07752 0.00084 0.07531 -65.32 0.07518 -65.34 0 27.24
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.34711 1.36954 0.00617 1.35793 0.00 1.35724 0.00 0 20.39
micro_bench.php 10 50 0 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 1.25338 1.27544 0.00417 1.26419 -6.90 1.26418 -6.86 0 20.32
micro_bench.php 10 50 0 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 1.25607 1.27897 0.00494 1.26488 -6.85 1.26475 -6.81 0 20.33
micro_bench.php 10 50 0 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.53465 0.55395 0.00408 0.54585 -59.80 0.54646 -59.74 0 21.65
1 Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
2 Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43972 0.44448 0.00107 0.44206 0.00 0.44232 0.00 0 41.83
3 Laravel 11.1.2 demo app 50 50 100 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.44084 0.44329 0.00058 0.44186 -0.05 0.44180 -0.12 0 41.70
4 Laravel 11.1.2 demo app 50 50 100 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.44094 0.44319 0.00044 0.44218 0.03 0.44213 -0.04 0 41.70
5 Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.42795 0.43054 0.00049 0.42881 -3.00 0.42880 -3.06 0 50.76
6 Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71686 0.72070 0.00085 0.71851 0.00 0.71851 0.00 0 37.35
7 Symfony 2.6.0 demo app 50 50 100 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.71507 0.71888 0.00086 0.71667 -0.26 0.71655 -0.27 0 37.40
8 Symfony 2.6.0 demo app 50 50 100 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.71524 0.71953 0.00103 0.71686 -0.23 0.71674 -0.25 0 37.40
9 Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.68749 0.69059 0.00066 0.68862 -4.16 0.68857 -4.17 0 44.47
10 Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58255 0.58549 0.00062 0.58382 0.00 0.58380 0.00 0 42.96
11 Wordpress 6.2 main page 10 50 20 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.57888 0.58247 0.00082 0.58057 -0.56 0.58067 -0.54 0 42.83
12 Wordpress 6.2 main page 10 50 20 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.57907 0.58361 0.00080 0.58014 -0.63 0.57999 -0.65 0 42.83
13 Wordpress 6.2 main page 10 50 20 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.52022 0.52235 0.00053 0.52129 -10.71 0.52122 -10.72 0 61.64
14 bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21539 0.22230 0.00116 0.21717 0.00 0.21689 0.00 0 26.13
15 bench.php 10 50 0 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.21518 0.21911 0.00083 0.21621 -0.44 0.21600 -0.41 0 26.07
16 bench.php 10 50 0 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.21491 0.21760 0.00064 0.21620 -0.45 0.21626 -0.29 0 26.07
17 bench.php 10 50 0 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.07405 0.07752 0.00084 0.07531 -65.32 0.07518 -65.34 0 27.24
18 micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.34711 1.36954 0.00617 1.35793 0.00 1.35724 0.00 0 20.39
19 micro_bench.php 10 50 0 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 1.25338 1.27544 0.00417 1.26419 -6.90 1.26418 -6.86 0 20.32
20 micro_bench.php 10 50 0 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 1.25607 1.27897 0.00494 1.26488 -6.85 1.26475 -6.81 0 20.33
21 micro_bench.php 10 50 0 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.53465 0.55395 0.00408 0.54585 -59.80 0.54646 -59.74 0 21.65

View File

@@ -1654,3 +1654,27 @@ micro_bench.php 10 50 0 PHP - previous master 2b80b2e5ec https://github.com/php/
micro_bench.php 10 50 0 PHP - master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 1.24866 1.27223 0.00503 1.26199 -6.72 1.26217 -6.67 0 20.32
micro_bench.php 10 50 0 PHP - master (JIT) a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.53428 0.55900 0.00594 0.54531 -59.69 0.54537 -59.67 0 21.64
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2024/2024_12_08_00_49_54_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.115-126.197.amzn2023.x86_64 Amazon Linux 2023.6.20241121 11.4.1 1 0 0 0 2024-12-08 00:49:54
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43972 0.44448 0.00107 0.44206 0.00 0.44232 0.00 0 41.83
Laravel 11.1.2 demo app 50 50 100 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.44084 0.44329 0.00058 0.44186 -0.05 0.44180 -0.12 0 41.70
Laravel 11.1.2 demo app 50 50 100 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.44094 0.44319 0.00044 0.44218 0.03 0.44213 -0.04 0 41.70
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.42795 0.43054 0.00049 0.42881 -3.00 0.42880 -3.06 0 50.76
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71686 0.72070 0.00085 0.71851 0.00 0.71851 0.00 0 37.35
Symfony 2.6.0 demo app 50 50 100 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.71507 0.71888 0.00086 0.71667 -0.26 0.71655 -0.27 0 37.40
Symfony 2.6.0 demo app 50 50 100 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.71524 0.71953 0.00103 0.71686 -0.23 0.71674 -0.25 0 37.40
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.68749 0.69059 0.00066 0.68862 -4.16 0.68857 -4.17 0 44.47
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58255 0.58549 0.00062 0.58382 0.00 0.58380 0.00 0 42.96
Wordpress 6.2 main page 10 50 20 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.57888 0.58247 0.00082 0.58057 -0.56 0.58067 -0.54 0 42.83
Wordpress 6.2 main page 10 50 20 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.57907 0.58361 0.00080 0.58014 -0.63 0.57999 -0.65 0 42.83
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.52022 0.52235 0.00053 0.52129 -10.71 0.52122 -10.72 0 61.64
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21539 0.22230 0.00116 0.21717 0.00 0.21689 0.00 0 26.13
bench.php 10 50 0 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 0.21518 0.21911 0.00083 0.21621 -0.44 0.21600 -0.41 0 26.07
bench.php 10 50 0 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.21491 0.21760 0.00064 0.21620 -0.45 0.21626 -0.29 0 26.07
bench.php 10 50 0 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.07405 0.07752 0.00084 0.07531 -65.32 0.07518 -65.34 0 27.24
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.34711 1.36954 0.00617 1.35793 0.00 1.35724 0.00 0 20.39
micro_bench.php 10 50 0 PHP - previous master a7aba3571f https://github.com/php/php-src/commit/a7aba3571f 1.25338 1.27544 0.00417 1.26419 -6.90 1.26418 -6.86 0 20.32
micro_bench.php 10 50 0 PHP - master c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 1.25607 1.27897 0.00494 1.26488 -6.85 1.26475 -6.81 0 20.33
micro_bench.php 10 50 0 PHP - master (JIT) c5d9c7da9e https://github.com/php/php-src/commit/c5d9c7da9e 0.53465 0.55395 0.00408 0.54585 -59.80 0.54646 -59.74 0 21.65
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
1654
1655
1656
1657
1658
1659
1660
1661
1662
1663
1664
1665
1666
1667
1668
1669
1670
1671
1672
1673
1674
1675
1676
1677
1678
1679
1680