This commit is contained in:
Benchmark
2024-11-13 01:28:19 +00:00
parent d6107ccd42
commit 41465a8adf
4 changed files with 107 additions and 0 deletions

View File

@@ -0,0 +1,2 @@
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2024/2024_11_13_00_49_29_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.112-124.190.amzn2023.x86_64 Amazon Linux 2023.6.20241031 11.4.1 1 0 0 0 2024-11-13 00:49:29
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2 2024/2024_11_13_00_49_29_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.112-124.190.amzn2023.x86_64 Amazon Linux 2023.6.20241031 11.4.1 1 0 0 0 2024-11-13 00:49:29

View File

@@ -0,0 +1,60 @@
### AWS x86_64 (c7i.24xl)
| Attribute | Value |
|---------------|----------------|
| Environment |aws|
| Runner |host|
| Instance type |c7i.metal-24xl (dedicated)|
| Architecture |x86_64
| CPU |48 cores|
| CPU settings |disabled deeper C-states, disabled turbo boost, disabled hyper-threading|
| RAM |188 GB|
| Kernel |6.1.112-124.190.amzn2023.x86_64|
| OS |Amazon Linux 2023.6.20241031|
| GCC |11.4.1|
| Time |2024-11-13 00:49:29 UTC|
### Laravel 11.1.2 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.43759|0.43930|0.00039|0.43820|0.00%|0.43812|0.00%|41.86 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/7f5a888bdb)|0.43545|0.43728|0.00042|0.43623|-0.45%|0.43626|-0.42%|41.80 MB|
|[PHP - master](https://github.com/php/php-src/commit/33ba1a4ab9)|0.43501|0.43719|0.00041|0.43605|-0.49%|0.43600|-0.48%|41.80 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/33ba1a4ab9)|0.42527|0.42675|0.00033|0.42602|-2.78%|0.42602|-2.76%|50.85 MB|
### Symfony 2.6.0 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.71783|0.72131|0.00074|0.71934|0.00%|0.71936|0.00%|37.38 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/7f5a888bdb)|0.71355|0.71812|0.00088|0.71500|-0.60%|0.71484|-0.63%|37.50 MB|
|[PHP - master](https://github.com/php/php-src/commit/33ba1a4ab9)|0.71343|0.71625|0.00059|0.71464|-0.65%|0.71449|-0.68%|37.50 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/33ba1a4ab9)|0.69054|0.69328|0.00059|0.69158|-3.86%|0.69150|-3.87%|44.55 MB|
### Wordpress 6.2 main page - 50 consecutive runs, 20 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.58099|0.58404|0.00058|0.58236|0.00%|0.58226|0.00%|43.00 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/7f5a888bdb)|0.57781|0.58034|0.00054|0.57904|-0.57%|0.57901|-0.56%|43.11 MB|
|[PHP - master](https://github.com/php/php-src/commit/33ba1a4ab9)|0.57621|0.58551|0.00137|0.57723|-0.88%|0.57691|-0.92%|43.12 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/33ba1a4ab9)|0.51970|0.52276|0.00051|0.52102|-10.53%|0.52105|-10.51%|62.00 MB|
### bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.21448|0.21918|0.00097|0.21628|0.00%|0.21619|0.00%|26.17 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/7f5a888bdb)|0.21556|0.22173|0.00103|0.21716|0.41%|0.21709|0.42%|26.22 MB|
|[PHP - master](https://github.com/php/php-src/commit/33ba1a4ab9)|0.21533|0.22045|0.00113|0.21685|0.26%|0.21661|0.19%|26.23 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/33ba1a4ab9)|0.07293|0.07727|0.00081|0.07439|-65.60%|0.07420|-65.68%|27.39 MB|
### micro_bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|1.33837|1.36554|0.00591|1.34975|0.00%|1.34921|0.00%|20.42 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/7f5a888bdb)|1.29092|1.32177|0.00675|1.30462|-3.34%|1.30445|-3.32%|20.48 MB|
|[PHP - master](https://github.com/php/php-src/commit/33ba1a4ab9)|1.29321|1.32383|0.00664|1.30668|-3.19%|1.30697|-3.13%|20.48 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/33ba1a4ab9)|0.51973|0.54215|0.00503|0.52810|-60.87%|0.52728|-60.92%|21.80 MB|

View File

@@ -0,0 +1,21 @@
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43759 0.43930 0.00039 0.43820 0.00 0.43812 0.00 0 41.86
Laravel 11.1.2 demo app 50 50 100 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.43545 0.43728 0.00042 0.43623 -0.45 0.43626 -0.42 0 41.80
Laravel 11.1.2 demo app 50 50 100 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.43501 0.43719 0.00041 0.43605 -0.49 0.43600 -0.48 0 41.80
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.42527 0.42675 0.00033 0.42602 -2.78 0.42602 -2.76 0 50.85
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71783 0.72131 0.00074 0.71934 0.00 0.71936 0.00 0 37.38
Symfony 2.6.0 demo app 50 50 100 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.71355 0.71812 0.00088 0.71500 -0.60 0.71484 -0.63 0 37.50
Symfony 2.6.0 demo app 50 50 100 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.71343 0.71625 0.00059 0.71464 -0.65 0.71449 -0.68 0 37.50
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.69054 0.69328 0.00059 0.69158 -3.86 0.69150 -3.87 0 44.55
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58099 0.58404 0.00058 0.58236 0.00 0.58226 0.00 0 43.00
Wordpress 6.2 main page 10 50 20 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.57781 0.58034 0.00054 0.57904 -0.57 0.57901 -0.56 0 43.11
Wordpress 6.2 main page 10 50 20 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.57621 0.58551 0.00137 0.57723 -0.88 0.57691 -0.92 0 43.12
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.51970 0.52276 0.00051 0.52102 -10.53 0.52105 -10.51 0 62.00
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21448 0.21918 0.00097 0.21628 0.00 0.21619 0.00 0 26.17
bench.php 10 50 0 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.21556 0.22173 0.00103 0.21716 0.41 0.21709 0.42 0 26.22
bench.php 10 50 0 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.21533 0.22045 0.00113 0.21685 0.26 0.21661 0.19 0 26.23
bench.php 10 50 0 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.07293 0.07727 0.00081 0.07439 -65.60 0.07420 -65.68 0 27.39
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.33837 1.36554 0.00591 1.34975 0.00 1.34921 0.00 0 20.42
micro_bench.php 10 50 0 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 1.29092 1.32177 0.00675 1.30462 -3.34 1.30445 -3.32 0 20.48
micro_bench.php 10 50 0 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 1.29321 1.32383 0.00664 1.30668 -3.19 1.30697 -3.13 0 20.48
micro_bench.php 10 50 0 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.51973 0.54215 0.00503 0.52810 -60.87 0.52728 -60.92 0 21.80
1 Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
2 Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43759 0.43930 0.00039 0.43820 0.00 0.43812 0.00 0 41.86
3 Laravel 11.1.2 demo app 50 50 100 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.43545 0.43728 0.00042 0.43623 -0.45 0.43626 -0.42 0 41.80
4 Laravel 11.1.2 demo app 50 50 100 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.43501 0.43719 0.00041 0.43605 -0.49 0.43600 -0.48 0 41.80
5 Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.42527 0.42675 0.00033 0.42602 -2.78 0.42602 -2.76 0 50.85
6 Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71783 0.72131 0.00074 0.71934 0.00 0.71936 0.00 0 37.38
7 Symfony 2.6.0 demo app 50 50 100 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.71355 0.71812 0.00088 0.71500 -0.60 0.71484 -0.63 0 37.50
8 Symfony 2.6.0 demo app 50 50 100 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.71343 0.71625 0.00059 0.71464 -0.65 0.71449 -0.68 0 37.50
9 Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.69054 0.69328 0.00059 0.69158 -3.86 0.69150 -3.87 0 44.55
10 Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58099 0.58404 0.00058 0.58236 0.00 0.58226 0.00 0 43.00
11 Wordpress 6.2 main page 10 50 20 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.57781 0.58034 0.00054 0.57904 -0.57 0.57901 -0.56 0 43.11
12 Wordpress 6.2 main page 10 50 20 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.57621 0.58551 0.00137 0.57723 -0.88 0.57691 -0.92 0 43.12
13 Wordpress 6.2 main page 10 50 20 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.51970 0.52276 0.00051 0.52102 -10.53 0.52105 -10.51 0 62.00
14 bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21448 0.21918 0.00097 0.21628 0.00 0.21619 0.00 0 26.17
15 bench.php 10 50 0 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.21556 0.22173 0.00103 0.21716 0.41 0.21709 0.42 0 26.22
16 bench.php 10 50 0 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.21533 0.22045 0.00113 0.21685 0.26 0.21661 0.19 0 26.23
17 bench.php 10 50 0 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.07293 0.07727 0.00081 0.07439 -65.60 0.07420 -65.68 0 27.39
18 micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.33837 1.36554 0.00591 1.34975 0.00 1.34921 0.00 0 20.42
19 micro_bench.php 10 50 0 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 1.29092 1.32177 0.00675 1.30462 -3.34 1.30445 -3.32 0 20.48
20 micro_bench.php 10 50 0 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 1.29321 1.32383 0.00664 1.30668 -3.19 1.30697 -3.13 0 20.48
21 micro_bench.php 10 50 0 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.51973 0.54215 0.00503 0.52810 -60.87 0.52728 -60.92 0 21.80

View File

@@ -1078,3 +1078,27 @@ micro_bench.php 10 50 0 PHP - previous master 53df3ae1e5 https://github.com/php/
micro_bench.php 10 50 0 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 1.28667 1.32273 0.00729 1.30500 -3.22 1.30531 -3.19 0 20.48
micro_bench.php 10 50 0 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.51989 0.53715 0.00406 0.52722 -60.90 0.52690 -60.92 0 21.80
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2024/2024_11_13_00_49_29_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.112-124.190.amzn2023.x86_64 Amazon Linux 2023.6.20241031 11.4.1 1 0 0 0 2024-11-13 00:49:29
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43759 0.43930 0.00039 0.43820 0.00 0.43812 0.00 0 41.86
Laravel 11.1.2 demo app 50 50 100 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.43545 0.43728 0.00042 0.43623 -0.45 0.43626 -0.42 0 41.80
Laravel 11.1.2 demo app 50 50 100 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.43501 0.43719 0.00041 0.43605 -0.49 0.43600 -0.48 0 41.80
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.42527 0.42675 0.00033 0.42602 -2.78 0.42602 -2.76 0 50.85
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71783 0.72131 0.00074 0.71934 0.00 0.71936 0.00 0 37.38
Symfony 2.6.0 demo app 50 50 100 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.71355 0.71812 0.00088 0.71500 -0.60 0.71484 -0.63 0 37.50
Symfony 2.6.0 demo app 50 50 100 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.71343 0.71625 0.00059 0.71464 -0.65 0.71449 -0.68 0 37.50
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.69054 0.69328 0.00059 0.69158 -3.86 0.69150 -3.87 0 44.55
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58099 0.58404 0.00058 0.58236 0.00 0.58226 0.00 0 43.00
Wordpress 6.2 main page 10 50 20 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.57781 0.58034 0.00054 0.57904 -0.57 0.57901 -0.56 0 43.11
Wordpress 6.2 main page 10 50 20 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.57621 0.58551 0.00137 0.57723 -0.88 0.57691 -0.92 0 43.12
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.51970 0.52276 0.00051 0.52102 -10.53 0.52105 -10.51 0 62.00
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21448 0.21918 0.00097 0.21628 0.00 0.21619 0.00 0 26.17
bench.php 10 50 0 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.21556 0.22173 0.00103 0.21716 0.41 0.21709 0.42 0 26.22
bench.php 10 50 0 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.21533 0.22045 0.00113 0.21685 0.26 0.21661 0.19 0 26.23
bench.php 10 50 0 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.07293 0.07727 0.00081 0.07439 -65.60 0.07420 -65.68 0 27.39
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.33837 1.36554 0.00591 1.34975 0.00 1.34921 0.00 0 20.42
micro_bench.php 10 50 0 PHP - previous master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 1.29092 1.32177 0.00675 1.30462 -3.34 1.30445 -3.32 0 20.48
micro_bench.php 10 50 0 PHP - master 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 1.29321 1.32383 0.00664 1.30668 -3.19 1.30697 -3.13 0 20.48
micro_bench.php 10 50 0 PHP - master (JIT) 33ba1a4ab9 https://github.com/php/php-src/commit/33ba1a4ab9 0.51973 0.54215 0.00503 0.52810 -60.87 0.52728 -60.92 0 21.80
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
1078
1079
1080
1081
1082
1083
1084
1085
1086
1087
1088
1089
1090
1091
1092
1093
1094
1095
1096
1097
1098
1099
1100
1101
1102
1103
1104