This commit is contained in:
Benchmark
2024-11-12 01:29:14 +00:00
parent d61d7342f8
commit d6107ccd42
4 changed files with 107 additions and 0 deletions

View File

@@ -0,0 +1,2 @@
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2024/2024_11_12_00_49_37_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.112-124.190.amzn2023.x86_64 Amazon Linux 2023.6.20241031 11.4.1 1 0 0 0 2024-11-12 00:49:37
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2 2024/2024_11_12_00_49_37_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.112-124.190.amzn2023.x86_64 Amazon Linux 2023.6.20241031 11.4.1 1 0 0 0 2024-11-12 00:49:37

View File

@@ -0,0 +1,60 @@
### AWS x86_64 (c7i.24xl)
| Attribute | Value |
|---------------|----------------|
| Environment |aws|
| Runner |host|
| Instance type |c7i.metal-24xl (dedicated)|
| Architecture |x86_64
| CPU |48 cores|
| CPU settings |disabled deeper C-states, disabled turbo boost, disabled hyper-threading|
| RAM |188 GB|
| Kernel |6.1.112-124.190.amzn2023.x86_64|
| OS |Amazon Linux 2023.6.20241031|
| GCC |11.4.1|
| Time |2024-11-12 00:49:37 UTC|
### Laravel 11.1.2 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.43891|0.44182|0.00046|0.43955|0.00%|0.43948|0.00%|41.86 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/53df3ae1e5)|0.43578|0.43752|0.00038|0.43651|-0.69%|0.43649|-0.68%|41.79 MB|
|[PHP - master](https://github.com/php/php-src/commit/7f5a888bdb)|0.43634|0.43910|0.00054|0.43739|-0.49%|0.43731|-0.49%|41.79 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/7f5a888bdb)|0.42621|0.42841|0.00043|0.42734|-2.78%|0.42734|-2.76%|50.85 MB|
### Symfony 2.6.0 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.71964|0.72415|0.00096|0.72113|0.00%|0.72097|0.00%|37.38 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/53df3ae1e5)|0.71615|0.72107|0.00096|0.71742|-0.51%|0.71739|-0.50%|37.49 MB|
|[PHP - master](https://github.com/php/php-src/commit/7f5a888bdb)|0.71492|0.71914|0.00074|0.71671|-0.61%|0.71668|-0.59%|37.49 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/7f5a888bdb)|0.69285|0.69534|0.00061|0.69416|-3.74%|0.69410|-3.73%|44.55 MB|
### Wordpress 6.2 main page - 50 consecutive runs, 20 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.58214|0.58487|0.00066|0.58328|0.00%|0.58329|0.00%|43.00 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/53df3ae1e5)|0.57873|0.58214|0.00070|0.58002|-0.56%|0.57985|-0.59%|43.11 MB|
|[PHP - master](https://github.com/php/php-src/commit/7f5a888bdb)|0.57768|0.58154|0.00087|0.57899|-0.73%|0.57887|-0.76%|43.11 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/7f5a888bdb)|0.52074|0.52377|0.00074|0.52216|-10.48%|0.52208|-10.49%|62.00 MB|
### bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.21566|0.21932|0.00092|0.21722|0.00%|0.21698|0.00%|26.16 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/53df3ae1e5)|0.21156|0.21691|0.00100|0.21300|-1.94%|0.21277|-1.94%|26.22 MB|
|[PHP - master](https://github.com/php/php-src/commit/7f5a888bdb)|0.21510|0.21928|0.00089|0.21635|-0.40%|0.21617|-0.38%|26.22 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/7f5a888bdb)|0.07317|0.07637|0.00072|0.07473|-65.60%|0.07468|-65.58%|27.39 MB|
### micro_bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|1.33925|1.36724|0.00520|1.34846|0.00%|1.34827|0.00%|20.42 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/53df3ae1e5)|1.27738|1.30351|0.00429|1.28861|-4.44%|1.28876|-4.41%|20.48 MB|
|[PHP - master](https://github.com/php/php-src/commit/7f5a888bdb)|1.28667|1.32273|0.00729|1.30500|-3.22%|1.30531|-3.19%|20.48 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/7f5a888bdb)|0.51989|0.53715|0.00406|0.52722|-60.90%|0.52690|-60.92%|21.80 MB|

View File

@@ -0,0 +1,21 @@
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43891 0.44182 0.00046 0.43955 0.00 0.43948 0.00 0 41.86
Laravel 11.1.2 demo app 50 50 100 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.43578 0.43752 0.00038 0.43651 -0.69 0.43649 -0.68 0 41.79
Laravel 11.1.2 demo app 50 50 100 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.43634 0.43910 0.00054 0.43739 -0.49 0.43731 -0.49 0 41.79
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.42621 0.42841 0.00043 0.42734 -2.78 0.42734 -2.76 0 50.85
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71964 0.72415 0.00096 0.72113 0.00 0.72097 0.00 0 37.38
Symfony 2.6.0 demo app 50 50 100 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.71615 0.72107 0.00096 0.71742 -0.51 0.71739 -0.50 0 37.49
Symfony 2.6.0 demo app 50 50 100 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.71492 0.71914 0.00074 0.71671 -0.61 0.71668 -0.59 0 37.49
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.69285 0.69534 0.00061 0.69416 -3.74 0.69410 -3.73 0 44.55
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58214 0.58487 0.00066 0.58328 0.00 0.58329 0.00 0 43.00
Wordpress 6.2 main page 10 50 20 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.57873 0.58214 0.00070 0.58002 -0.56 0.57985 -0.59 0 43.11
Wordpress 6.2 main page 10 50 20 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.57768 0.58154 0.00087 0.57899 -0.73 0.57887 -0.76 0 43.11
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.52074 0.52377 0.00074 0.52216 -10.48 0.52208 -10.49 0 62.00
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21566 0.21932 0.00092 0.21722 0.00 0.21698 0.00 0 26.16
bench.php 10 50 0 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.21156 0.21691 0.00100 0.21300 -1.94 0.21277 -1.94 0 26.22
bench.php 10 50 0 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.21510 0.21928 0.00089 0.21635 -0.40 0.21617 -0.38 0 26.22
bench.php 10 50 0 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.07317 0.07637 0.00072 0.07473 -65.60 0.07468 -65.58 0 27.39
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.33925 1.36724 0.00520 1.34846 0.00 1.34827 0.00 0 20.42
micro_bench.php 10 50 0 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 1.27738 1.30351 0.00429 1.28861 -4.44 1.28876 -4.41 0 20.48
micro_bench.php 10 50 0 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 1.28667 1.32273 0.00729 1.30500 -3.22 1.30531 -3.19 0 20.48
micro_bench.php 10 50 0 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.51989 0.53715 0.00406 0.52722 -60.90 0.52690 -60.92 0 21.80
1 Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
2 Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43891 0.44182 0.00046 0.43955 0.00 0.43948 0.00 0 41.86
3 Laravel 11.1.2 demo app 50 50 100 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.43578 0.43752 0.00038 0.43651 -0.69 0.43649 -0.68 0 41.79
4 Laravel 11.1.2 demo app 50 50 100 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.43634 0.43910 0.00054 0.43739 -0.49 0.43731 -0.49 0 41.79
5 Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.42621 0.42841 0.00043 0.42734 -2.78 0.42734 -2.76 0 50.85
6 Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71964 0.72415 0.00096 0.72113 0.00 0.72097 0.00 0 37.38
7 Symfony 2.6.0 demo app 50 50 100 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.71615 0.72107 0.00096 0.71742 -0.51 0.71739 -0.50 0 37.49
8 Symfony 2.6.0 demo app 50 50 100 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.71492 0.71914 0.00074 0.71671 -0.61 0.71668 -0.59 0 37.49
9 Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.69285 0.69534 0.00061 0.69416 -3.74 0.69410 -3.73 0 44.55
10 Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58214 0.58487 0.00066 0.58328 0.00 0.58329 0.00 0 43.00
11 Wordpress 6.2 main page 10 50 20 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.57873 0.58214 0.00070 0.58002 -0.56 0.57985 -0.59 0 43.11
12 Wordpress 6.2 main page 10 50 20 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.57768 0.58154 0.00087 0.57899 -0.73 0.57887 -0.76 0 43.11
13 Wordpress 6.2 main page 10 50 20 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.52074 0.52377 0.00074 0.52216 -10.48 0.52208 -10.49 0 62.00
14 bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21566 0.21932 0.00092 0.21722 0.00 0.21698 0.00 0 26.16
15 bench.php 10 50 0 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.21156 0.21691 0.00100 0.21300 -1.94 0.21277 -1.94 0 26.22
16 bench.php 10 50 0 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.21510 0.21928 0.00089 0.21635 -0.40 0.21617 -0.38 0 26.22
17 bench.php 10 50 0 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.07317 0.07637 0.00072 0.07473 -65.60 0.07468 -65.58 0 27.39
18 micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.33925 1.36724 0.00520 1.34846 0.00 1.34827 0.00 0 20.42
19 micro_bench.php 10 50 0 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 1.27738 1.30351 0.00429 1.28861 -4.44 1.28876 -4.41 0 20.48
20 micro_bench.php 10 50 0 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 1.28667 1.32273 0.00729 1.30500 -3.22 1.30531 -3.19 0 20.48
21 micro_bench.php 10 50 0 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.51989 0.53715 0.00406 0.52722 -60.90 0.52690 -60.92 0 21.80

View File

@@ -1054,3 +1054,27 @@ micro_bench.php 10 50 0 PHP - previous master 62e53e6f49 https://github.com/php/
micro_bench.php 10 50 0 PHP - master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 1.27739 1.30127 0.00498 1.28840 -6.88 1.28764 -6.95 0 20.48
micro_bench.php 10 50 0 PHP - master (JIT) 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.53487 0.55333 0.00383 0.54291 -60.76 0.54224 -60.81 0 21.80
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2024/2024_11_12_00_49_37_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.112-124.190.amzn2023.x86_64 Amazon Linux 2023.6.20241031 11.4.1 1 0 0 0 2024-11-12 00:49:37
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43891 0.44182 0.00046 0.43955 0.00 0.43948 0.00 0 41.86
Laravel 11.1.2 demo app 50 50 100 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.43578 0.43752 0.00038 0.43651 -0.69 0.43649 -0.68 0 41.79
Laravel 11.1.2 demo app 50 50 100 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.43634 0.43910 0.00054 0.43739 -0.49 0.43731 -0.49 0 41.79
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.42621 0.42841 0.00043 0.42734 -2.78 0.42734 -2.76 0 50.85
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71964 0.72415 0.00096 0.72113 0.00 0.72097 0.00 0 37.38
Symfony 2.6.0 demo app 50 50 100 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.71615 0.72107 0.00096 0.71742 -0.51 0.71739 -0.50 0 37.49
Symfony 2.6.0 demo app 50 50 100 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.71492 0.71914 0.00074 0.71671 -0.61 0.71668 -0.59 0 37.49
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.69285 0.69534 0.00061 0.69416 -3.74 0.69410 -3.73 0 44.55
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58214 0.58487 0.00066 0.58328 0.00 0.58329 0.00 0 43.00
Wordpress 6.2 main page 10 50 20 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.57873 0.58214 0.00070 0.58002 -0.56 0.57985 -0.59 0 43.11
Wordpress 6.2 main page 10 50 20 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.57768 0.58154 0.00087 0.57899 -0.73 0.57887 -0.76 0 43.11
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.52074 0.52377 0.00074 0.52216 -10.48 0.52208 -10.49 0 62.00
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21566 0.21932 0.00092 0.21722 0.00 0.21698 0.00 0 26.16
bench.php 10 50 0 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 0.21156 0.21691 0.00100 0.21300 -1.94 0.21277 -1.94 0 26.22
bench.php 10 50 0 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.21510 0.21928 0.00089 0.21635 -0.40 0.21617 -0.38 0 26.22
bench.php 10 50 0 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.07317 0.07637 0.00072 0.07473 -65.60 0.07468 -65.58 0 27.39
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.33925 1.36724 0.00520 1.34846 0.00 1.34827 0.00 0 20.42
micro_bench.php 10 50 0 PHP - previous master 53df3ae1e5 https://github.com/php/php-src/commit/53df3ae1e5 1.27738 1.30351 0.00429 1.28861 -4.44 1.28876 -4.41 0 20.48
micro_bench.php 10 50 0 PHP - master 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 1.28667 1.32273 0.00729 1.30500 -3.22 1.30531 -3.19 0 20.48
micro_bench.php 10 50 0 PHP - master (JIT) 7f5a888bdb https://github.com/php/php-src/commit/7f5a888bdb 0.51989 0.53715 0.00406 0.52722 -60.90 0.52690 -60.92 0 21.80
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
1054
1055
1056
1057
1058
1059
1060
1061
1062
1063
1064
1065
1066
1067
1068
1069
1070
1071
1072
1073
1074
1075
1076
1077
1078
1079
1080