This commit is contained in:
Benchmark
2024-12-21 01:28:46 +00:00
parent 866f6e0f2e
commit a48710a95b
4 changed files with 107 additions and 0 deletions

View File

@@ -0,0 +1,2 @@
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2024/2024_12_21_00_49_28_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.119-129.201.amzn2023.x86_64 Amazon Linux 2023.6.20241212 11.4.1 1 0 0 0 2024-12-21 00:49:28
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2 2024/2024_12_21_00_49_28_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.119-129.201.amzn2023.x86_64 Amazon Linux 2023.6.20241212 11.4.1 1 0 0 0 2024-12-21 00:49:28

View File

@@ -0,0 +1,60 @@
### AWS x86_64 (c7i.24xl)
| Attribute | Value |
|---------------|----------------|
| Environment |aws|
| Runner |host|
| Instance type |c7i.metal-24xl (dedicated)|
| Architecture |x86_64
| CPU |48 cores|
| CPU settings |disabled deeper C-states, disabled turbo boost, disabled hyper-threading|
| RAM |188 GB|
| Kernel |6.1.119-129.201.amzn2023.x86_64|
| OS |Amazon Linux 2023.6.20241212|
| GCC |11.4.1|
| Time |2024-12-21 00:49:28 UTC|
### Laravel 11.1.2 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.43848|0.44077|0.00046|0.43960|0.00%|0.43954|0.00%|41.82 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/4b1c3cf0b6)|0.43424|0.43658|0.00051|0.43514|-1.02%|0.43510|-1.01%|41.69 MB|
|[PHP - master](https://github.com/php/php-src/commit/afc1f0d99b)|0.43518|0.43754|0.00046|0.43612|-0.79%|0.43610|-0.78%|41.69 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/afc1f0d99b)|0.42373|0.42531|0.00036|0.42453|-3.43%|0.42454|-3.41%|50.75 MB|
### Symfony 2.6.0 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.71301|0.71679|0.00078|0.71412|0.00%|0.71398|0.00%|37.33 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/4b1c3cf0b6)|0.70954|0.72530|0.00223|0.71137|-0.38%|0.71087|-0.43%|37.39 MB|
|[PHP - master](https://github.com/php/php-src/commit/afc1f0d99b)|0.70888|0.71315|0.00077|0.71053|-0.50%|0.71044|-0.50%|37.39 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/afc1f0d99b)|0.68102|0.68424|0.00064|0.68215|-4.48%|0.68213|-4.46%|44.47 MB|
### Wordpress 6.2 main page - 50 consecutive runs, 20 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.58090|0.58363|0.00055|0.58202|0.00%|0.58191|0.00%|42.95 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/4b1c3cf0b6)|0.57727|0.57994|0.00058|0.57838|-0.63%|0.57829|-0.62%|42.79 MB|
|[PHP - master](https://github.com/php/php-src/commit/afc1f0d99b)|0.57501|0.57987|0.00069|0.57845|-0.61%|0.57841|-0.60%|42.79 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/afc1f0d99b)|0.51905|0.52173|0.00051|0.52019|-10.62%|0.52011|-10.62%|61.87 MB|
### bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.21497|0.21983|0.00108|0.21682|0.00%|0.21667|0.00%|26.12 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/4b1c3cf0b6)|0.21538|0.21847|0.00065|0.21664|-0.09%|0.21661|-0.03%|26.06 MB|
|[PHP - master](https://github.com/php/php-src/commit/afc1f0d99b)|0.21411|0.21820|0.00078|0.21546|-0.63%|0.21534|-0.61%|26.06 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/afc1f0d99b)|0.07391|0.07748|0.00083|0.07526|-65.29%|0.07504|-65.37%|27.23 MB|
### micro_bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|1.34019|1.36753|0.00638|1.35414|0.00%|1.35402|0.00%|20.38 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/4b1c3cf0b6)|1.34009|1.36546|0.00618|1.35140|-0.20%|1.35100|-0.22%|20.32 MB|
|[PHP - master](https://github.com/php/php-src/commit/afc1f0d99b)|1.30362|1.32994|0.00734|1.31635|-2.79%|1.31682|-2.75%|20.32 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/afc1f0d99b)|0.54852|0.57380|0.00604|0.56259|-58.45%|0.56314|-58.41%|21.65 MB|

View File

@@ -0,0 +1,21 @@
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43848 0.44077 0.00046 0.43960 0.00 0.43954 0.00 0 41.82
Laravel 11.1.2 demo app 50 50 100 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.43424 0.43658 0.00051 0.43514 -1.02 0.43510 -1.01 0 41.69
Laravel 11.1.2 demo app 50 50 100 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.43518 0.43754 0.00046 0.43612 -0.79 0.43610 -0.78 0 41.69
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.42373 0.42531 0.00036 0.42453 -3.43 0.42454 -3.41 0 50.75
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71301 0.71679 0.00078 0.71412 0.00 0.71398 0.00 0 37.33
Symfony 2.6.0 demo app 50 50 100 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.70954 0.72530 0.00223 0.71137 -0.38 0.71087 -0.43 0 37.39
Symfony 2.6.0 demo app 50 50 100 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.70888 0.71315 0.00077 0.71053 -0.50 0.71044 -0.50 0 37.39
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.68102 0.68424 0.00064 0.68215 -4.48 0.68213 -4.46 0 44.47
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58090 0.58363 0.00055 0.58202 0.00 0.58191 0.00 0 42.95
Wordpress 6.2 main page 10 50 20 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.57727 0.57994 0.00058 0.57838 -0.63 0.57829 -0.62 0 42.79
Wordpress 6.2 main page 10 50 20 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.57501 0.57987 0.00069 0.57845 -0.61 0.57841 -0.60 0 42.79
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.51905 0.52173 0.00051 0.52019 -10.62 0.52011 -10.62 0 61.87
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21497 0.21983 0.00108 0.21682 0.00 0.21667 0.00 0 26.12
bench.php 10 50 0 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.21538 0.21847 0.00065 0.21664 -0.09 0.21661 -0.03 0 26.06
bench.php 10 50 0 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.21411 0.21820 0.00078 0.21546 -0.63 0.21534 -0.61 0 26.06
bench.php 10 50 0 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.07391 0.07748 0.00083 0.07526 -65.29 0.07504 -65.37 0 27.23
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.34019 1.36753 0.00638 1.35414 0.00 1.35402 0.00 0 20.38
micro_bench.php 10 50 0 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 1.34009 1.36546 0.00618 1.35140 -0.20 1.35100 -0.22 0 20.32
micro_bench.php 10 50 0 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 1.30362 1.32994 0.00734 1.31635 -2.79 1.31682 -2.75 0 20.32
micro_bench.php 10 50 0 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.54852 0.57380 0.00604 0.56259 -58.45 0.56314 -58.41 0 21.65
1 Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
2 Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43848 0.44077 0.00046 0.43960 0.00 0.43954 0.00 0 41.82
3 Laravel 11.1.2 demo app 50 50 100 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.43424 0.43658 0.00051 0.43514 -1.02 0.43510 -1.01 0 41.69
4 Laravel 11.1.2 demo app 50 50 100 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.43518 0.43754 0.00046 0.43612 -0.79 0.43610 -0.78 0 41.69
5 Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.42373 0.42531 0.00036 0.42453 -3.43 0.42454 -3.41 0 50.75
6 Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71301 0.71679 0.00078 0.71412 0.00 0.71398 0.00 0 37.33
7 Symfony 2.6.0 demo app 50 50 100 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.70954 0.72530 0.00223 0.71137 -0.38 0.71087 -0.43 0 37.39
8 Symfony 2.6.0 demo app 50 50 100 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.70888 0.71315 0.00077 0.71053 -0.50 0.71044 -0.50 0 37.39
9 Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.68102 0.68424 0.00064 0.68215 -4.48 0.68213 -4.46 0 44.47
10 Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58090 0.58363 0.00055 0.58202 0.00 0.58191 0.00 0 42.95
11 Wordpress 6.2 main page 10 50 20 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.57727 0.57994 0.00058 0.57838 -0.63 0.57829 -0.62 0 42.79
12 Wordpress 6.2 main page 10 50 20 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.57501 0.57987 0.00069 0.57845 -0.61 0.57841 -0.60 0 42.79
13 Wordpress 6.2 main page 10 50 20 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.51905 0.52173 0.00051 0.52019 -10.62 0.52011 -10.62 0 61.87
14 bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21497 0.21983 0.00108 0.21682 0.00 0.21667 0.00 0 26.12
15 bench.php 10 50 0 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.21538 0.21847 0.00065 0.21664 -0.09 0.21661 -0.03 0 26.06
16 bench.php 10 50 0 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.21411 0.21820 0.00078 0.21546 -0.63 0.21534 -0.61 0 26.06
17 bench.php 10 50 0 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.07391 0.07748 0.00083 0.07526 -65.29 0.07504 -65.37 0 27.23
18 micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.34019 1.36753 0.00638 1.35414 0.00 1.35402 0.00 0 20.38
19 micro_bench.php 10 50 0 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 1.34009 1.36546 0.00618 1.35140 -0.20 1.35100 -0.22 0 20.32
20 micro_bench.php 10 50 0 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 1.30362 1.32994 0.00734 1.31635 -2.79 1.31682 -2.75 0 20.32
21 micro_bench.php 10 50 0 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.54852 0.57380 0.00604 0.56259 -58.45 0.56314 -58.41 0 21.65

View File

@@ -1966,3 +1966,27 @@ micro_bench.php 10 50 0 PHP - previous master 8aac6987c2 https://github.com/php/
micro_bench.php 10 50 0 PHP - master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 1.33497 1.35976 0.00583 1.34581 -0.51 1.34487 -0.53 0 20.32
micro_bench.php 10 50 0 PHP - master (JIT) 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.53263 0.55081 0.00384 0.54149 -59.97 0.54108 -59.98 0 21.65
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2024/2024_12_21_00_49_28_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.119-129.201.amzn2023.x86_64 Amazon Linux 2023.6.20241212 11.4.1 1 0 0 0 2024-12-21 00:49:28
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43848 0.44077 0.00046 0.43960 0.00 0.43954 0.00 0 41.82
Laravel 11.1.2 demo app 50 50 100 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.43424 0.43658 0.00051 0.43514 -1.02 0.43510 -1.01 0 41.69
Laravel 11.1.2 demo app 50 50 100 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.43518 0.43754 0.00046 0.43612 -0.79 0.43610 -0.78 0 41.69
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.42373 0.42531 0.00036 0.42453 -3.43 0.42454 -3.41 0 50.75
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71301 0.71679 0.00078 0.71412 0.00 0.71398 0.00 0 37.33
Symfony 2.6.0 demo app 50 50 100 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.70954 0.72530 0.00223 0.71137 -0.38 0.71087 -0.43 0 37.39
Symfony 2.6.0 demo app 50 50 100 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.70888 0.71315 0.00077 0.71053 -0.50 0.71044 -0.50 0 37.39
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.68102 0.68424 0.00064 0.68215 -4.48 0.68213 -4.46 0 44.47
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58090 0.58363 0.00055 0.58202 0.00 0.58191 0.00 0 42.95
Wordpress 6.2 main page 10 50 20 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.57727 0.57994 0.00058 0.57838 -0.63 0.57829 -0.62 0 42.79
Wordpress 6.2 main page 10 50 20 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.57501 0.57987 0.00069 0.57845 -0.61 0.57841 -0.60 0 42.79
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.51905 0.52173 0.00051 0.52019 -10.62 0.52011 -10.62 0 61.87
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21497 0.21983 0.00108 0.21682 0.00 0.21667 0.00 0 26.12
bench.php 10 50 0 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 0.21538 0.21847 0.00065 0.21664 -0.09 0.21661 -0.03 0 26.06
bench.php 10 50 0 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.21411 0.21820 0.00078 0.21546 -0.63 0.21534 -0.61 0 26.06
bench.php 10 50 0 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.07391 0.07748 0.00083 0.07526 -65.29 0.07504 -65.37 0 27.23
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.34019 1.36753 0.00638 1.35414 0.00 1.35402 0.00 0 20.38
micro_bench.php 10 50 0 PHP - previous master 4b1c3cf0b6 https://github.com/php/php-src/commit/4b1c3cf0b6 1.34009 1.36546 0.00618 1.35140 -0.20 1.35100 -0.22 0 20.32
micro_bench.php 10 50 0 PHP - master afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 1.30362 1.32994 0.00734 1.31635 -2.79 1.31682 -2.75 0 20.32
micro_bench.php 10 50 0 PHP - master (JIT) afc1f0d99b https://github.com/php/php-src/commit/afc1f0d99b 0.54852 0.57380 0.00604 0.56259 -58.45 0.56314 -58.41 0 21.65
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
1966
1967
1968
1969
1970
1971
1972
1973
1974
1975
1976
1977
1978
1979
1980
1981
1982
1983
1984
1985
1986
1987
1988
1989
1990
1991
1992