This commit is contained in:
Benchmark
2025-02-15 01:28:09 +00:00
parent 5428b33ee5
commit 408230f90b
4 changed files with 107 additions and 0 deletions

View File

@@ -0,0 +1,2 @@
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2025/2025_02_15_00_49_21_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.127-135.201.amzn2023.x86_64 Amazon Linux 2023.6.20250211 11.4.1 1 0 0 0 2025-02-15 00:49:21
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2 2025/2025_02_15_00_49_21_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.127-135.201.amzn2023.x86_64 Amazon Linux 2023.6.20250211 11.4.1 1 0 0 0 2025-02-15 00:49:21

View File

@@ -0,0 +1,60 @@
### AWS x86_64 (c7i.24xl)
| Attribute | Value |
|---------------|----------------|
| Environment |aws|
| Runner |host|
| Instance type |c7i.metal-24xl (dedicated)|
| Architecture |x86_64
| CPU |48 cores|
| CPU settings |disabled deeper C-states, disabled turbo boost, disabled hyper-threading|
| RAM |188 GB|
| Kernel |6.1.127-135.201.amzn2023.x86_64|
| OS |Amazon Linux 2023.6.20250211|
| GCC |11.4.1|
| Time |2025-02-15 00:49:21 UTC|
### Laravel 11.1.2 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.43894|0.45345|0.00219|0.44051|0.00%|0.44011|0.00%|41.88 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/78d934ad8e)|0.43532|0.44392|0.00116|0.43641|-0.93%|0.43623|-0.88%|41.84 MB|
|[PHP - master](https://github.com/php/php-src/commit/c696087e32)|0.43726|0.44472|0.00105|0.43841|-0.48%|0.43810|-0.46%|41.84 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c696087e32)|0.42526|0.42709|0.00042|0.42618|-3.25%|0.42616|-3.17%|50.82 MB|
### Symfony 2.6.0 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.71250|0.71629|0.00085|0.71415|0.00%|0.71403|0.00%|37.41 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/78d934ad8e)|0.70764|0.71158|0.00076|0.70890|-0.74%|0.70878|-0.73%|37.52 MB|
|[PHP - master](https://github.com/php/php-src/commit/c696087e32)|0.71044|0.71388|0.00078|0.71159|-0.36%|0.71141|-0.37%|37.52 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c696087e32)|0.68347|0.68700|0.00075|0.68444|-4.16%|0.68425|-4.17%|44.53 MB|
### Wordpress 6.2 main page - 50 consecutive runs, 20 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.58123|0.58327|0.00048|0.58203|0.00%|0.58194|0.00%|43.02 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/78d934ad8e)|0.57506|0.58234|0.00108|0.57945|-0.44%|0.57947|-0.42%|42.98 MB|
|[PHP - master](https://github.com/php/php-src/commit/c696087e32)|0.57622|0.57857|0.00057|0.57740|-0.79%|0.57745|-0.77%|42.98 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c696087e32)|0.52036|0.52266|0.00045|0.52130|-10.43%|0.52125|-10.43%|61.94 MB|
### bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.21475|0.21937|0.00103|0.21666|0.00%|0.21642|0.00%|26.19 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/78d934ad8e)|0.21503|0.21943|0.00101|0.21678|0.05%|0.21655|0.06%|26.25 MB|
|[PHP - master](https://github.com/php/php-src/commit/c696087e32)|0.21556|0.21993|0.00100|0.21734|0.31%|0.21728|0.40%|26.25 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c696087e32)|0.07325|0.07733|0.00081|0.07503|-65.37%|0.07489|-65.40%|27.34 MB|
### micro_bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|1.33657|1.36612|0.00585|1.34973|0.00%|1.34830|0.00%|20.45 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/78d934ad8e)|1.35272|1.36990|0.00406|1.36195|0.91%|1.36239|1.05%|20.50 MB|
|[PHP - master](https://github.com/php/php-src/commit/c696087e32)|1.27568|1.30464|0.00680|1.28804|-4.57%|1.28804|-4.47%|20.50 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c696087e32)|0.51987|0.54512|0.00619|0.53142|-60.63%|0.53066|-60.64%|21.76 MB|

View File

@@ -0,0 +1,21 @@
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43894 0.45345 0.00219 0.44051 0.00 0.44011 0.00 0 41.88
Laravel 11.1.2 demo app 50 50 100 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.43532 0.44392 0.00116 0.43641 -0.93 0.43623 -0.88 0 41.84
Laravel 11.1.2 demo app 50 50 100 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.43726 0.44472 0.00105 0.43841 -0.48 0.43810 -0.46 0 41.84
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.42526 0.42709 0.00042 0.42618 -3.25 0.42616 -3.17 0 50.82
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71250 0.71629 0.00085 0.71415 0.00 0.71403 0.00 0 37.41
Symfony 2.6.0 demo app 50 50 100 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.70764 0.71158 0.00076 0.70890 -0.74 0.70878 -0.73 0 37.52
Symfony 2.6.0 demo app 50 50 100 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.71044 0.71388 0.00078 0.71159 -0.36 0.71141 -0.37 0 37.52
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.68347 0.68700 0.00075 0.68444 -4.16 0.68425 -4.17 0 44.53
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58123 0.58327 0.00048 0.58203 0.00 0.58194 0.00 0 43.02
Wordpress 6.2 main page 10 50 20 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.57506 0.58234 0.00108 0.57945 -0.44 0.57947 -0.42 0 42.98
Wordpress 6.2 main page 10 50 20 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.57622 0.57857 0.00057 0.57740 -0.79 0.57745 -0.77 0 42.98
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.52036 0.52266 0.00045 0.52130 -10.43 0.52125 -10.43 0 61.94
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21475 0.21937 0.00103 0.21666 0.00 0.21642 0.00 0 26.19
bench.php 10 50 0 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.21503 0.21943 0.00101 0.21678 0.05 0.21655 0.06 0 26.25
bench.php 10 50 0 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.21556 0.21993 0.00100 0.21734 0.31 0.21728 0.40 0 26.25
bench.php 10 50 0 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.07325 0.07733 0.00081 0.07503 -65.37 0.07489 -65.40 0 27.34
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.33657 1.36612 0.00585 1.34973 0.00 1.34830 0.00 0 20.45
micro_bench.php 10 50 0 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 1.35272 1.36990 0.00406 1.36195 0.91 1.36239 1.05 0 20.50
micro_bench.php 10 50 0 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 1.27568 1.30464 0.00680 1.28804 -4.57 1.28804 -4.47 0 20.50
micro_bench.php 10 50 0 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.51987 0.54512 0.00619 0.53142 -60.63 0.53066 -60.64 0 21.76
1 Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
2 Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43894 0.45345 0.00219 0.44051 0.00 0.44011 0.00 0 41.88
3 Laravel 11.1.2 demo app 50 50 100 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.43532 0.44392 0.00116 0.43641 -0.93 0.43623 -0.88 0 41.84
4 Laravel 11.1.2 demo app 50 50 100 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.43726 0.44472 0.00105 0.43841 -0.48 0.43810 -0.46 0 41.84
5 Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.42526 0.42709 0.00042 0.42618 -3.25 0.42616 -3.17 0 50.82
6 Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71250 0.71629 0.00085 0.71415 0.00 0.71403 0.00 0 37.41
7 Symfony 2.6.0 demo app 50 50 100 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.70764 0.71158 0.00076 0.70890 -0.74 0.70878 -0.73 0 37.52
8 Symfony 2.6.0 demo app 50 50 100 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.71044 0.71388 0.00078 0.71159 -0.36 0.71141 -0.37 0 37.52
9 Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.68347 0.68700 0.00075 0.68444 -4.16 0.68425 -4.17 0 44.53
10 Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58123 0.58327 0.00048 0.58203 0.00 0.58194 0.00 0 43.02
11 Wordpress 6.2 main page 10 50 20 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.57506 0.58234 0.00108 0.57945 -0.44 0.57947 -0.42 0 42.98
12 Wordpress 6.2 main page 10 50 20 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.57622 0.57857 0.00057 0.57740 -0.79 0.57745 -0.77 0 42.98
13 Wordpress 6.2 main page 10 50 20 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.52036 0.52266 0.00045 0.52130 -10.43 0.52125 -10.43 0 61.94
14 bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21475 0.21937 0.00103 0.21666 0.00 0.21642 0.00 0 26.19
15 bench.php 10 50 0 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.21503 0.21943 0.00101 0.21678 0.05 0.21655 0.06 0 26.25
16 bench.php 10 50 0 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.21556 0.21993 0.00100 0.21734 0.31 0.21728 0.40 0 26.25
17 bench.php 10 50 0 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.07325 0.07733 0.00081 0.07503 -65.37 0.07489 -65.40 0 27.34
18 micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.33657 1.36612 0.00585 1.34973 0.00 1.34830 0.00 0 20.45
19 micro_bench.php 10 50 0 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 1.35272 1.36990 0.00406 1.36195 0.91 1.36239 1.05 0 20.50
20 micro_bench.php 10 50 0 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 1.27568 1.30464 0.00680 1.28804 -4.57 1.28804 -4.47 0 20.50
21 micro_bench.php 10 50 0 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.51987 0.54512 0.00619 0.53142 -60.63 0.53066 -60.64 0 21.76

View File

@@ -1030,3 +1030,27 @@ micro_bench.php 10 50 0 PHP - previous master 65d433161a https://github.com/php/
micro_bench.php 10 50 0 PHP - master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 1.34614 1.35932 0.00351 1.35305 0.27 1.35359 0.34 0 20.49
micro_bench.php 10 50 0 PHP - master (JIT) 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.53182 0.56252 0.00661 0.54702 -59.46 0.54693 -59.46 0 21.75
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2025/2025_02_15_00_49_21_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.127-135.201.amzn2023.x86_64 Amazon Linux 2023.6.20250211 11.4.1 1 0 0 0 2025-02-15 00:49:21
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43894 0.45345 0.00219 0.44051 0.00 0.44011 0.00 0 41.88
Laravel 11.1.2 demo app 50 50 100 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.43532 0.44392 0.00116 0.43641 -0.93 0.43623 -0.88 0 41.84
Laravel 11.1.2 demo app 50 50 100 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.43726 0.44472 0.00105 0.43841 -0.48 0.43810 -0.46 0 41.84
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.42526 0.42709 0.00042 0.42618 -3.25 0.42616 -3.17 0 50.82
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71250 0.71629 0.00085 0.71415 0.00 0.71403 0.00 0 37.41
Symfony 2.6.0 demo app 50 50 100 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.70764 0.71158 0.00076 0.70890 -0.74 0.70878 -0.73 0 37.52
Symfony 2.6.0 demo app 50 50 100 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.71044 0.71388 0.00078 0.71159 -0.36 0.71141 -0.37 0 37.52
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.68347 0.68700 0.00075 0.68444 -4.16 0.68425 -4.17 0 44.53
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58123 0.58327 0.00048 0.58203 0.00 0.58194 0.00 0 43.02
Wordpress 6.2 main page 10 50 20 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.57506 0.58234 0.00108 0.57945 -0.44 0.57947 -0.42 0 42.98
Wordpress 6.2 main page 10 50 20 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.57622 0.57857 0.00057 0.57740 -0.79 0.57745 -0.77 0 42.98
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.52036 0.52266 0.00045 0.52130 -10.43 0.52125 -10.43 0 61.94
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21475 0.21937 0.00103 0.21666 0.00 0.21642 0.00 0 26.19
bench.php 10 50 0 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 0.21503 0.21943 0.00101 0.21678 0.05 0.21655 0.06 0 26.25
bench.php 10 50 0 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 0.21556 0.21993 0.00100 0.21734 0.31 0.21728 0.40 0 26.25
bench.php 10 50 0 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.07325 0.07733 0.00081 0.07503 -65.37 0.07489 -65.40 0 27.34
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.33657 1.36612 0.00585 1.34973 0.00 1.34830 0.00 0 20.45
micro_bench.php 10 50 0 PHP - previous master 78d934ad8e https://github.com/php/php-src/commit/78d934ad8e 1.35272 1.36990 0.00406 1.36195 0.91 1.36239 1.05 0 20.50
micro_bench.php 10 50 0 PHP - master c696087e32 https://github.com/php/php-src/commit/c696087e32 1.27568 1.30464 0.00680 1.28804 -4.57 1.28804 -4.47 0 20.50
micro_bench.php 10 50 0 PHP - master (JIT) c696087e32 https://github.com/php/php-src/commit/c696087e32 0.51987 0.54512 0.00619 0.53142 -60.63 0.53066 -60.64 0 21.76
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
1030
1031
1032
1033
1034
1035
1036
1037
1038
1039
1040
1041
1042
1043
1044
1045
1046
1047
1048
1049
1050
1051
1052
1053
1054
1055
1056