diff --git a/2025/2025_03_12_00_49_29_1_aws_x86_64_c7i_metal_24xl/environment.tsv b/2025/2025_03_12_00_49_29_1_aws_x86_64_c7i_metal_24xl/environment.tsv new file mode 100644 index 0000000..3b9a707 --- /dev/null +++ b/2025/2025_03_12_00_49_29_1_aws_x86_64_c7i_metal_24xl/environment.tsv @@ -0,0 +1,2 @@ +URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time +2025/2025_03_12_00_49_29_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.129-138.220.amzn2023.x86_64 Amazon Linux 2023.6.20250303 11.4.1 1 0 0 0 2025-03-12 00:49:29 diff --git a/2025/2025_03_12_00_49_29_1_aws_x86_64_c7i_metal_24xl/result.md b/2025/2025_03_12_00_49_29_1_aws_x86_64_c7i_metal_24xl/result.md new file mode 100644 index 0000000..63e0115 --- /dev/null +++ b/2025/2025_03_12_00_49_29_1_aws_x86_64_c7i_metal_24xl/result.md @@ -0,0 +1,60 @@ +### AWS x86_64 (c7i.24xl) + +| Attribute | Value | +|---------------|----------------| +| Environment |aws| +| Runner |host| +| Instance type |c7i.metal-24xl (dedicated)| +| Architecture |x86_64 +| CPU |48 cores| +| CPU settings |disabled deeper C-states, disabled turbo boost, disabled hyper-threading| +| RAM |188 GB| +| Kernel |6.1.129-138.220.amzn2023.x86_64| +| OS |Amazon Linux 2023.6.20250303| +| GCC |11.4.1| +| Time |2025-03-12 00:49:29 UTC| + +### Laravel 11.1.2 demo app - 30 consecutive runs, 100 requests (sec) + +| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory | +|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------| +|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.44062|0.44493|0.00084|0.44154|0.00%|0.44142|0.00%|41.86 MB| +|[PHP - previous master](https://github.com/php/php-src/commit/9d60dc16b8)|0.43947|0.44115|0.00040|0.44006|-0.34%|0.43995|-0.33%|41.86 MB| +|[PHP - master](https://github.com/php/php-src/commit/645cd6a5ad)|0.43909|0.44251|0.00070|0.44008|-0.33%|0.43998|-0.32%|41.86 MB| +|[PHP - master (JIT)](https://github.com/php/php-src/commit/645cd6a5ad)|0.42759|0.42979|0.00049|0.42843|-2.97%|0.42837|-2.96%|50.79 MB| + +### Symfony 2.6.0 demo app - 30 consecutive runs, 100 requests (sec) + +| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory | +|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------| +|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.71587|0.71895|0.00064|0.71730|0.00%|0.71711|0.00%|37.39 MB| +|[PHP - previous master](https://github.com/php/php-src/commit/9d60dc16b8)|0.70780|0.72090|0.00224|0.70948|-1.09%|0.70904|-1.13%|37.55 MB| +|[PHP - master](https://github.com/php/php-src/commit/645cd6a5ad)|0.70623|0.70925|0.00090|0.70754|-1.36%|0.70746|-1.35%|37.55 MB| +|[PHP - master (JIT)](https://github.com/php/php-src/commit/645cd6a5ad)|0.67965|0.68309|0.00085|0.68120|-5.03%|0.68095|-5.04%|44.55 MB| + +### Wordpress 6.2 main page - 30 consecutive runs, 20 requests (sec) + +| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory | +|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------| +|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.58167|0.58408|0.00051|0.58264|0.00%|0.58263|0.00%|43.01 MB| +|[PHP - previous master](https://github.com/php/php-src/commit/9d60dc16b8)|0.57925|0.58202|0.00074|0.58014|-0.43%|0.58000|-0.45%|42.93 MB| +|[PHP - master](https://github.com/php/php-src/commit/645cd6a5ad)|0.57761|0.57989|0.00058|0.57869|-0.68%|0.57863|-0.69%|42.93 MB| +|[PHP - master (JIT)](https://github.com/php/php-src/commit/645cd6a5ad)|0.52062|0.52223|0.00046|0.52148|-10.50%|0.52152|-10.49%|61.91 MB| + +### bench.php - 25 consecutive runs (sec) + +| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory | +|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------| +|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.21534|0.21925|0.00107|0.21667|0.00%|0.21666|0.00%|26.18 MB| +|[PHP - previous master](https://github.com/php/php-src/commit/9d60dc16b8)|0.21463|0.21740|0.00060|0.21572|-0.44%|0.21566|-0.46%|26.27 MB| +|[PHP - master](https://github.com/php/php-src/commit/645cd6a5ad)|0.21554|0.21959|0.00110|0.21679|0.06%|0.21636|-0.13%|26.27 MB| +|[PHP - master (JIT)](https://github.com/php/php-src/commit/645cd6a5ad)|0.07492|0.07710|0.00056|0.07583|-65.00%|0.07567|-65.07%|27.37 MB| + +### micro_bench.php - 25 consecutive runs (sec) + +| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory | +|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------| +|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|1.33656|1.35449|0.00501|1.34599|0.00%|1.34506|0.00%|20.44 MB| +|[PHP - previous master](https://github.com/php/php-src/commit/9d60dc16b8)|1.25660|1.27601|0.00488|1.26460|-6.05%|1.26413|-6.02%|20.53 MB| +|[PHP - master](https://github.com/php/php-src/commit/645cd6a5ad)|1.26762|1.28457|0.00375|1.27787|-5.06%|1.27813|-4.98%|20.53 MB| +|[PHP - master (JIT)](https://github.com/php/php-src/commit/645cd6a5ad)|0.52606|0.53879|0.00315|0.53291|-60.41%|0.53345|-60.34%|21.79 MB| diff --git a/2025/2025_03_12_00_49_29_1_aws_x86_64_c7i_metal_24xl/result.tsv b/2025/2025_03_12_00_49_29_1_aws_x86_64_c7i_metal_24xl/result.tsv new file mode 100644 index 0000000..8d450c1 --- /dev/null +++ b/2025/2025_03_12_00_49_29_1_aws_x86_64_c7i_metal_24xl/result.tsv @@ -0,0 +1,21 @@ +Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage +Laravel 11.1.2 demo app 50 30 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.44062 0.44493 0.00084 0.44154 0.00 0.44142 0.00 0 41.86 +Laravel 11.1.2 demo app 50 30 100 PHP - previous master 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 0.43947 0.44115 0.00040 0.44006 -0.34 0.43995 -0.33 0 41.86 +Laravel 11.1.2 demo app 50 30 100 PHP - master 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.43909 0.44251 0.00070 0.44008 -0.33 0.43998 -0.32 0 41.86 +Laravel 11.1.2 demo app 50 30 100 PHP - master (JIT) 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.42759 0.42979 0.00049 0.42843 -2.97 0.42837 -2.96 0 50.79 +Symfony 2.6.0 demo app 50 30 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71587 0.71895 0.00064 0.71730 0.00 0.71711 0.00 0 37.39 +Symfony 2.6.0 demo app 50 30 100 PHP - previous master 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 0.70780 0.72090 0.00224 0.70948 -1.09 0.70904 -1.13 0 37.55 +Symfony 2.6.0 demo app 50 30 100 PHP - master 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.70623 0.70925 0.00090 0.70754 -1.36 0.70746 -1.35 0 37.55 +Symfony 2.6.0 demo app 50 30 100 PHP - master (JIT) 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.67965 0.68309 0.00085 0.68120 -5.03 0.68095 -5.04 0 44.55 +Wordpress 6.2 main page 10 30 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58167 0.58408 0.00051 0.58264 0.00 0.58263 0.00 0 43.01 +Wordpress 6.2 main page 10 30 20 PHP - previous master 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 0.57925 0.58202 0.00074 0.58014 -0.43 0.58000 -0.45 0 42.93 +Wordpress 6.2 main page 10 30 20 PHP - master 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.57761 0.57989 0.00058 0.57869 -0.68 0.57863 -0.69 0 42.93 +Wordpress 6.2 main page 10 30 20 PHP - master (JIT) 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.52062 0.52223 0.00046 0.52148 -10.50 0.52152 -10.49 0 61.91 +bench.php 10 25 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21534 0.21925 0.00107 0.21667 0.00 0.21666 0.00 0 26.18 +bench.php 10 25 0 PHP - previous master 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 0.21463 0.21740 0.00060 0.21572 -0.44 0.21566 -0.46 0 26.27 +bench.php 10 25 0 PHP - master 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.21554 0.21959 0.00110 0.21679 0.06 0.21636 -0.13 0 26.27 +bench.php 10 25 0 PHP - master (JIT) 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.07492 0.07710 0.00056 0.07583 -65.00 0.07567 -65.07 0 27.37 +micro_bench.php 10 25 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.33656 1.35449 0.00501 1.34599 0.00 1.34506 0.00 0 20.44 +micro_bench.php 10 25 0 PHP - previous master 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 1.25660 1.27601 0.00488 1.26460 -6.05 1.26413 -6.02 0 20.53 +micro_bench.php 10 25 0 PHP - master 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 1.26762 1.28457 0.00375 1.27787 -5.06 1.27813 -4.98 0 20.53 +micro_bench.php 10 25 0 PHP - master (JIT) 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.52606 0.53879 0.00315 0.53291 -60.41 0.53345 -60.34 0 21.79 diff --git a/2025/database.tsv b/2025/database.tsv index 4086324..e9b476b 100644 --- a/2025/database.tsv +++ b/2025/database.tsv @@ -1582,3 +1582,27 @@ micro_bench.php 10 25 0 PHP - previous master 33c4ca36e4 https://github.com/php/ micro_bench.php 10 25 0 PHP - master 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 1.25794 1.27557 0.00431 1.26512 -6.40 1.26486 -6.27 0 20.53 micro_bench.php 10 25 0 PHP - master (JIT) 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 0.52575 0.54100 0.00318 0.53479 -60.43 0.53489 -60.36 0 21.79 +URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time +2025/2025_03_12_00_49_29_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.129-138.220.amzn2023.x86_64 Amazon Linux 2023.6.20250303 11.4.1 1 0 0 0 2025-03-12 00:49:29 +Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage +Laravel 11.1.2 demo app 50 30 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.44062 0.44493 0.00084 0.44154 0.00 0.44142 0.00 0 41.86 +Laravel 11.1.2 demo app 50 30 100 PHP - previous master 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 0.43947 0.44115 0.00040 0.44006 -0.34 0.43995 -0.33 0 41.86 +Laravel 11.1.2 demo app 50 30 100 PHP - master 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.43909 0.44251 0.00070 0.44008 -0.33 0.43998 -0.32 0 41.86 +Laravel 11.1.2 demo app 50 30 100 PHP - master (JIT) 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.42759 0.42979 0.00049 0.42843 -2.97 0.42837 -2.96 0 50.79 +Symfony 2.6.0 demo app 50 30 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71587 0.71895 0.00064 0.71730 0.00 0.71711 0.00 0 37.39 +Symfony 2.6.0 demo app 50 30 100 PHP - previous master 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 0.70780 0.72090 0.00224 0.70948 -1.09 0.70904 -1.13 0 37.55 +Symfony 2.6.0 demo app 50 30 100 PHP - master 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.70623 0.70925 0.00090 0.70754 -1.36 0.70746 -1.35 0 37.55 +Symfony 2.6.0 demo app 50 30 100 PHP - master (JIT) 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.67965 0.68309 0.00085 0.68120 -5.03 0.68095 -5.04 0 44.55 +Wordpress 6.2 main page 10 30 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58167 0.58408 0.00051 0.58264 0.00 0.58263 0.00 0 43.01 +Wordpress 6.2 main page 10 30 20 PHP - previous master 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 0.57925 0.58202 0.00074 0.58014 -0.43 0.58000 -0.45 0 42.93 +Wordpress 6.2 main page 10 30 20 PHP - master 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.57761 0.57989 0.00058 0.57869 -0.68 0.57863 -0.69 0 42.93 +Wordpress 6.2 main page 10 30 20 PHP - master (JIT) 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.52062 0.52223 0.00046 0.52148 -10.50 0.52152 -10.49 0 61.91 +bench.php 10 25 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21534 0.21925 0.00107 0.21667 0.00 0.21666 0.00 0 26.18 +bench.php 10 25 0 PHP - previous master 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 0.21463 0.21740 0.00060 0.21572 -0.44 0.21566 -0.46 0 26.27 +bench.php 10 25 0 PHP - master 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.21554 0.21959 0.00110 0.21679 0.06 0.21636 -0.13 0 26.27 +bench.php 10 25 0 PHP - master (JIT) 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.07492 0.07710 0.00056 0.07583 -65.00 0.07567 -65.07 0 27.37 +micro_bench.php 10 25 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.33656 1.35449 0.00501 1.34599 0.00 1.34506 0.00 0 20.44 +micro_bench.php 10 25 0 PHP - previous master 9d60dc16b8 https://github.com/php/php-src/commit/9d60dc16b8 1.25660 1.27601 0.00488 1.26460 -6.05 1.26413 -6.02 0 20.53 +micro_bench.php 10 25 0 PHP - master 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 1.26762 1.28457 0.00375 1.27787 -5.06 1.27813 -4.98 0 20.53 +micro_bench.php 10 25 0 PHP - master (JIT) 645cd6a5ad https://github.com/php/php-src/commit/645cd6a5ad 0.52606 0.53879 0.00315 0.53291 -60.41 0.53345 -60.34 0 21.79 +