EgorBot for EgorBo in #111806

[EgorBot]

Processing dotnet/runtime#111806 (comment) command:

Command

-linux_azure_genoa -linux_azure_milano -linux_azure_cascadelake -linux_azure_cobalt100 -windows_azure_cobalt100 -linux_azure_ampere

using BenchmarkDotNet.Attributes;

[CsvExporter]
public class Benchmarks
{
    [Benchmark]
    [ArgumentsSource(nameof(TestData))]
    public bool EqualsTest(string a, string b) => a == b;

    public static IEnumerable<object[]> TestData()
    {
        int[] lengths = [8, 10, 20, 50, 64, 80, 100, 200, 512, 768, 1000, 10000, 100000];
        foreach (int length in lengths)
        {
            yield return [new string('b', length) + "x", new string('b', length) + "y"];
        }
    }
}

(EgorBot will reply in this issue)

[EgorBot]

Benchmark results on linux_azure_genoa

BenchmarkDotNet v0.14.0, Ubuntu 24.04.1 LTS (Noble Numbat)
AMD EPYC 9V74, 1 CPU, 16 logical and 8 physical cores
  Job-BYCSET : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
  Job-EOFEXO : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI

Method	Toolchain	a	b	Mean	Error	Ratio
EqualsTest	Main	bbb(...)bbx [100001]	bbb(...)bby [100001]	3,593.367 ns	1.0607 ns	1.00
EqualsTest	PR	bbb(...)bbx [100001]	bbb(...)bby [100001]	3,479.471 ns	0.2910 ns	0.97
EqualsTest	Main	bbb(...)bbx [10001]	bbb(...)bby [10001]	356.049 ns	0.9523 ns	1.00
EqualsTest	PR	bbb(...)bbx [10001]	bbb(...)bby [10001]	325.632 ns	0.0568 ns	0.91
EqualsTest	Main	bbbb(...)bbbx [1001]	bbbb(...)bbby [1001]	32.516 ns	0.0684 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [1001]	bbbb(...)bbby [1001]	24.501 ns	0.1827 ns	0.75
EqualsTest	Main	bbbb(...)bbbx [769]	bbbb(...)bbby [769]	25.588 ns	0.0542 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [769]	bbbb(...)bbby [769]	19.912 ns	0.1300 ns	0.78
EqualsTest	Main	bbbb(...)bbbx [513]	bbbb(...)bbby [513]	17.316 ns	0.0523 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [513]	bbbb(...)bbby [513]	13.812 ns	0.1087 ns	0.80
EqualsTest	Main	bbbb(...)bbbx [201]	bbbb(...)bbby [201]	6.916 ns	0.0516 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [201]	bbbb(...)bbby [201]	6.904 ns	0.0550 ns	1.00
EqualsTest	Main	bbbb(...)bbbx [101]	bbbb(...)bbby [101]	4.043 ns	0.0416 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [101]	bbbb(...)bbby [101]	3.934 ns	0.0481 ns	0.97
EqualsTest	Main	bbbbb(...)bbbbx [81]	bbbbb(...)bbbby [81]	3.134 ns	0.0249 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [81]	bbbbb(...)bbbby [81]	3.185 ns	0.0349 ns	1.02
EqualsTest	Main	bbbbb(...)bbbbx [65]	bbbbb(...)bbbby [65]	2.977 ns	0.0640 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [65]	bbbbb(...)bbbby [65]	2.988 ns	0.0565 ns	1.00
EqualsTest	Main	bbbbb(...)bbbbx [51]	bbbbb(...)bbbby [51]	2.402 ns	0.0144 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [51]	bbbbb(...)bbbby [51]	2.482 ns	0.0094 ns	1.03
EqualsTest	Main	bbbbb(...)bbbbx [21]	bbbbb(...)bbbby [21]	2.350 ns	0.0004 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [21]	bbbbb(...)bbbby [21]	2.350 ns	0.0005 ns	1.00
EqualsTest	Main	bbbbbbbbbbx	bbbbbbbbbby	2.350 ns	0.0003 ns	1.00
EqualsTest	PR	bbbbbbbbbbx	bbbbbbbbbby	2.350 ns	0.0003 ns	1.00
EqualsTest	Main	bbbbbbbbx	bbbbbbbby	2.350 ns	0.0003 ns	1.00
EqualsTest	PR	bbbbbbbbx	bbbbbbbby	2.350 ns	0.0004 ns	1.00

BDN_Artifacts.zip

cc @EgorBo (agent_logs.txt). EgorBot manual: link.

[EgorBot]

Benchmark results on linux_azure_cascadelake

BenchmarkDotNet v0.14.0, Ubuntu 24.04.1 LTS (Noble Numbat)
Intel Xeon Platinum 8370C CPU 2.80GHz, 1 CPU, 16 logical and 8 physical cores
  Job-EXRYYU : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
  Job-WYTPPF : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI

Method	Toolchain	a	b	Mean	Error	Ratio
EqualsTest	Main	bbb(...)bbx [100001]	bbb(...)bby [100001]	7,839.603 ns	1.2121 ns	1.00
EqualsTest	PR	bbb(...)bbx [100001]	bbb(...)bby [100001]	4,951.880 ns	0.2280 ns	0.63
EqualsTest	Main	bbb(...)bbx [10001]	bbb(...)bby [10001]	333.314 ns	0.0393 ns	1.00
EqualsTest	PR	bbb(...)bbx [10001]	bbb(...)bby [10001]	256.027 ns	0.0325 ns	0.77
EqualsTest	Main	bbbb(...)bbbx [1001]	bbbb(...)bbby [1001]	35.555 ns	0.0034 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [1001]	bbbb(...)bbby [1001]	30.665 ns	0.0046 ns	0.86
EqualsTest	Main	bbbb(...)bbbx [769]	bbbb(...)bbby [769]	26.253 ns	0.0075 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [769]	bbbb(...)bbby [769]	22.080 ns	0.0013 ns	0.84
EqualsTest	Main	bbbb(...)bbbx [513]	bbbb(...)bbby [513]	18.196 ns	0.0086 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [513]	bbbb(...)bbby [513]	17.214 ns	0.0429 ns	0.95
EqualsTest	Main	bbbb(...)bbbx [201]	bbbb(...)bbby [201]	7.166 ns	0.0021 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [201]	bbbb(...)bbby [201]	7.301 ns	0.0017 ns	1.02
EqualsTest	Main	bbbb(...)bbbx [101]	bbbb(...)bbby [101]	4.229 ns	0.0280 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [101]	bbbb(...)bbby [101]	4.200 ns	0.0012 ns	0.99
EqualsTest	Main	bbbbb(...)bbbbx [81]	bbbbb(...)bbbby [81]	3.177 ns	0.0132 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [81]	bbbbb(...)bbbby [81]	3.178 ns	0.0171 ns	1.00
EqualsTest	Main	bbbbb(...)bbbbx [65]	bbbbb(...)bbbby [65]	7.327 ns	0.0015 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [65]	bbbbb(...)bbbby [65]	3.184 ns	0.0204 ns	0.43
EqualsTest	Main	bbbbb(...)bbbbx [51]	bbbbb(...)bbbby [51]	2.198 ns	0.0054 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [51]	bbbbb(...)bbbby [51]	2.305 ns	0.0219 ns	1.05
EqualsTest	Main	bbbbb(...)bbbbx [21]	bbbbb(...)bbbby [21]	2.357 ns	0.0070 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [21]	bbbbb(...)bbbby [21]	2.337 ns	0.0433 ns	0.99
EqualsTest	Main	bbbbbbbbbbx	bbbbbbbbbby	2.356 ns	0.0059 ns	1.00
EqualsTest	PR	bbbbbbbbbbx	bbbbbbbbbby	2.262 ns	0.0239 ns	0.96
EqualsTest	Main	bbbbbbbbx	bbbbbbbby	2.351 ns	0.0153 ns	1.00
EqualsTest	PR	bbbbbbbbx	bbbbbbbby	2.280 ns	0.0342 ns	0.97

BDN_Artifacts.zip

cc @EgorBo (agent_logs.txt). EgorBot manual: link.

[EgorBot]

Benchmark results on linux_azure_milano

BenchmarkDotNet v0.14.0, Ubuntu 24.04.1 LTS (Noble Numbat)
AMD EPYC 7763, 1 CPU, 16 logical and 8 physical cores
  Job-AIMNUN : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX2
  Job-DWDFGT : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX2

Method	Toolchain	a	b	Mean	Error	Ratio
EqualsTest	Main	bbb(...)bbx [100001]	bbb(...)bby [100001]	4,154.423 ns	6.4564 ns	1.00
EqualsTest	PR	bbb(...)bbx [100001]	bbb(...)bby [100001]	3,985.363 ns	1.6129 ns	0.96
EqualsTest	Main	bbb(...)bbx [10001]	bbb(...)bby [10001]	389.913 ns	0.6223 ns	1.00
EqualsTest	PR	bbb(...)bbx [10001]	bbb(...)bby [10001]	342.813 ns	0.0478 ns	0.88
EqualsTest	Main	bbbb(...)bbbx [1001]	bbbb(...)bbby [1001]	36.980 ns	0.0470 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [1001]	bbbb(...)bbby [1001]	31.510 ns	0.0441 ns	0.85
EqualsTest	Main	bbbb(...)bbbx [769]	bbbb(...)bbby [769]	34.204 ns	0.1016 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [769]	bbbb(...)bbby [769]	22.541 ns	0.0273 ns	0.66
EqualsTest	Main	bbbb(...)bbbx [513]	bbbb(...)bbby [513]	19.085 ns	0.0248 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [513]	bbbb(...)bbby [513]	15.814 ns	0.0270 ns	0.83
EqualsTest	Main	bbbb(...)bbbx [201]	bbbb(...)bbby [201]	7.421 ns	0.0187 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [201]	bbbb(...)bbby [201]	7.208 ns	0.0046 ns	0.97
EqualsTest	Main	bbbb(...)bbbx [101]	bbbb(...)bbby [101]	4.409 ns	0.0009 ns	1.00
EqualsTest	PR	bbbb(...)bbbx [101]	bbbb(...)bbby [101]	4.406 ns	0.0035 ns	1.00
EqualsTest	Main	bbbbb(...)bbbbx [81]	bbbbb(...)bbbby [81]	4.106 ns	0.0002 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [81]	bbbbb(...)bbbby [81]	4.103 ns	0.0025 ns	1.00
EqualsTest	Main	bbbbb(...)bbbbx [65]	bbbbb(...)bbbby [65]	3.796 ns	0.0012 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [65]	bbbbb(...)bbbby [65]	3.803 ns	0.0228 ns	1.00
EqualsTest	Main	bbbbb(...)bbbbx [51]	bbbbb(...)bbbby [51]	3.485 ns	0.0005 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [51]	bbbbb(...)bbbby [51]	3.494 ns	0.0004 ns	1.00
EqualsTest	Main	bbbbb(...)bbbbx [21]	bbbbb(...)bbbby [21]	2.556 ns	0.0005 ns	1.00
EqualsTest	PR	bbbbb(...)bbbbx [21]	bbbbb(...)bbbby [21]	2.877 ns	0.0114 ns	1.13
EqualsTest	Main	bbbbbbbbbbx	bbbbbbbbbby	2.867 ns	0.0003 ns	1.00
EqualsTest	PR	bbbbbbbbbbx	bbbbbbbbbby	2.862 ns	0.0007 ns	1.00
EqualsTest	Main	bbbbbbbbx	bbbbbbbby	2.871 ns	0.0003 ns	1.00
EqualsTest	PR	bbbbbbbbx	bbbbbbbby	2.979 ns	0.0003 ns	1.04

BDN_Artifacts.zip

cc @EgorBo (agent_logs.txt). EgorBot manual: link.

[EgorBot]

Benchmark results on windows_azure_cobalt100

BenchmarkDotNet v0.14.0, Windows 11 (10.0.26100.2314)
azure_cobalt100
  Job-ROCHCN : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD
  Job-QZDBCO : .NET 10.0.0 (42.42.42.42424), Arm64 RyuJIT AdvSIMD

Method	Job	Toolchain	a	b	Mean	Error	Ratio
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbb(...)bbx [100001]	bbb(...)bby [100001]	7,514.778 ns	1.7964 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbb(...)bbx [100001]	bbb(...)bby [100001]	6,774.014 ns	2.4102 ns	0.90
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbb(...)bbx [10001]	bbb(...)bby [10001]	658.562 ns	0.3476 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbb(...)bbx [10001]	bbb(...)bby [10001]	583.156 ns	0.4187 ns	0.89
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbbb(...)bbbx [1001]	bbbb(...)bbby [1001]	64.483 ns	0.0401 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbbb(...)bbbx [1001]	bbbb(...)bbby [1001]	56.687 ns	0.0422 ns	0.88
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbbb(...)bbbx [769]	bbbb(...)bbby [769]	49.922 ns	0.0251 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbbb(...)bbbx [769]	bbbb(...)bbby [769]	44.905 ns	0.0514 ns	0.90
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbbb(...)bbbx [513]	bbbb(...)bbby [513]	33.912 ns	0.0932 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbbb(...)bbbx [513]	bbbb(...)bbby [513]	30.601 ns	0.1238 ns	0.90
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbbb(...)bbbx [201]	bbbb(...)bbby [201]	13.301 ns	0.0013 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbbb(...)bbbx [201]	bbbb(...)bbby [201]	13.287 ns	0.0170 ns	1.00
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbbb(...)bbbx [101]	bbbb(...)bbby [101]	6.531 ns	0.0075 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbbb(...)bbbx [101]	bbbb(...)bbby [101]	7.250 ns	0.0035 ns	1.11
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbbbb(...)bbbbx [81]	bbbbb(...)bbbby [81]	5.306 ns	0.0016 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbbbb(...)bbbbx [81]	bbbbb(...)bbbby [81]	6.193 ns	0.0036 ns	1.17
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbbbb(...)bbbbx [65]	bbbbb(...)bbbby [65]	4.512 ns	0.0046 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbbbb(...)bbbbx [65]	bbbbb(...)bbbby [65]	4.709 ns	0.0037 ns	1.04
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbbbb(...)bbbbx [51]	bbbbb(...)bbbby [51]	3.398 ns	0.0039 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbbbb(...)bbbbx [51]	bbbbb(...)bbbby [51]	3.916 ns	0.0033 ns	1.15
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbbbb(...)bbbbx [21]	bbbbb(...)bbbby [21]	1.548 ns	0.0017 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbbbb(...)bbbbx [21]	bbbbb(...)bbbby [21]	2.172 ns	0.0037 ns	1.40
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbbbbbbbbbx	bbbbbbbbbby	1.189 ns	0.0025 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbbbbbbbbbx	bbbbbbbbbby	1.010 ns	0.0017 ns	0.85
EqualsTest	Job-ROCHCN	\core_root_base\corerun.exe	bbbbbbbbx	bbbbbbbby	1.062 ns	0.0026 ns	1.00
EqualsTest	Job-QZDBCO	\core_root_diff\corerun.exe	bbbbbbbbx	bbbbbbbby	1.237 ns	0.0031 ns	1.16

BDN_Artifacts.zip

cc @EgorBo (agent_logs.txt). EgorBot manual: link.

[EgorBot]

@EgorBot -windows_azure_cascadelake -linux_azure_cobalt100 -linux_azure_ampere -aws_arm -aws_amd -pr 111806

using BenchmarkDotNet.Attributes;

[CsvExporter]
public class Benchmarks
{
    [Benchmark]
    [ArgumentsSource(nameof(TestData))]
    public bool EqualsTest(string a, string b) => a == b;

    public static IEnumerable<object[]> TestData()
    {
        int[] lengths = [8, 10, 20, 50, 64, 80, 100, 200, 512, 768, 1000, 10000, 100000];
        foreach (int length in lengths)
        {
            yield return [new string('b', length) + "x", new string('b', length) + "y"];
        }
    }
}