About:
The Web application can measure the performance of three popular libraries for API. For API, I used https://www.freeforexapi.com/. I implemented three HTTP clients: HttpClient, Refit, and RestSharp. All clients send identical data and receive the same response. For measuring, I used the BenchmarkDotNet library. This application's main idea is to launch tests without the console and get reports.
I implemented launching tests from Web UI. First, you can request forex API with different clients, catch sight of results and execute timing. The following functionality, You can choose the host, the runtimes, and the client and run a test. The Web UI launches the bash script under .NET, and further, it launches tests. The main peculiarity of this test is that it has optionality. You can choose different frameworks. Unfortunately, I couldn't make the tests for the NET8. There are some issues with packages and Docker. Next feature, You can see test reports, choosing client or all clients. And finally, I packed it to Docker.
You can see it by link here.
Usings:
First of all, You should clone the project. Then, if you want to use VS or Rider, you can run MVC and tests. Finally, if you don't want to use IDE, you can compose Docker and open it through your web browser.
Measures:
Legends:
Mean: Arithmetic mean of all measurements
Error: Half of 99.9% confidence interval
StdDev: Standard deviation of all measurements
Gen 0: GC Generation 0 collects per 1000 operations
Allocated: Allocated memory per single operation (managed only, inclusive, 1KB = 1024B)
1 Us: 1 Microsecond (0.000001 sec)
HttpClient
BenchmarkDotNet=v0.13.5, OS=macOS Ventura 13.3.1 (a) (22E772610a) [Darwin 22.4.0]
Intel Core i7-8850H CPU 2.60GHz (Coffee Lake), 1 CPU, 12 logical and 6 physical cores
.NET SDK=8.0.100-preview.3.23178.7
[Host] : .NET 6.0.16 (6.0.1623.17311), X64 RyuJIT AVX2
ShortRun : .NET 6.0.16 (6.0.1623.17311), X64 RyuJIT AVX2
Job=ShortRun IterationCount=3 LaunchCount=1
WarmupCount=3
| Method | Runtime | Mean | Error | StdDev | Gen0 | Gen1 | Allocated |
|---|---|---|---|---|---|---|---|
| BenchMark_HttpClientHandler | .NET 6.0 | 39.62 μs | 12.92 μs | 0.708 μs | 0.7935 | 0.4272 | 4.89 KB |
| BenchMark_HttpClientHandler | .NET 7.0 | 50.59 μs | 62.91 μs | 3.448 μs | 1.5869 | 0.4883 | 8.78 KB |
Refit
BenchmarkDotNet=v0.13.5, OS=macOS Ventura 13.3.1 (a) (22E772610a) [Darwin 22.4.0]
Intel Core i7-8850H CPU 2.60GHz (Coffee Lake), 1 CPU, 12 logical and 6 physical cores
.NET SDK=8.0.100-preview.3.23178.7
[Host] : .NET 6.0.16 (6.0.1623.17311), X64 RyuJIT AVX2
ShortRun : .NET 6.0.16 (6.0.1623.17311), X64 RyuJIT AVX2
Job=ShortRun IterationCount=3 LaunchCount=1
WarmupCount=3
| Method | Runtime | Mean | Error | StdDev | Gen0 | Gen1 | Allocated |
|---|---|---|---|---|---|---|---|
| BenchMark_RefitClientHandler | .NET 6.0 | 94.90 μs | 42.84 μs | 2.348 μs | 1.9531 | 0.4883 | 11.73 KB |
| BenchMark_RefitClientHandler | .NET 7.0 | 116.57 μs | 31.83 μs | 1.745 μs | 4.3945 | 1.4648 | 22.45 KB |
RestSharp
BenchmarkDotNet=v0.13.5, OS=macOS Ventura 13.3.1 (a) (22E772610a) [Darwin 22.4.0]
Intel Core i7-8850H CPU 2.60GHz (Coffee Lake), 1 CPU, 12 logical and 6 physical cores
.NET SDK=8.0.100-preview.3.23178.7
[Host] : .NET 6.0.16 (6.0.1623.17311), X64 RyuJIT AVX2
ShortRun : .NET 6.0.16 (6.0.1623.17311), X64 RyuJIT AVX2
Job=ShortRun IterationCount=3 LaunchCount=1
WarmupCount=3
| Method | Runtime | Mean | Error | StdDev | Gen0 | Allocated |
|---|---|---|---|---|---|---|
| BenchMark_RestsharpClientHandler | .NET 6.0 | 1.177 ms | 1.035 ms | 0.0567 ms | 7.8125 | 53.52 KB |
| BenchMark_RestsharpClientHandler | .NET 7.0 | 1.556 ms | 5.196 ms | 0.2848 ms | 7.8125 | 46.03 KB |
Top comments (0)