I have been working on writing perf tests for some time now and one issue that I frequently come across is that the results are not consistent. I have tried XCTOSSignpostMetrics for checking hitch ratio and also XCTMemoryMetric for checking the leaks.
Do you have any idea why there is inconsistency and also if we can do anything to have more consistent results across runs?
Yes, tried it on real devices but still see inconsistency in the results. I have also raised this issue with apple in the perf lab discussion earlier this year.
For further actions, you may consider blocking this person and/or reporting abuse
We're a place where coders share, stay up-to-date and grow their careers.
I have been working on writing perf tests for some time now and one issue that I frequently come across is that the results are not consistent. I have tried XCTOSSignpostMetrics for checking hitch ratio and also XCTMemoryMetric for checking the leaks.
Do you have any idea why there is inconsistency and also if we can do anything to have more consistent results across runs?
Have you tried using real device for testing?
Yes, tried it on real devices but still see inconsistency in the results. I have also raised this issue with apple in the perf lab discussion earlier this year.