When testing VR titles Testronic will monitor performance values in order to provide feedback and data corresponding to any events which indicate a drop below the expected performance level. Should performance be inconsistent or values show a large degree of variance then Testronic will also observe and document these events either directly as bug reports or as part of the written daily analysis of results delivered to our clients.
Performance testing considerations will be evaluated before the start of testing to establish the requirements of the title with the following data being monitored;
- CPU usage
- Memory usage
- Frame times
Bespoke performance testing scenarios can be created in order to test the title in specific circumstances where the risk of performance issues is highest.
Currently, performance testing for VR titles is being performed using the published minimum specifications from Oculus and HTC to confirm that titles are meeting the expectations for consistency of experience quality.