You may believe mobile performance testing is similar to same web activities and you will be right. Bit only to some extent. Mobile performance tests are definitely wider and cover significantly more ground, although they still share same principals and core activities remain intact.
Users have devices they are using to gain from your apps. And those devices differ in generations, hardware, software and OS version and capabilities, geographical and cellular limitations, etc. And that’s just to name a few issues that differ mobile from web. But how to really rock at this process?
- Start from ensuring your goals are not different from business objectives. Corporate requirements exist for a reason. Test only the aspects business requires and don’t go elsewhere without a valid reason otherwise you are risking to miss defects that are of larger priority. You are not here to simply play around with the app to determine its limitations, right? So, by following business requirements you ensure you are providing mobile testing services with a large emphasis on services. Start with determining what the app is designed to do and what is the primary, defining business metric. If any aspects of achieving this ultimate end-goal require custom developed logic – test those places first. These are connection type flaws and similar issues in context of performance testing.
- What are the KPIs? These little fellers are directly related to your business objectives and may vary from max response time and to error rate. Making sure what your KPIs are is your firs direct step towards delivering expected results.
- Don’t get carried away. You can emulate whatever you want bit no data ca be even relatively compared in accuracy to results from tests that were run on actual devices. Emulations are great when server-end data is under test while no software can actually display all possible device-related specifications.
- One more thing you should consider are interactions. People get calls and texts and push notifications and a hell load of other notification all the time. How will they influence the app? Phone call and text interruptions are often tested, yet many other types like the dead battery signal or alarm clock are often missing from the overall testing scope.
Hope these tips were helpful and remember to share your thoughts through the comments!