5 Things You Should Know About Mobile Testing with Xamarin Test Cloud
October 27, 2014
*Bluetube was acquired by Perficient in October 2016. To learn more, please click here.*
If you were not aware, Xamarin recently released Xamarin Test Cloud. It joins a relatively young but growing field of products and cloud solutions to solve one of the biggest challenges facing mobile application development, mobile testing. Below are five things you should know about mobile testing with Xamarin Test Cloud:
It takes more devices than you think – Think you can hit 75% market share with manual testing? You might be surprised to know that it takes up to 134 devices and configurations to get 75% US market coverage. Xamarin Test Cloud actually features over a thousand real devices and configurations, covering just about any testing needs.
It’s actually real devices – Xamarin Test Cloud testing and the execution actually runs on real devices. We've found that one of the biggest assumptions about Xamarin Test Cloud is that they are not running on actual devices since so many cloud based services use simulators. This is also a huge distinction from those other platforms that require simulators to achieve large device counts. This unique feature sets Xamarin Test Cloud apart from other “real device” testing platforms that only offer one or two dozen devices or configurations. As point number one illustrates, it takes a lot more devices and configurations than you think.
Enterprise distributed or B2B apps still benefit – Chances are you may not even realize you need a mobile testing platform or solution. Often we hear clients say ‘we are only targeting iOS’ or ‘we do enterprise distribution and we only need to hit a few devices’. If you haven’t noticed, iOS is starting to fragment and that is requiring coverage of multiple iOS versions. If you include iPad you now have up to 10 different screen resolutions across two or more iOS versions to support. Offering Android support? That covers dozens of screen resolutions and thousands of devices, not to mention numerous OS versions to support.
You can build automated tests in C# - Although this is a bit technical, it is important to note that Automated Test Scripts can be built in Calabash (Ruby) and C#. For those that use Xamarin, this means you can build your app not only in the same language, but also build your scripts as part of your overall development process, rather than an afterthought.
Your app doesn't have to be native, or even built in Xamarin – That’s right. Despite the fact that Xamarin Test Cloud comes from Xamarin, your app doesn't have to be built in Xamarin to leverage the platform. Any app that can run on the device can be used with Xamarin Test cloud. This includes hybrid apps, which are apps that are a mix of native and HTML5 based.
Bonus - It can integrate with automated builds or continuous integration – Mature organizations know the value of automated builds and continuous integration. Now, you can integrate Xamarin Test Cloud into these tools and processes. Therefore, you can have a combined release and testing strategy that helps eliminate the needs for human involvement and reduce the risk of human error and regression impact.
Want to know more about mobile testing or Xamarin Test Cloud? Check out Xamarin’s free white paper on Xamarin Test Cloud. You can also learn more about Bluetube’s expertise and services as Xamarin Test Cloud Consulting Partners and as Xamarin Premiere Consulting Partners.
Interested in learning more about other cross-platform development tools? Our comparison of cross-platform mobile development tools might be of interest to you too!