Case Study: End-to-End Testing of Mobile Banking App

About the Customer

The Customer is a very reputed commercial retail bank in Australia aimed at servicing SMBs (small and medium businesses). The bank ranks among top 8 local banks in the region and wanted to develop a successful Mobile Banking App for its customers.

The Challenge (End-to-End Testing of Mobile Banking App)

In an attempt to unlock the immense potential of mobile banking, the bank decided to launch a state-of-the-art mobile banking solution providing app that would enable the bank’s customers to make transactions and manage their funds right on their mobile devices.

This large-scale and complex project had a number of key challenges for the testing team. To ensure that they were not leaving out either of the popular mobile platforms, the bank decided to develop the mobile banking application for both. Hence the banking app testing required end-to-end testing services on two of the most widely used mobile platforms — iOS and Android. The banking application had to be totally compatible with mobile operational systems starting from their old OS versions (iOS 9.1+ and Android 4.0+). This meant comprehensive cross device and cross platform compatibility testing.

To make this even more challenging, numerous devices from different manufacturers run on Android, and several of them have some device-specific complexities that had to be considered during testing.

The bank had a clear mandate — to ensure a highly positive user experience (UX), the mobile applications had to closely resemble the experience that their users would experience at a physical bank branch. Due to all these factors, the banking mobile app had a very complex set of functionality. It required the banking app to be reactive to rapidly to changing business conditions such as changes in the banking regulations, revised transaction processing systems, etc. This needed top-quality, specialized testing services that covered high-risk areas and of the system in an effective way. The Bank selected CredibleSoft, an award winning mobile app testing service provider, to perform a comprehensive release testing of their mobile banking solution apps.

Solution Provided by CredibleSoft’s QA, Testing Team

To overcome the cross-device and cross-platform testing challenge, ensure adequate device coverage and based on most popular devices among the bank customers, CredibleSoft’s mobile testing team decided to use a matrix of 24+ real devices from our test lab. This testing approach immediately helped address the requirements to cater to a vast majority of banking app users. Two test engineers and one QA manager from CredibleSoft’s rockstar testing team were assigned for this project. They delivered top-quality functional and regression testing throughout the entire duration of the product development lifecycle.

The project implementation required close collaboration between CredibleSoft’s testing team and the customer representatives. Knowing how complex and highly-responsive the banking apps (iOS and Android versions) were going to be, standard functional testing was not going to be sufficient. Hence, our QA testing team decided to use more advanced Agile automated testing methods. We used tools such as Appium for automating core and error-prone areas of the banking mobile apps.

To ensure thorough regression testing and to make sure no new issues were being introduced when new features and bug fixes were released in each sprint iterations, CredibleSoft’s testing team developed a regression test suite with as many as 273 critical test cases — many of these were automated and integrated to the development pipeline for automatic execution during each sprint. This considerably reduced the QA, testing time and ensured no surprises (defects) were detected in production.

The End Result

The banking app project ran for 3+ years. The continuous collaboration of the development team, the bank representatives and CredibleSoft’s testing team made sure that a high on quality and high on usability banking mobile app that was compatible with a large number of mobile OS versions, devices, and wearables was delivered. The banking app works seamlessly across a wide number of iOS as well as Android smart devices and offers secure platform for various banking related transactions.

The success of this banking mobile convinced the Bank to keep coming back to us for future projects.

Technology Stack and Tools That Were Used

TestRail, Atlassian JIRA, TestNG, Appium, Android SDK, Xcode Instruments, Maven, Gradle, Jenkins