Leading European Telco Operator.
A leading European telco operator had decided to implement a state-of-the-art, high redundancy CS Core Network. When it came time to address service verification, they were faced with a total of more than 500 test cases, plus several regression cycles that needed to be completed in order ensure network quality. It quickly became obvious that running through all of these tests manually would cause massive delays, and that unless they took a new approach to testing they would have to push back their “ready for service” milestone considerably.
As telecom networks become more complex, involving an ever-increasing slate of new protocols and devices, manual testing becomes less and less feasible. The European operator’s current testing service provider could only offer 6 test cases per engineer per day as their maximum throughput—meaning that
500 Test Cases would require 80 working person-days
Suffice it to say, the company didn’t have the time or the resources to devote to such a Herculean feat of manual testing. Service functionality had to be verified on a tight timeline, and because of configuration and software changes during the implementation phase, extensive regression testing was going to be necessary. The company knew that they would have to think outside the box to get this project done under time pressure.
Circuit Switched Core Project
Since manual testing wasn’t going to cut it, the company began to consider their options for automated testing. While many of the solutions available on the market right now offer simulated testing or testing on rooted devices, SEGRON was able to orchestrate automated testing on out-of-the-box devices to the tune of hundreds of test cases per user per day. Using SEGRON ATF (Automated Test Framework), the client was able to establish a robust testing environment, automating 500 complex Priority-1 test cases to ensure efficient and high-quality service verification. The best part?
The automated test execution ran through 500 test cases in only 10 hours.
With this simple, cost-effective tool orchestrating more than 20 Android mobile devices in a complex RAN environment (2G, 3G, and 4G), the company was able to automate all 500 of the network test cases, resulting in a 95% reduction in time spent on testing. Not only that, but they were able to benefit from test results that were more reliable than manual test results while providing straightforward, easy-to-read reporting. Because test cases were easily defined and maintained, they could be extended and modified on demand as new testing needs (e.g. regression tests) arose.
This put the company in a position not just to save huge swaths of time and money on a one-time project, but to rely on automated testing to improve efficiency and test quality on an ongoing basis. In this way, they’re potentially poised to leverage this boosted efficiency into increased time and cost saving beyond the test bench, resulting in improved network quality and a better bottom line.