SEGRON’s Automated Testing Framework (ATF)
Why SEGRON ATF?
The average engineer could execute about 10 test case per day.
As recently as 2004, networks were structured simply enough that software and configuration changes could be tested manually by engineers.
Since then, both diversity and volume of testing have increased dramatically. Why?
First, networks have become more complex. Today, in addition to core network technologies, every telecom operator has to maintain and test at least 3 radio access networks in parallel (2G/3G/LTE), which are often multi-vendor implementations. 5G and network virtualization are on the horizon, meaning that this complexity is only going to increase.
Just as networks are getting more complex, agile development methodologies, widely adopted by network and software vendors, are radically compressing version cycles. The result? Software updates/upgrades are being pushed out more rapidly and under more considerable time pressure.
At the same time, the telco service portfolio is quickly expanding. Widespread LTE adoption, for instance, introduced another network layer without “cleaning up” old legacy services. As a result, services like mobile fax and circuit-switched data remain in use and thus require continuous maintenance. Expect 5G to bring similar challenges.
As if this weren’t enough, ubiquitous mobile data usage has made not just businesses, but consumers–even society itself, really–dependent on telco service quality. Transparency and ease-of-use continue to drive up usage, but this puts pressure on telcos to offer services that are more and more complex to produce.
On the one hand, continuously evolving telco services have become mission critical for both individuals and businesses in the last 15 years. Thousands of services (voice, messaging, data browsing, mobile internet access, gaming, etc.) have been built up on top of the “always on” telco infrastructure. For this reason, small service interruptions can have an outsized business impact. At the same time, new regulations have made it easier than ever for users to switch providers. This means the only way to ensure quality of service and retain subscribers is continuous network testing.
What has changed?
Based on the changes we’ve seen, it’s easy to understand why. But what else has changed between 2004 and today in terms of testing?
Surprisingly, not much!
Industry-leading operators still struggle with their manual testing approach. Expensive experts and armies of engineers have to be brought in for test execution and analysis; test campaigns are routinely shortened to meet the project timelines, increasing the risk of failure, leading to lost customers and revenue.
Key Benefits of SEGRON ATF
Just as testing is becoming more complex, its value is becoming more pronounced. By improving test coverage and speeding up time-to-market, SEGRON ATF can reduce not just testing costs, but network quality issues and operational bottlenecks. Our system prioritizes ease of use and ease of integration in order so that you can focus on delighting and retaining your customers.
By using SEGRON ATF, MNOs can achieve higher test quality in record time. The result is a significant reduction in costs and more optimal overall resource usage.
By running SEGRON ATF in an existing testing environment, operators can optimize processes and shorten time-to-market for product deployments of all sorts. The solution can be used in parallel or in conjunction with manual testing to ensure optimal quality assurance in any network environment.
Easily readable, technology-independent test case design. Users can quickly and easily write test cases on their own.
SEGRON ATF generates test reports that add value for both reporting management and troubleshooting e-mail alerts which can be configured to send notifications when network issues are detected (applicable for 24/7 testing).
Ready for 5G and IoT. Our end-to-end testing approach features the latest out-of-the-box Android and iOS smartphones without any rooting or jailbreaks. This means that tests are performed with exactly the devices / firmware versions that end-customers will be utilizing.
SEGRON ATF is designed to integrate with the MML and GUI configuration interface for all major IT and Telco equipment suppliers. This enables flexible configuration and log file analysis to ensure the highest possible test quality.
>10,000 test cases automated for all possible telco test scenarios. Areas like VoLTE, VoWiFi, CS, PS, VPN, emergency calls and many others are covered and available out-of-the-box.
End-to-End product characteristics
Deliver your services with speed and quality. Based on numerous years of IoT, field trial, and commercial deployment experience on both operator and vendor side, SEGRON testing solutions are tailored to: improve quality, reduce project duration, and reduce project costs. Our test framework is designed to meet your most exacting technical needs without sacrificing ease-of-use or readable reporting—the exact things that testers need to maintain a positive ROI.
WebUI (HTML, java). Applications (java, Windows executables). Command prompt (SOAP, LDAP interface).
We automate the latest iOS and Android smartphones without any specific software on the phone without any jailbreaking or rooting. The phones are exactly as end-customers are using them. Further we automate customer specific firmware and Apps.
Built-in app (e.g. iPhone app) testing, user app (e.g. WhatsApp) testing, custom app testing.
SIP Phone Automation
We support a large portfolio of SIP phones and SIP Apps to verify interworking between mobile and land-line services.
Legacy Telephony Testing
Analogue POTS lines, ISDN BR/PRI, analogue FAX, data, and voice service verification including audio analysis (tones, path, announcements).
Beyond End2End® Product Characteristics
Testing providers place a lot of value on end-to-end frameworks, but simply tracking success or failure, even for end-to-end processes, can still leave a lot to be desired. SEGRON ATF is designed to go deeper, offering users test data that covers the space between your endpoints (e.g. signalling patterns, etc.). This means that it can uncover errors and potential service issues that otherwise remain hidden, even in cases where all relevant tests seem to pass.
Signalling Protocol Analysis
Signal trace and analysis are essential for high-quality testing. The ATF Signalling Protocol Analysis feature is the direct result of decades worth of proven field experience in software development and signalling network design, enabling users to analyze and verify the entire 3GPP and IETF protocol stack on a bit level. The ATF easily analyzes all protocols decoded by Wireshark.
The ATF can easily analyze tones, speech path, and announcements on all automated end-devices (smartphones, SIP phones, and legacy phones, among others). Tones can be analyzed in connection and pre-connection state (e.g. ring-back tones, dial-tones, etc.). Voice path verification is performed with ITU compliant voice samples.
Machine Interface Automation
The ATF integrates with the MML syntax of all major network equipment manufacturers, and is designed to integrate with the MML and GUI configuration interface for all major IT and telco equipment manufacturers. This feature enables flexible configuration and internal log analysis to ensure the highest possible test quality.
Protocol Analyzer / Centralized Monitoring System Automation like Wireshark, or any other monitoring system offering API.
Automated Document Analysis
The ATF is able to verify PDF documents (e.g. customer invoices, orders, etc.).
Automated collection and analysis of CDR/EDR (Call Data Records/Event Data Records). Details content verification for revenue assurance and end-customer billing.