Does Your Test Partner Need to Be a Telco Expert?

does-your-test-automation-provider-really-have-to-be-a-telecom-expert

End-to-end testing—it’s all the rage right now in any number of industries, and with good reason. As global technologies become more connected and more thoroughly interwoven into the fabric of society, more thorough and efficient testing will become not just a luxury, but a necessity.

As such, it should come as no surprise that a number of testing automation providers have cropped up in the past few years, covering everything from software security to telecoms.

This, too, makes sense on the surface: how different could testing solutions for different industries really be? If you can automate verification for a new social media platform, why can’t you do the same for VoIP verification?

Unfortunately, in reality it’s not that simple. Testing from one domain to another involves different sets of challenges and radically different domain knowledge. Even if the basic principals are the same, the particulars are going to vary enough that you’ll really want to partner with someone who is more than just an end-to-end test factory.

If you’re a telco service provider or network operator, you’ll want to seek out a testing provider with specific, in-depth domain knowledge. Why? We’re glad you asked…

Unique Challenges in Telecom Testing

As the global telecom sphere evolves, it’s not just service itself that becomes more complicated—it’s testing and service verification as well. Every year, user expectations are becoming more exacting and networks themselves are getting more complicated.

Even as 5G slowly becomes more and more available, legacy telephony continues to be a major part of the landscape, meaning that in order to verify service for a given device, network, function, etc. testers need to run through more individual use cases than ever.

Of course, this increased complexity makes the use cases themselves more complicated from a testing perspective, meaning that they’re becoming more time consuming at the same time that they’re proliferating.

Given all the above, it’s no wonder companies are seeking outsourced testing solutions. At the same time, the very factors that are pushing people to automate tests are also a clear signal of the importance of an automation provider with strong domain knowledge.

Let’s say you’re testing VoLTE after a recent rollout of updates in your core network. A generalized testing provider might use simulation to verify VoLTE functionality, but they’re unlikely to have the actual out-of-the-box iOS and Android devices that your users will be utilizing. 

As a result, small differences in the simulation vs. reality might lead you to miss small changes in latency times (which can result in a big difference in perceived quality of service for VoLTE users); by the same token, they might not test interworking towards legacy devices and networks. Thus, when you take the updates live you might find that some of your users on older devices aren’t able to access your network, while VoLTE users aren’t getting the voice quality they expect.

Creating Project Alignment

In the example above, a testing automation provider with telco domain knowledge would have (hopefully) had not just the right equipment on hand to verify service for your various use cases (e.g. out-of-the-box iOS and Android devices), but the experience to ensure interoperability tests and verification for legacy devices.

This is valuable enough on its face, but it also suggests another way in which domain knowledge itself (in addition to services provided) is a driver of value.

Although end-to-end test automation has only just recently become a buzzword, service verification outsourcing has been occurring in the telco industry for many years—and the result has been that finding knowledgeable resources has become harder than ever both within and outside these companies.

The implications here are two-fold: first, that if you don’t have robust testing framework already in place, you’ll necessarily rely on your vendor to provide such a framework. If your partner in this process can provide automation but isn’t able to develop a domain-specific set of use cases, the necessary knowledge to reach minimum acceptable test coverage might prove difficult to come by.

Second, if you’re in a position where your in-house testing expertise has largely vanished, there is fairly obvious value to be gained by partnering with someone who can provide a repeatable framework that yields sufficient documentation for you to regain some control over your service verification.

For this to be effective, telco operators need a company that can speak their language. If your testing solution provider doesn’t have telco specific expertise, they won’t have the language with which to communicate effectively before or after testing about your particular concerns and areas of interest.

Beyond End-to-End Testing

So far, we’ve seen a number of ways in which telecom expertise can make testing more comprehensive and thus more valuable in the short and long term.

But is it just about the ability to manage ever-growing complexity and to do so in a way that allows easy collaboration and transparency—or is there another level of testing sophistication that can only be powered by those who have a complete view of the entire telco structure, from high-level strategic and corporate concerns to specific engineering challenges?

As you might have guessed, the answer is “yes.” Sure, a generic testing automation provider might be able to adequately offer end-point service verification (i.e. end-to-end), but what about the level beyond that?

With real telco expertise, it’s possible to automate not just verification at end-points, but between them, i.e. what’s happening at the level of network elements, switches, packets, and signals. Even in cases where call, text, or email appears to have gone through as normal, there may (for instance) be signaling errors that a “normal” testing solution would have no way to catch.

You might be thinking that there isn’t too much added value to be extracted here, but in point of fact these sorts of “invisible” errors can be harbingers of issues that could crop up during later usage.

By tracking them and offering reporting that documents them, you improve test coverage well beyond what would have been possible under other circumstances. By increasing coverage in this way, you potentially improve the quality of your network in a way that would be functionally impossible without a high degree of telco expertise.

Interested in our Products ?

Scroll Up

pencil Download your White Paper now

TECHNICAL PROJECT MANAGER

You will be a part of the SEGRON Project Team. This will be an amazing opportunity for someone to be part of a team working in next generation cutting edge technologies such as 5G, IOT, DevOps, CI/CD and test automation.

As technical project manager, you will be responsible for understanding the different customer requirements and latest technologies around 5G, VoLTE use cases and you have to setup and align related project activities together with our customers.
You should have a strong knowledge and background in the telco environment paired with project management skills to align projects, track the related KPI’s further having a strong view also on the financial performance.

Soft Skills:
Problem Solving skills:
• Analytical & technical mindset
• Good in abstraction i.e. seeing the “big picture”
• Self-Motivated & Responsible
Team player:
• collaborates with others
• teach new skills to others and write tutorials
Others:
• Good Communication Skills
• Flexible/Entrepreneurial

Hard Skills:
• Several years of experience in Telecom Domain.
• Good expertise on 5G/4G/3G technologies and should be familiar with the network call flows
• IMS/SDM/EPC domain knowledge
• Wireshark packet analysis
• Experience in Protocol testing including HTTP2, SIP, MAP, Diameter.
• Sound understanding of Telco Cloud technologies such as VNFI, Open Stack.
• Sound knowledge in Linux/CentOS, TCP/IP stack
• DevOps knowledge.

Nice to have skills:
• Understanding of 5G network elements and interfaces is plus.
• Robot Framework / Python

Specific additional information:
• You have a Telecommunications/Electronics/SW/Computer master’s degree or equivalent through experience
• PM Certification or equivalent through experience
• Very high English proficient

Others:
• Full time job
• Variety of financial and non-financial benefits
• Offered salary: from 2500 EUR (depends on experience)

DEVELOPER TEST AUTOMATION

You will be a part of the SEGRON Test Automation Development Team. This will be an amazing opportunity for someone to be part of a team working in next generation cutting edge technologies such as 5G, IOT, DevOps, CI/CD and test automation using Python, Robot.

As test automation developer, you will be responsible for understanding the different customer requirements and latest technologies around 5G, VoLTE use cases, building automation tools, framework, creating reusable python libraries for test automation.
You should have a strong knowledge and hands-on experience in test automation framework (Robot) and Python scripting language. Further you must continuously renew the automation & review guidelines set within the team. Ensure developed reusable keywords & test scripts meet the automation guideline.

Soft Skills:
Problem Solving skills:
• Analytical & technical mindset
• Good in abstraction i.e. seeing the “big picture”
• Self-Motivated & Responsible 


Team player:
• collaborates with others
• teach new skills to others and write tutorials


Others:
• Good Communication Skills
• Flexible/Entrepreneurial

Hard Skills:
• Experience in developing reusable test automation scripts using Python and Robot Framework
• Several years of experience in Telecom Domain
• Good expertise on 5G/4G/3G technologies and should be familiar with the network call flows
• Test Case development
• Mobile development
• Design Patterns
• Web development/testing
• IMS/SDM/EPC domain knowledge
• Hand-on experience in Docker containers and Kubernetes.
• Sound understanding of Telco Cloud technologies such as VNFI, Open Stack
• Sound knowledge in Linux/CentOS, TCP/IP stack
• DevOps knowledge

Nice to have skills:
• Understanding of 5G network elements and interfaces is plus
• Wireshark packet analysis
• Experience in Protocol testing including HTTP2, SIP, MAP, Diameter

Specific additional information:
• You have a Telecommunications/Electronics/SW/Computer master’s degree or equivalent through experience
• Very high English proficient

Others:
• Full time job
• Variety of financial and non-financial benefits
• Offered salary: from 2000 EUR (depends on experience)