5 Factors That Impact Telecom Test Quality

It’s no secret that test quality has a direct impact on quality of service, meaning that high quality tests can and do correlate with telco operators’ ability to attract and retain customers. And yet, as telecommunications networks become more and more complex, maintaining high quality tests for things like subscriber migrations, new network rollouts, device acceptance, etc. is becoming more difficult and time consuming than ever.

Obviously, testers need to find a way to maintain coverage and quality levels—even in the face of growing network complexity—but the path to doing so is not always clear.

For that reason, today we’ll be focusing on some of the most important factors that impact telco test quality. Hopefully, this will help you to identify some of the aspects within your own testing operations that could be improved upon, while suggesting potential paths forward for better positioning your test frameworks within the context of network quality and ROI. So, without further ado, let’s dive in!

1. Time Pressure

Telco testing is, of course, a technically complex process to begin with—and we’ll talk about those technical complexities in a bit. But for starters, it’s worth pointing out that one of the biggest hurdles to high test quality is simple time pressure.

If you don’t have enough time to design your test framework, establish relevant use cases, perform the actual service verification, and document your results within whatever timeline has been handed down, you’re going to have to either cut corners, spend money on outsourcing, rope in more engineers, or sacrifice test coverage.

Any of which can lead to problems down the road. After all, if you’re relying on manual tests, there’s not much you can do speed up service verification without sacrificing quality.

2. Complexity

As if time pressure weren’t bad enough, the increasing complexity of the modern telco environment is actually decreasing the number of test cases that your average test engineer can perform in a given day.

As the number of legacy systems that require testing increases and new devices flood the market, the potential hurdles immanent in any given deadline are actually exacerbated. Not only that, but high levels of test coverage become harder to achieve—to say nothing of the added difficulties that stem specifically from the complexity itself.

Your organization needs to keep amassing new knowledge about testing and best practices while internalizing the new standards that bodies like 3GPP are handing down to deal with new technology—no mean feat in an environment where engineers are often already spread too thin.

Unfortunately, many of the tactics that network operators use to improve coverage (outsourcing, e.g.) help speed things up at the expense of developing this knowledge base. When this happens, all of a sudden your test quality is dependent more on vendor quality than on in-house capabilities.

3. Resources/Expertise

This next factor is, in some ways, a synthesis of the first two. Your resources (whether that’s the number of devices and test engineers you can devote to a test or the accumulated domain knowledge within your organization) are ultimately the factors that determine whether a test will cover enough of the right areas to be worth your time and money while effectively verifying service.

To wit, time pressure affects test quality insofar as it impacts the time-bound resources at your disposal; complexity does the same based on your organization’s ability to understand and grapple with that complexity.

Why is this synthesis of ideas useful to you as you try to get a better handle on your test quality? Because it boils things down to a simple question: “do I have the resources to efficiently and accurately verify service?”

If the answer is yes, then you’re on pace for high quality testing. If the answer is no, then you need to figure out how you can increase or stretch your existing resources to cover the testing demand. If you’re doing things by hand, this might mean looking into automation.

4. Virtual vs. Out-of-the-Box Devices

So far, we’ve been talking about things that could easily apply to end-to-end testing across multiple different fields. This one, however, is a little more specific to the telecom domain: are your tests being performed on the specific equipment that users will actually make use of out in the field (i.e. out-of-the-box devices), or are you using rooted, jailbreaked ,or simulated devices?

This can be a major determining factor in the accuracy of your tests and your ability to ensure network functionality. The more complex and varied telco networks get (and the more demanding your average customer becomes), the greater the likelihood that small differences between simulations and reality will mask real gaps in your functionality.

If you’re testing VoLTE across a handful of simulated Android devices, for instance, tiny differences in packet loss or latency between the simulated devices and real, end-user devices might cause testers to deem something a successful call that, in the field, won’t meet customer standards.

5. Use Case Design

Lastly, we get to use cases. How effectively are you defining use cases that require verification, how successfully are you scripting or otherwise orchestrating those use cases, and how many of the relevant use cases are you running through?

This is partially another way of saying that testing coverage is one of the biggest predictors of testing quality—but it’s also a suggestion that, given the new levels of complexity telcos are dealing with, a use case-based mindset is becoming increasingly crucial.

As we move towards more widespread 5G adoption—and sub-millisecond latency times become the norm, driving an influx of IoT and other new devices into the telecom world—use cases will continue to proliferate.

Test engineers will have to get smarter and smarter about defining and carrying out test cases in order to keep pace. If you’re unable to define appropriate use cases as your network’s usage changes or you’re unable to actually test what may prove to be hundreds of test cases, you run the risk of a dip in test quality.

If, conversely, you have the resources, know-how, and technology to take new and emerging test cases in stride, your network will reap the benefits.

Search

Interested in our Products ?

Scroll to Top
Segron logo black blue

Senior SaaS System Administrator

Technical Skills :
  • Oversee the sysadmin related tasks in our SaaS infrastructure (partially cloud based, partially bare metal)
  • Daily operation and maintenance of the system
  • Analysing and resolving incidents
  • Follow and help improving the incident and change management procedures
  • Design procedures for system troubleshooting and maintenance
  • Incorporating base OS updates and security patches
  • Ensure that systems are safe and secure against cybersecurity threats by raising change requests where potential threat is possible
  • Performing SW updates for the Segron SaaS SW stack (distributed architecture with clusters)
  • Configuring solutions like reverse proxy, firewalls, etc.
  • Building tools to automate procedures & reduce occurrences of errors and improve customer experience
  • Tutoring & coaching newcomers & less senior experts in the team
  • Interworking with the architects and IT admins of Segron to have the SaaS procedures inline with the Segron processes
Non-technical skills:
  • We are looking for a self-motivated, self-improving individual with a highly independent mindset and open and straightforward technical communication to help us to improve and maintain our cloud infrastructure of our powerful end-to-end testing solution ATF (Automated Testing Framework)
  • 3+ years hands-on experience with operation and monitoring of cloud / linux systems
  • 3+ years of hands-on experience with network devops elements: configuring routers, switches, networks
  • Hands-on experience with running live systems with infrastructure as a code mode of operation
  • Specific knowledge which brings direct advantage: Docker, Docker Compose, Grafana, Prometheus, Ansible, Debian Linux OS administration, Security
  • Experience in building and maintaining distributed systems (incl. redundancy, resiliency, load-balancing) is welcome
  • Excellent knowledge of English
Location :
  • Place of work: Bratislava (partially home office possible)
  • Rate: from 30 EUR/hour (possible higher rate, depends on experience)
Segron logo - The Next Generation of Active Testing
Segron logo black blue

CI/CD Senior Developer

Technical Skills :
  • A senior role with a proven expertise in software development, cloud computing, DevOps, and CI/CD
  • Experience in planning, designing, and overseeing the CI/CD strategy and architecture on the level of organization
  • Ability to tailor testing strategies which define and follow the best practices, standards, and policies for the software delivery process
  • Hands-on experience in creating and managing CI/CD pipelines and workflows (PaaC)
  • Ability to evaluate and recommend the best tools, technologies, and methodologies for the CI/CD implementation
  • Prior hands-on experience working with different CI/CD toolsets (Jenkins, Bitbucket, GitLab, artifactory, Ansible ..)
  • Proficient with DevOps tools API automation capabilities
  • Proficient with Atlassian Tools (BitBucket, Jira, Confluence) and agile SW development methodologies
  • Familiar with cloud patterns and best practices
  • Familiar with web performance best practices
  • Comfortable working in cloud DevOps ecosystem
  • Comfortable working with Linux platforms
  • Initial working experience in SW development is an advantage.
Non-technical skills:
  • Effective communication with technical as well and business stakeholders
  • Self-motivating, self-improving mindset
  • Ownership of relevant industry certificates is a plus
Location :
  • Location: Bratislava, Slovakia (with hybrid flexibility)
  • Rate: from 30 EUR/hour (possible higher rate, depends on experience)
Segron logo - The Next Generation of Active Testing
Segron logo black blue

Test Automation Engineer

Job description, responsibilities:

Hardware Testing: Conduct verification and testing of hardware during the HW/SW products
assembly process.
Technical Support: Provide technical assistance during testing activities and troubleshoot any
hardware issues that arise. Support to internal teams and customers by managing priorities and
meeting deadlines.
Equipment Maintenance: Configure and maintain SEGRON laboratory and customer equipment.
Logistics Support: Handle hardware ordering and logistics.
Troubleshooting: Analyze and resolve SEGRON product issues through effective problem-solving.
Ability to troubleshoot and resolve issues that arise during the integration process.
Collaboration: Work with the SEGRON Development Team on product or software issues and assist
the Project Team with planned activities.
Root Cause Analysis: Investigate production errors to identify underlying causes.
Software Deployment: Implement software updates and fixes.
Team Collaboration: Ability to work collaboratively in a team environment, especially in serving global
customers.

Requirements/ Skills:

Networking knowledge: Understanding TCP/IP networks and LAN/WAN configurations. Routing and
switching and related protocols strongly desired.
Hardware Proficiency: Understanding of hardware components, including servers, routers, and
peripherals, to ensure proper assembly and integration. Experience in data centers is a plus.
Travel Abilities: Willing to travel for customer on-site support for hardware installations, migrations,
upgrades, troubleshooting, etc. (few times a year, 3-5 days)
Hand Tools: Proficiency in using hand tools like screwdrivers, pliers, crimpers, and punches for
assembling and disassembling components.
Operating Systems: Knowledge of Linux and Windows. VM experience (Hyper-V, VMWare, Oracle
Virtual Box, Proxmox etc.)
Tools Proficiency: Basic understanding of Ansible.
Telecommunications Experience: Previous experience in the telecom sector is a plus.
Education: Degree in Computer Science/Engineering or equivalent work experience.
Experience: At least 2 years of relevant work experience preferred. A strong desire to continuously
improve skills and knowledge in hardware and software integration, with an openness to feedback and
new ideas. Key is openminded person willing to learn fast in great team.
Communication Skills: Effective oral and written Eng

Others:

• Full time job (employment)
• Onsite work during onboarding period, then it can be 3 days onsite, 2 days home office
Offered salary: from 2000 Euro (depends on seniority and skills level)
Variety of financial benefits
Place of work: Bratislava

Segron logo - The Next Generation of Active Testing
Segron logo black blue

Senior Python Developer

Technical Skills :

  • A solid, experienced SW developer with at least 10 years of experience in active SW development in different programming paradigms
  • Minimum 5 years of professional Python development experience
  • Master or college degree from Computer Science, Mathematics or STEM domain
  • Well educated in design and programming patterns that increase software’s efficiency and readability.
  • Very good analytical and problem solving skills.
  • At least three skills out of the following 4 skills are requested:
    • Microservices based architectures (Docker containers)
    • Linux
    • Ansible
    • Robot  Framework
  • Comfortable with sysadmin and DevOps skills (Ansible, YML files, Network Programming, IP protocols, designing and developing proxy servers for different protocols – example: streaming, integrating and compiling third party libraries on Linux (Debian))
  • Proficient with Atlassian Tools (BitBucket, Jira, Confluence) thorough understanding of Git and version control best practices
  • Familiar with cloud patterns and best practices
  • Familiar with web performance best practices

Non-technical skills:

  • Ability to work under pressure
  • Ability to abstract and explain your work
  • Strong understanding of Agile development process and experience working in an agile team
  • Strong communication skills with both technical and non-technical stakeholders
Location :
  • Bratislava, Slovakia (with hybrid flexibility)
  • Rate: from 35 EUR/hour (possible higher rate, but depends on experience)
Segron logo - The Next Generation of Active Testing