segron logo

How (and Why) You Should Test on Flagship Devices

According to Apple, in the last quarter of 2019, the recently-released iPhone 11, iPhone 11 Pro, and iPhone 11 Pro Max made up nearly 70% of all American iPhone sales. It’s often been remarked that any data Apple happens to share should be taken with a grain of salt (they don’t release information about how many units they actually move), but even if this trend is exaggerated, it’s still fairly telling. In the US at least, mobile users are going out of their way to seek out the latest and greatest smartphones—and the odds are pretty high that some of those mobile users are subscribers on your network.

So, imagine their chagrin when they activate their new phone—excited to use its OLED screen and triple camera system—only to find themselves mired in network connectivity issues. iPhones are such high-profile devices that there would be an immediate outcry, but with new phones from other manufacturers, it might take a while for the issues to come to light. By that time, you’ve already lost the support of many of these users.  

 

How Out-of-the-Box Smartphones Impact Test Quality

The situation we outlined above might seem grim, but as luck would have it, there are proven ways to minimize that. Step one: test on the devices that users are utilizing to connect to your network. This sounds simple enough, but testers are often tempted to go the other way due to time pressure or perceived ease of automation. Usually, this takes the form of testers making use of devices that have been subject to rooting or jailbreaking. Considering the increasing complexity of the average telco network, it’s easy to imagine why someone would try to take a shortcut by mainly hacking devices to install testing software, but the result is tests that are less reliable than tests performed on devices out-of-the-box. Why? Because by making changes to the device iOS, you’re changing it just enough that it’s no longer a representative sample of other devices of its make, model, and firmware version. As a result, tiny differences in functionality can begin to add up to significant discrepancies.

Luckily, you don’t need to root or jailbreak your devices to automate testing. Instead, you can connect out-of-the-box devices—identical to the ones your subscribers are using—to a test server that primarily uses robotic process automation to dial numbers, perform calls, send SMS messages, and track the results in terms of both passage/failure of tests and protocol-level activity. These devices slot into automation flows just as seamlessly (we would often argue more seamlessly) then their rooted counterparts, but they don’t present the same downsides. Instead, they provide you with the closest possible recreation of real network usage conditions. 

 

The Importance of Flagship Devices

When it comes to testing on flagship devices, in particular, the rationale is essentially the same as the reasoning that was presented above. If your users are flocking to flagship devices as they’re released, they’re going to expect high network quality once they connect with their new devices. If you haven’t tested using these same devices, there’s a chance that something can go wrong, and that they won’t be able to place calls, use data, or otherwise use their phones as they expect to. Even when it comes to less high profile devices, that desire is still going to be there, and without proper service verification, as new devices enter the market, you’re going to run into issues. As technology changes and evolves, this will only become more true. To wit, the first generation of proper 5G-enabled phones has been trickling into the market for about a year now—and they’re equipped with different antennae and radio hardware than the prior generation of smartphones, such that they can connect to the new spectrums designated for millimeter-wave use. This presents a challenge for testers since there’s no realistic way to replicate these changes without using the devices themselves.

And this line of reasoning doesn’t just extend to phones. As we enter the IoT (internet of things) era, the number of cutting edge connected devices is increasing every year—putting considerable pressure on telco testers. Because IoT use cases can often be extremely high leverage (think of the eCall modem in a modern EU-based car that facilitates emergency calls in the case of an accident), the stakes are high, and it’s essential to have workflows in place, where you can test on the latest devices as efficiently as possible. Otherwise, your test lab runs the risk of missing important issues that could impact your subscribers. 

Automating Flagship Devices

As we said above, telco testers often look to rooting and jailbreaking to incorporate devices more easily into automation flows. After all, if you can’t test flagship devices within the context of test automation, there’s little hope of maintaining high test coverage or throughput. Thus, you might still be thinking of rooting as a last resort for testing on the absolute latest phones. But does rooting really speed up the process? Not necessarily. In SEGRON’s ATF (Automated Test Framework), it’s actually possible to incorporate new devices into the framework within a matter of hours. In this way, testers can incorporate the latest devices into their test lab operations without a hitch.

As you can probably guess from the preceding, once they’ve been automated in this way, there’s no need to root them. Instead, you can simply orchestrate tests, as usual, no doubt putting extra emphasis on conformance tests to ensure that any new firmware specifications play nicely with your network. Not only does this put you on a path to higher test coverage, but it also puts you in a position to address your subscribers’ needs proactively. With any luck, this can give you a competitive advantage over other operators in your area who might not be verifying functionality for the flagship iOS or Android devices that are just coming onto the market.

 

Download our latest eBook and Learn more about how Test Automation can speed up Time-to-Market, improve CX and more.

Search
Tags

Interested in our Products ?

Scroll to Top
Segron logo black blue

Senior SaaS System Administrator

Technical Skills :
  • Oversee the sysadmin related tasks in our SaaS infrastructure (partially cloud based, partially bare metal)
  • Daily operation and maintenance of the system
  • Analysing and resolving incidents
  • Follow and help improving the incident and change management procedures
  • Design procedures for system troubleshooting and maintenance
  • Incorporating base OS updates and security patches
  • Ensure that systems are safe and secure against cybersecurity threats by raising change requests where potential threat is possible
  • Performing SW updates for the Segron SaaS SW stack (distributed architecture with clusters)
  • Configuring solutions like reverse proxy, firewalls, etc.
  • Building tools to automate procedures & reduce occurrences of errors and improve customer experience
  • Tutoring & coaching newcomers & less senior experts in the team
  • Interworking with the architects and IT admins of Segron to have the SaaS procedures inline with the Segron processes
Non-technical skills:
  • We are looking for a self-motivated, self-improving individual with a highly independent mindset and open and straightforward technical communication to help us to improve and maintain our cloud infrastructure of our powerful end-to-end testing solution ATF (Automated Testing Framework)
  • 3+ years hands-on experience with operation and monitoring of cloud / linux systems
  • 3+ years of hands-on experience with network devops elements: configuring routers, switches, networks
  • Hands-on experience with running live systems with infrastructure as a code mode of operation
  • Specific knowledge which brings direct advantage: Docker, Docker Compose, Grafana, Prometheus, Ansible, Debian Linux OS administration, Security
  • Experience in building and maintaining distributed systems (incl. redundancy, resiliency, load-balancing) is welcome
  • Excellent knowledge of English
Location :
  • Place of work: Bratislava (partially home office possible)
  • Rate: from 30 EUR/hour (possible higher rate, depends on experience)
Segron logo - The Next Generation of Active Testing
Segron logo black blue

CI/CD Senior Developer

Technical Skills :
  • A senior role with a proven expertise in software development, cloud computing, DevOps, and CI/CD
  • Experience in planning, designing, and overseeing the CI/CD strategy and architecture on the level of organization
  • Ability to tailor testing strategies which define and follow the best practices, standards, and policies for the software delivery process
  • Hands-on experience in creating and managing CI/CD pipelines and workflows (PaaC)
  • Ability to evaluate and recommend the best tools, technologies, and methodologies for the CI/CD implementation
  • Prior hands-on experience working with different CI/CD toolsets (Jenkins, Bitbucket, GitLab, artifactory, Ansible ..)
  • Proficient with DevOps tools API automation capabilities
  • Proficient with Atlassian Tools (BitBucket, Jira, Confluence) and agile SW development methodologies
  • Familiar with cloud patterns and best practices
  • Familiar with web performance best practices
  • Comfortable working in cloud DevOps ecosystem
  • Comfortable working with Linux platforms
  • Initial working experience in SW development is an advantage.
Non-technical skills:
  • Effective communication with technical as well and business stakeholders
  • Self-motivating, self-improving mindset
  • Ownership of relevant industry certificates is a plus
Location :
  • Location: Bratislava, Slovakia (with hybrid flexibility)
  • Rate: from 30 EUR/hour (possible higher rate, depends on experience)
Segron logo - The Next Generation of Active Testing
Segron logo black blue

Test Automation Engineer

Job description, responsibilities:

  • ATF system configuration, integration, operations & maintenance in customer environments.
  • Building tools to automate procedures & reduce occurrences of errors and improve customer experience.
  • Hardware Verification, Testing and Preparation within the Staging Process.
  • Contribution to customer and service partner technical support across multiple accounts by sufficiently managing priorities and deadlines for own work.
  • Segron Laboratory equipment configuration and maintenance support.
  • Hardware order and logistics support.
  • Problem analysis of ATF issues, troubleshooting and fault correction.
  • Interface towards SEGRON Development Team in case of product or software issues.
  • Interface towards the SEGRON Technical Sales Team to support planned activities.
  • System and Integration documentation and guidelines.
  • Perform root cause analysis for production errors.
  • Deployment of software updates and fixes.
  • Ability to work in a team environment serving multiple global customers.
Requirements/ Skills:
  • Excellent knowledge of English
  • Operating Systems: Linux, Windows, MacOS
  • Good Knowledge of Containers and Virtual Machines
  • Telco experience welcome
  • Python or other scripting experience or knowledge preferable
  • Educational Qualification: Computer Science/Engineering or work experience equivalent
  • Work Experience: 3-4 years preferred
Others:
  • Full time job (employment)
  • Offered salary: from 1500 Euro (possible higher, depends on seniority and skills level)
  • Variety of financial benefits
  • Place of work: Bratislava
Segron logo - The Next Generation of Active Testing
Segron logo black blue

Senior Python Developer

Technical Skills :

  • A solid, experienced SW developer with at least 10 years of experience in active SW development in different programming paradigms
  • Minimum 5 years of professional Python development experience
  • Master or college degree from Computer Science, Mathematics or STEM domain
  • Well educated in design and programming patterns that increase software’s efficiency and readability.
  • Very good analytical and problem solving skills.
  • At least three skills out of the following 4 skills are requested:
    • Microservices based architectures (Docker containers)
    • Linux
    • Ansible
    • Robot  Framework
  • Comfortable with sysadmin and DevOps skills (Ansible, YML files, Network Programming, IP protocols, designing and developing proxy servers for different protocols – example: streaming, integrating and compiling third party libraries on Linux (Debian))
  • Proficient with Atlassian Tools (BitBucket, Jira, Confluence) thorough understanding of Git and version control best practices
  • Familiar with cloud patterns and best practices
  • Familiar with web performance best practices

Non-technical skills:

  • Ability to work under pressure
  • Ability to abstract and explain your work
  • Strong understanding of Agile development process and experience working in an agile team
  • Strong communication skills with both technical and non-technical stakeholders
Location :
  • Bratislava, Slovakia (with hybrid flexibility)
  • Rate: from 35 EUR/hour (possible higher rate, but depends on experience)
Segron logo - The Next Generation of Active Testing