5 Keys to a Successful IoT Testbed

Up to this point, the most common use cases for the IoT have continued to be industrial: tracking pallets as they move through a warehouse, monitoring inventory levels, analyzing machine usage, etc. But with the advent of 5G, consumer applications for this technology are going to become much more prevalent.

Especially as the speed of over-the-air data transfers become comparable to sending the same information over a wire. To handle this inevitable influx, the 3GPP has been setting standards and protocols for NB-IoT, with a focus on Low Power Applications (LPWA) over licensed spectrum bands.

As of right now, a critical mass of telco operators and other IoT users have adopted the 3GPP’s standards, making it the closest thing to a consensus choice for operating this technology. These standards, however, are just the beginning.

Many telco operators and equipment manufacturers are going to have to develop and operate robust IoT testbeds in order to keep pace with the rapid rate of technological change. To that end, here are a few keys to running a successful testbed for this emerging technology.

1. Consider Mobility

One of the most significant challenges for telco testers working with IoT devices is also one of the technology’s most valuable features for consumers: mobility. Picture a Fitbit or a smart watch: These devices are constantly transmitting data as the users go about their daily business.

As they move about their city or town, they log distance travelled, locations, and other information that users can review later on their smartphones or home computers. This is fairly typical functionality—but it raises important questions for testers:

  • What happens if the device can’t connect to the network?
  • Can the device fall back on legacy networks, or does it have local storage (such that it can send the information again later)?
  • How quickly does the device battery drain when it’s away from a charging station?
  • What happens if the application loses connection to the application server?

These are critical questions for any IoT deployment, but because they’re based on mobility, it’s difficult to test them in a lab setting. Testers might consider using attenuators and RF matrixes to simulate changes in LTE signal strength like the ones a subscriber on the move might experience.

2. Prioritize Security

Often, it seems like IoT deployments treat security as an afterthought, prioritizing innovation first and then trying to append a layer of security on top of the existing infrastructure. This is, to be blunt, a recipe for disaster.

Whether you’re building out new IoT applications in your test lab or simply verifying acceptance of new devices on your network, you’ll need to include security-related KPIs and testcases as part of your standard test suites.

If you treat data security, encryption, and access control like afterthoughts, they’ll feel like afterthoughts to users—who may seek out devices, applications, and networks that pose less risk.

3. Analyze Results on a Protocol Level

As a tester working with new technologies, you have a slightly different set of concerns than you might have otherwise. If you’re rolling out a new HSS database to handle subscriber information, your goal is to make sure that the whole data collection and maintenance process function from end-to-end.

If it does, you can be reasonably confident about the migration. If there are gaps or errors in the workflow, end-to-end tests will typically help you to pinpoint the issue and resolve it. With an IoT testbed, on the other hand, end-to-end tests aren’t always enough.

Instead, you might gain some value by going beyond end-to-end and examining the signalling and protocol data produced by the system-under-test. Doing this by hand can be overly complex and time-consuming, but within the context of an automated testing solution you can incorporate this data into your final test reports.

In this way, you can get a much earlier read on any issues that may be developing, and you can gain a clearer understanding of exactly what is happening on a protocol level as you develop new use cases for IoT technology.

4. Test 24/7

In the section above, we hinted at the potential value of an automated telecom test solution integrated into your IoT testbed’s infrastructure. Analyzing signal traces is a potentially value-additive use case for such a solution—but it’s far from the only one. To wit, automation can also power 24/7 testing within your testbed. Why is this valuable? For a number of reasons:

  • 24/7 testing increases test velocity, which in turn helps you to integrate cutting edge technology like the IoT into your network more quickly.
  • Tests that can be run 24/7 can also be limited to off hours when engineers aren’t working, saving testers the trouble and inconvenience of waiting for low traffic load in the system-under-test before testing.
  • Round-the-clock testing makes it easier to incorporate regression tests into your standard test suites. This is critical for testbeds in particular, because changes that could affect network connectivity and other factors are being made constantly.

Since time-to-market is of particular importance with new technologies, the ability to test round-the-clock can be a major factor in giving you an edge over the competition.

5. Make Your Findings Readable and Accessible

This advice is true not just for IoT testbeds—or even testbeds in general—but it certainly bears mentioning in this context. No matter how innovative your technology is, or how thorough your verification passes are, your testbed’s value will be severely limited if users elsewhere in your organization can’t access and understand the results.

For issues of access, it’s helpful to make sure that your testing efforts aren’t conducted in a silo. Make sure that you’re storing documentation where it’s accessible to those who need it, and that it’s in a format that people can work with.

As for readability, it’s worth considering the value of something like keyword-based tests. In these kinds of workflow, tests are executed via readable, pre-defined keywords—and the subsequent reporting automatically leverages those same keywords.

This makes the test results easy to understand for technical and non-technical users alike, meaning that the impact any experiments conducted in your IoT testbed can be maximized throughout your operation.


Device Testing
Jari Nurminen

Jari Nurminen

Jari has over 20 years of experience in software development, test automation and telecommunications. His expertise includes delivering Telecom and ICT solutions to major European carriers. As Chief Technology Officer (CTO), Jari leads the operation for the whole Automatic Test Framework ecosystem and the R&D department at Segron.

Interested in our Products ?

Scroll to Top
SEGRON Logo Black Blue

Senior SaaS System Administrator

Job description, responsibilities:
  • Oversee the sysadmin related tasks in our SaaS infrastructure (partially cloud based, partially bare metal)
  • Daily operation and maintenance of the system
  • Analysing and resolving incidents
  • Follow and help improving the incident and change management procedures
  • Design procedures for system troubleshooting and maintenance
  • Incorporating base OS updates and security patches
  • Ensure that systems are safe and secure against cybersecurity threats by raising change requests where potential threat is possible
  • Performing SW updates for the Segron SaaS SW stack (distributed architecture with clusters)
  • Configuring solutions like reverse proxy, firewalls, etc.
  • Building tools to automate procedures & reduce occurrences of errors and improve customer experience
  • Tutoring & coaching newcomers & less senior experts in the team
  • Interworking with the architects and IT admins of Segron to have the SaaS procedures inline with the Segron processes
Requirements / Skills:
  • We are looking for a self-motivated, self-improving individual with a highly independent mindset and open and straightforward technical communication to help us to improve and maintain our cloud infrastructure of our powerful end-to-end testing solution ATF (Automated Testing Framework)
  • 3+ years hands-on experience with operation and monitoring of cloud / linux systems
  • 3+ years of hands-on experience with network devops elements: configuring routers, switches, networks
  • Hands-on experience with running live systems with infrastructure as a code mode of operation
  • Specific knowledge which brings direct advantage: Docker, Docker Compose, Grafana, Prometheus, Ansible, Debian Linux OS administration, Security
  • Experience in building and maintaining distributed systems (incl. redundancy, resiliency, load-balancing) is welcome
  • Excellent knowledge of English
  • Full time job (employment)
  • Offered salary: from 1800 Euro (depends on seniority and skills level)
  • Variety of financial benefits
  • Place of work: Bratislava (partially home office possible)
SEGRON Logo Black Blue

Senior Python Backend Developer

Job description, responsibilities:

  • Develop, apply and if needed refactor, back-end architecture for ATF GUI
  • Compile and analyze data, processes, and codes to troubleshoot problems and identify areas for improvement.
  • Cooperate with the front-end developers and other team members to establish objectives and design more functional, cohesive codes to enhance the user experience.
  • Researching, designing, implementing, testing, and managing software
  • Recommend and execute improvements to software.
  • Writing and implementing efficient and clean code
  • Integrate software components and third-party programs.
  • Verify and deploy programs and systems.
  • Troubleshoot, debug, and upgrade existing software.
  • Maintaining and upgrading existing systems
  • Create technical documentation for reference and reporting.

Requirements / Skills:

  • 7+ years in SW development
  • 3-5+ years in following technology stack:
    • Backend: Python
    • Database: PostgreSQL
    • Frameworks: Django
  • Knowledge and hands-on experience with microservices: RabbitMQ, celery, etc.
  • Git knowledge
  • Experience with Atlassian Tools (BitBucket, JIRA, Confluence)
  • Experience in working in agile processes and teams.
  • Strong communication skills with both technical and non-technical stakeholders (stakeholders (Project Managers, Product Owners, etc.)
  • Willingness to write e2e testcases in Robot Framework and use Jenkins CI for code testing.


  • Full time job
  • Offered rate: from 30 Euro/hour (depends on seniority and skills level)
SEGRON Logo Black Blue

Linux IT Engineer

Service summary

  • Understand SEGRON’s technology, product, and IT systems
  • Design, set-up, install and transition SEGRON IT services towards Linux cloud deployments
  • Administer and manage applications of SEGRON Linux IT system landscapes
  • Act as direct contact person for an external team of Linux security experts and be responsible for service operations (requests, changes, problems, incidents)
  • Provision and maintain Linux clients/servers in production and development environments
  • Preparing cost estimates for System security enhancements
  • Testing the final security system and updating and upgrading it as needed.
  • Responding quickly and effectively to all security incidents and providing post-event analyses
  • Monitoring the IT security supplier, cultivating a sense of security awareness within our organization, and arranging for continuous education
  • Remaining up to date with the latest security systems, standards, authentication protocols, and products
  • Representing SEGRON in case of security audits driven by suppliers

Skills & Qualifications

  • Interest in digital system landscapes, web technologies and cloud computing
  • Enthusiasm for innovation, technology, learning and knowledge
  • Solid Python scripting knowledge
  • Strong technical problem-solving skills and experience in IP networking and static routing FTP, SSH, SMTP, DNS, HTTP/S, DHCP, SMB/NFS, Syslog logging facility
  • Solid understanding of operating databases and file systems
  • Solid understanding of server deployment, configuration and troubleshooting common issues
  • Experience with automation/configuration management using Ansible and YAML playbooks
  • Experience of monitoring tools and statistics – InfluxDB, Grafana
  • Excellent customer communication skills
  • Team player, willing to help, flexible
  • Excellent knowledge of English


  • Full time job
  • Offered rate: from 35 EUR/hour (depends on seniority and skills level)