Nagra DTV Achieves 4X Faster Test Automation with Testsigma

Discover how Nagra automated testing for a cross-platform app runs across multiple mobile devices and Android TV platforms with Testsigma

2500

Test Cases Automated

Faster Automation

25%

Reduced Test Cycle

Industry

Media and Entertainment

Headquarters

Switzerland

Table Of Contents

1 About Nagra:
2 From In-House Automation Framework to Seeking a Scalable Solution
3 Discovering Testsigma: A Solution That Checks All Boxes
4 I commend Testsigma’s vision in supporting organizations in their test automation journey. Their tool is maintenance-free and comes with built-in capabilities that significantly speed up the automation process.
5 Testsigma is an outstanding customer-focused solution. By transitioning from our in-house framework for our OTT application, we increased our test case creation speed by 400% and completely eliminated manual testing for our 2500 automated test cases. The ease of debugging and comprehensive device coverage ensures we deliver high-quality releases every quarter. Our team quickly adapted to the platform, showcasing its user-friendly nature.
6 Realizing the Full Potential of Automation with Testsigma
7 The Way Forward

About Nagra:

Nagra DTV, a division of the Kudelski Group, is a global leader in providing content providers and digital TV operators worldwide with secure, open and integrated platforms and applications over broadcast, broadband and mobile platforms

From In-House Automation Framework to Seeking a Scalable Solution

Nagra’s OTT applications portfolio, including Web, iOS, Android, and multiple other TV OS platforms, is built on a single code base to scale across different operating systems. Before adopting Testsigma, Nagra ran automated tests using an in-house automation framework built with WebDriver IO and Node.js to test their applications. However, this framework presented several challenges:

Slow Automation Process: Developing a single test case took one to two days due to the intricate nature of end-to-end system integration testing, despite having experienced automation specialists.
Complexity and Maintenance: The in-house framework demanded significant time and knowledge to maintain and debug scripts.
Scalability Issues: The framework was limited in its ability to scale across new devices entering the market, hindering timely and quality releases.

Discovering Testsigma: A Solution That Checks All Boxes

Nagra’s OTT application team looked for a solution that would:

1. Support automation across multiple platforms with minimal changes.
2. Offer low-code or no-code capabilities to enable faster script creation and easier maintenance.
3. Enhance the efficiency of their DevOps to meet their customer demands of frequent releases.

They evaluated several tools and found Testsigma to address their requirements:

Cross-Platform Compatibility: Automation scripts written for one platform (e.g., Android) could run on others (e.g., iOS) platforms without significant modifications. Testsigma also helped support automating OTT apps running on different Android TV platforms such as FireTV, Nokia, SEI, etc.
Built-in Cloud Lab: With Testsigma’s inbuilt device farm support, the team was able to use different device versions on the cloud and execute the tests.
Ease of Use: With NLP and record & playback approaches, even newly onboarded engineers could quickly become proficient.
Improved Efficiency: Testsigma enabled the team to create three to four test cases per day, compared to one to two days per test case with the in-house framework. Testsigma also helped in developing new Addons that were required for automating TV App use cases
Enhanced Debugging: Detailed logs and video session recordings (mainly for Web, Android / iOS handheld devices) made debugging straightforward, allowing testers to pinpoint exactly where a test case failed.
Test Reusability: Step groups allowed for reusable code blocks, simplifying maintenance and updates.

I commend Testsigma’s vision in supporting organizations in their test automation journey. Their tool is maintenance-free and comes with built-in capabilities that significantly speed up the automation process.

Sathish Babu

Sr. Engineering Manager, Nagra

Realizing the Full Potential of Automation with Testsigma

The team began using Testsigma with a team of five to six skilled automation engineers. After becoming familiar with the tool, they extended its use to other team members, fully leveraging its potential

Faster Test Development: The team increased their test development speed by 3x to 4x.

Automation Coverage: Nagra’s OTT application team automated 2500 test cases in less than 8 months, eliminating the need for manual testing.

Pipeline Integration: Their CI/CD pipeline ran these 2500 tests daily using Testsigma’s scheduler, ensuring continuous testing and quick feedback to developers.

Device Variety: Testsigma’s cloud-based device options (Browser, Android / IOS handheld devices) allowed Nagra to test across numerous hardware variants, thereby detecting issues that were limited by hardware constraints.

Resource Efficiency: Debugging and test maintenance effort is relatively low, leading to better utilization of their engineer’s time.

Testsigma is an outstanding customer-focused solution. By transitioning from our in-house framework for our OTT application, we increased our test case creation speed by 400% and completely eliminated manual testing for our 2500 automated test cases. The ease of debugging and comprehensive device coverage ensures we deliver high-quality releases every quarter. Our team quickly adapted to the platform, showcasing its user-friendly nature.

Sathish Babu

Sr. Engineering Manager, Nagra

The Way Forward

Sathish says “They’re excited for Testsigma to extend support to Smart TV variants like Samsung Tizen and LG WebOS, making Testsigma indispensable for our automation needs”