Why separate Quality Engineering and Quality Assurance

 
by Martin Tyler,  6th March 2024
Uncategorized

In the realm of business operations, structuring the quality function and clearly defining responsibilities are crucial, with each methodology carrying its unique set of pros and cons.

Consider the strategy where a dedicated Quality Assurance (QA) team is responsible exclusively for manual testing, leaving the development team to craft automation tests. While this seems efficient, it inherently faces a challenge: development teams are primarily focused on creating and enhancing connected TV applications. Consequently, automation often takes a backseat, resulting in a disproportionate emphasis on manual testing over automated testing coverage. This leaves many features only tested in often infrequent manual regressions increasing the likelihood of regressions that fit a high number of defects.

An alternative model involves the QA team handling both manual and automated testing. However, this approach isn’t without its drawbacks. The QA team’s primary focus tends to be on testing new feature tickets as they arise, which can inadvertently lead to a reduced emphasis on expanding automated test coverage.

At FX Digital, we’ve embraced an innovative approach to quality assurance that sets us apart in the industry. We strike a balance between manual and automated testing, ensuring comprehensive coverage and maintaining a high standard of quality in all our projects. This equilibrium not only optimises our testing processes but also underscores our commitment to delivering exceptional digital solutions. We have strategically redefined our quality functions. Our system involves the formation of two specialised teams, each possessing a unique set of skills and dedicated responsibilities. This division not only enhances the effectiveness of our quality assurance processes but also brings an array of benefits, ensuring the highest standards Quality assurance.

The Quality Assurance team

The Quality Assurance (QA) at FX Digital team plays a pivotal role in upholding the quality of our client projects, setting a benchmark in the industry. This team, composed of highly skilled professionals, excels in the meticulous design and execution of both manual and automated test cases. Their proficiency extends beyond mere testing; they are adept at scrutinising test results and functional specifications, ensuring that every aspect of the software meets the requirements and our own rigorous standards.

The QA team’s expertise extends beyond testing procedures.They are deeply versed in various software development life cycle (SDLC) methodologies. This knowledge allows them to seamlessly integrate quality assurance processes throughout the development cycle, from initial design to final deployment. By understanding and applying the best practices in SDLC, they play a crucial role in streamlining development processes, which in turn enhances the overall quality and efficiency of our projects.

A significant aspect of the QA team’s responsibility is defining and implementing standards and methodologies for software testing. They are tasked with creating comprehensive testing strategies and plans, ensuring that every project undergoes a thorough and systematic evaluation. This meticulous approach is crucial in maintaining consistency and excellence across all our projects.

Furthermore, the team conducts regular audits to ensure compliance with these established standards. These audits are integral in identifying areas of improvement, ensuring that the QA processes evolve continuously to meet the changing demands of the industry and our clients.

The QA team’s commitment to ensuring best practices in software testing is instrumental in maintaining the high quality of our projects. They serve as the guardians of quality, ensuring that every project we deliver is not only functional but also meets the highest standards of reliability and performance.

The Quality Engineering team

Conversely, in the Quality Engineering (QE) team at FX Digital we focus on technological innovation, focusing on the development, support, and maintenance of bespoke automation solutions tailored for the QA team. Our team has an expertise in programming, mastery of automation tools, software architecture, and proficiency in Continuous Integration (CI) pipelines.

Our responsibilities extend beyond mere development. They are instrumental in managing and upholding the infrastructure that is vital for our testing processes. This includes the meticulous construction and ongoing maintenance of our state-of-the-art device lab, ensuring that it remains at the forefront of technological advancements. Additionally, they oversee the development and upkeep of sophisticated pipelines that are crucial for the seamless execution of automated tests.

Our ability to engineer and refine automation solutions doesn’t just streamline workflows; it significantly enhances the precision and reliability of our testing outcomes. By continuously innovating and adapting to the latest technological trends, we ensure that our testing infrastructure remains robust and cutting-edge.

In essence, our contributions are fundamental to the success of FX Digital’s quality assurance endeavours, but with a different focus to QA. Their technical skills and dedication to maintaining and advancing our testing infrastructure play a pivotal role in ensuring that we deliver software solutions of the highest quality, reinforcing our commitment to excellence and innovation in the digital realm.

Why this works better for FX Digital

The delineation of these roles offers numerous advantages. It allows for focused expertise in each team, with QA professionals honing skills in test design and process improvement, and QE professionals deepening their technical knowledge in automation and infrastructure. This leads to more thorough and effective outcomes in both testing and development of our specialised connected TV framework.

Moreover, this structure fosters efficiency and effective collaboration. Each team, being an expert in their respective area, completes tasks with greater precision and speed. Clearly defined roles and responsibilities enhance communication within and between teams.

This laser focus enables them to substantially advance automation efforts. In contrast, many companies rely on their developers to create automation tests. However, since these tests are often viewed as a lower priority, they frequently remain unwritten. By clearly delineating functions and assigning specific responsibilities, FX Digital has successfully achieved and consistently maintained exceptionally high coverage rates, exceeding 65% across all projects. This strategic separation not only streamlines our processes but also ensures the utmost quality and efficiency in our deliverables.

You might wonder if our approach limits the learning opportunities for the QA team, but in reality, it actually enhances it by streamlining the process of writing automated test cases as we’ve made it more accessible. The QE team has developed and implemented pre-created stems, significantly lowering the entry barrier for the QA team. Our QA team members undergo a comprehensive training program to master the use of this framework. Remarkably, they are able to start writing automated tests for our front-end applications within just a couple of weeks.

However, their learning journey doesn’t end there. Given that all TV apps are unique, we’ve designed our framework to be flexible, incorporating the ability to add custom test steps written in TypeScript. As our QA professionals grow in their roles, they increasingly engage in more complex aspects of testing, always supported by the QE team.

This environment fosters innovation within the QA team. For instance, one of our QA members developed a test configuration tool using our framework. Another team member created a tool that generates the JSON files required by our framework for writing test cases. These examples illustrate how our approach not only cultivates technical skills but also encourages creative problem-solving and continuous professional growth.

Summary

By strategically differentiating the roles of QA and QE, FX Digital has achieved remarkable advancements in our operational efficiency. This clear delineation has not only substantially broadened the scope and application of test automation but has also elevated the overall quality of our services to new heights. Moreover, this separation has fostered an environment ripe for innovation, opening doors to a myriad of opportunities within our team.

For those steering the quality function in businesses with a focus on connected TV, we strongly recommend considering this structure. Adopting this approach could be a game-changer, offering a blend of enhanced quality control, innovative solutions, and streamlined processes, ultimately contributing to the overall success and competitiveness of your organisation in the dynamic connected TV landscape.

Connect with us today and let our experts guide you through automation challenges to a solution tailored to your needs.