The work was done through a direct engagement with the medical imaging division of the client’s healthcare subsidiary.
The client has several R&D centers each focusing on a different set of products. Prior to working with QualiTest, the client’s testing was performed in-house with some of the work performed onsite and the rest being done off-shore at testing centers in India.
Business Needs and Objectives
The client was concerned with rising QA and testing costs combined with a growing lack of overall control over the QA and testing process. The customer indicated that a lack of quality and process metrics (in a highly regulated industry) meant that the overall amount of work was growing but quality was not improving.
The client felt that some QA and testing areas were lacking but was not sure where change was needed and what to change in order to get the best quality improvement and the highest value.
After evaluating a number of alternatives, the client selected QualiTest to perform an assessment according to Test Process Improvement (TPI) model. The main criteria which the client indicated ultimately led to selecting a TPI approach were simplicity, difficulty of implementation, flexibility and focus on the testing processes.
The following is a partial list of the challenges which were quickly identified as part of the initial TPI assessment:
- The client was investing more and more in documentation and test planning but was still not getting an overall control over the process effectiveness or a sense of the upcoming releases maturity.
- QA and testing activities were performed on multiple locations which made it more difficult for the teams to communicate effectively and made the evaluation more challenging as well.
- The testing teams moment of involvement left little time for test execution and usually led to delays and the testing process staying in the projects critical path for too long.
- A significant investment in automation with problems in both questionable ROI as well as tests not focused on the real critical issues which had to be tested. The automation team was very strong technically but was lacking business knowledge in how and what should really be tested.
- Lack of compatibility to standard testing automation tools due to unique platforms, limited GUI interface and rapid development processes.
Overall, the challenge was a growing QA and testing budget with no tangible increase in defect detection or higher assurance of quality.
The QualiTest Solution
QualiTest conducted an assessment of the existing QA and testing processes in order to establish a base line which describes the current situation under the 20 known key areas in TPI. The evaluation was conducted by a senior test specialist and supervised by the QualiTest Professional Services team. The evaluation performed by QualiTest included interviewing key client employees in the areas of QA, Testing and IT followed by analysis and presentation to the client. The final assessment report included both short and long term recommendations milestones.
Following the Assessment, a steering committee was established consisting of members of the client’s QA team, development team and QualiTest Sr. Test Specialist. Five months after the TPI Assessment completion, the following achievements have been widely recognized:
- Test Strategy: a motivated consideration of the product risks took place, for which knowledge of the system, its use and its operational management is required. A risk-based approach was implemented. Each high-level test determined its own test strategy. Exploratory Test Techniques were implemented.
- Metrics: metrics were defined and implemented. A real-time dashboard was created collecting data from various systems allowing the QA team to base its decisions on a valid state while providing management and stakeholders with full visibility to the activities performed by the QA team.
- Moment of involvement: Testing was started in parallel to requirement definition. Allocating the defects early in the development stages allowed the QA team to focus on deep testing during the late stages of development
- Test Automation: Keyword Driven Approach (KDT) was implemented allowing various members of the team to participate in the Test Automation effort. Test Automation was integrated as part of the daily build allowing the development to benefit from Test Automation and to locate defects early in the process, even before test execution started.
* TPI™ is a registered trademark of Sogeti
Project Business Card
Solution: Test Process Improvement
Location: On-shore, Off-site
Project Size: 4 QualiTest employeess
Client size: Fortune500
About QualiTest Group
QualiTest Group is a leading global provider of Quality Assurance and Software Testing Services. With over 1000 Software Testing professionals, 10 branches, and a strong presence in the USA, Europe, Israel, and Asia, QualiTest provides services to global Fortune 500 companies and large and small organizations. The company is committed to improving quality by providing superior solutions to clients and partners worldwide as well as advancing QA and testing methodologies. QualiTest offers a wide variety of QA and testing services such as: On-shore testing, QA and testing outsourcing, and flexible testing consulting and staffing. QualiTest expert services promote global practices such as: Test Process Improvement (TPI), KDT Test Automation, Load and Performance Testing, Website and Mobile Device Testing, Scrum Testing, Exploratory Testing, and Virtuology.