Client Overview

Our Client provides services in the regulatory compliance and financial crime area for leading banks and financial institutions. It collaborates with prominent financial institutions and reliable industry allies to provide a highly effective and streamlined next-gen platform solution for unifying compliance standards.

Testing bottlenecks were hampering agility

The Client needed faster deployments and shorter development times and so automation was required to accelerate sluggish manual testing processes. The Client also wanted to improve the quality of its overall solution, and to detect defects earlier in the development lifecycle.

The Client’s objectives also included the extension of test coverage to the integration of two third-party entities, to ensure comprehensive regression testing for all release updates and hot fixes. Additionally, the Client needed to scale across multiple environments.

The Client needed to improve the performance efficiency for current peak load and scalability for future platform growth. To achieve this, they required a robust performance test framework to support and test at each release level. The Client also needed to enhance its enterprise data management for:

  • Compliance Assurance – Ensure adherence to stringent regulatory standards, safeguarding data integrity, and mitigating legal risks.
  • Operational Optimization – Enable efficiency improvements across the organization.

A triple-pronged approach to driving quality

With testing bottlenecks hampering agility, Qualitest’s expertise was sought in three key areas: automation, enterprise data management and performance testing.

End to end test automation

Qualitest engineers integrated into the Client’s scaled agile scrum teams helping to drive planning, acceptance, smoke, and regression tests. Automation testing saved time on list alterations and complex scenarios, while speeding up message review and log analysis through AWS CloudWatch integration. Qualitest experts crafted standardized test packages for capability regression and end-to-end testing, addressing critical scenarios.

The automation pack handled third-party integration scenarios with different inputs. Additionally, automated testing covered every solution component, emphasizing end-to-end test automation. Test sets were tailored for each capability. Automated integration tests were executed, enabling successful end-to-end testing — a milestone achieved in the first half of 2023. The automation framework ensured quality and reliability, utilizing Cucumber for behavior-driven testing, Rest Assured for API testing, Swift Messages testing, and Kafka Topic Consumer design pattern for event-driven systems. It adeptly manages test data, provides robust reporting, supports multiple environments and allows extensibility.

Enterprise Data Management

The Enterprise Data Management (EDM) workstream involved developing two Minimum Viable Products (MVPs). One MVP utilized Snowflake, and the other leveraged Iceberg tables, both within the AWS ecosystem, utilizing Parquet files stored in Amazon S3.

EDM capabilities were enhanced by incorporating robust reporting functionalities. Apache Superset was selected as the Client’s Business Intelligence tool, enabling customized reporting based on the rich data within their data lakes.

Automation of EDM played a crucial role in expediting manual data testing tasks, particularly in scenarios requiring frequent updates. This streamlined daily processes and enabled quick review of messages and log analysis, facilitated by integration with AWS CloudWatch through automation frameworks.

End to end performance testing

Shift Left early testing was implemented in the lower environment to identify possible performance bottlenecks, and recommendations were provided to improve system performance.

On the tooling side, we used a proof of concept to recommend appropriate frameworks and methods for testing the critical system. This gave the Client a clear understanding of how to specify performance requirements, and it created a standard for upcoming versions.

Reusable script harnesses were made available by Qualitest for verifying AWS SQS system, and these will be helpful in the event of a regression pack release in the future. We created several automation frameworks for data set-up and output generation, which significantly reduced the execution time.

By setting different types of dashboards on the AWS cloud system, engineering-level analysis was performed to detect potential performance bottlenecks.

Key benefits

Immediate impact in a complex environment

  • Reduced a week’s manual test effort to just an hour.
  • Achieved a 50% reduction in setup time.
  • Proactively identified issues early through a shift-left approach, minimizing bugs in later stages.

Enhanced testing efficiency

  • Automated tests developed for capability testing utilized for regression testing, smoke tests, and development pipelines.
  • Reduced test data setup efforts by 50%, addressing performance concerns early.

Streamlined processes and improved feedback

  • Enabled faster feedback for every deployment and critical change during UAT phase using automation.
  • Uplifted hardware capacity by 10% based on deep dive analysis with cloud-level performance metrics.

Strategic problem solving

  • Identified and prevented three+ potential bottlenecks (P1 Defects) with custom cloud dashboard setups.
  • Created 10+ reusable assets for upcoming releases across various environments.

quality engineering free assessment Download the PDF