Quality Assurance

Quality assurance is one of the key ingredients of creating good software. While our full QA process, which is described below, is used when we develop high integrity software for the medical industry, we use a reasonable subset for all our non medical projects.

Our full QA process conforms to FDA guideline 21 CFR 820 – Quality System Regulations which addresses how to develop and validate software for FDA-regulated environments like medical devices, clinical trials and software governed by 21 CFR Part 11 for electronic signatures. HIPAA has also adopted Part 820 as its quality standard for software that contains patient data. Part 820 requires that a disciplined, controlled and fully documented methodology be used to develop and validate software.

While a software vendor may have an excellent piece of software, for a FDA-regulated environment, an assumption is made that if a particular aspect of the development process has not been documented it did not happen and the software’s integrity cannot be proven. The FDA does not accept that observing the software’s error free behavior in the past is proof that the software will behave in an error free manner in the future. The FDA will only accept a software development methodology that clearly manages and documents the quality of the entire development process as proof that the software is error free.

SageKey uses a disciplined, controlled and fully documented methodology to design, build and test regulated software. Our quality assurance methodology uses a nine-step process:

Product Requirements

The Product Requirements document defines the project. It includes the list of requirements and information about the environment in which the application will be run.

Software Development Project Plan

This document lists the project’s resources and deliverables, defines the schedule of tasks to be completed and identifies the source of project funding.

Design Specifications

The Design Specifications document contains detailed information about the specific functionality of the software. Each feature or function is given an identifier that is used to trace between the specifications and their test cases.

Technical Specifications

This document describes the project’s system architecture and development tools. It outlines how the Design Specifications will be developed into software and includes a design risk assessment and a developer testing plan.

Unit Testing & Code Review

Unit testing is conducted on each functional element of the application by the developer and the results documented. Code reviews are performed as a means of improving code maintainability by ensuring adherence to coding standards. Results of the reviews are included in the Code Review Report.

Build Notes

The Build Notes document describes the software build environment and lists any specific settings or configurations that must be made to create a build of the software.

Software Quality Assurance Testing Protocol

This document identifies the testing environment and includes a description of the testers and their approach for testing each component of the software. The document describes each test case and assigns it an identifier that traces it to a design specification.

Software Quality Assurance Testing Report

This document describes the results of the execution of the test cases. It includes a description of the software configuration tested and the results of each test case execution. The results of failed tests are entered into a Validation Error Reporting log in preparation for re-testing.

Release Notes

The Release Notes document includes a list of all files that will be deployed with the application and lists any outstanding issues, workarounds or helpful notes that will assist in the deployment, installation and use of the application.

Company’s Supporting Infrastructure

In addition to the above, companies that build high integrity software are required to have a set of written, approved and enacted policies called Standard Operating Procedures (SOPs) for all the core business activities that affect the software development process. These SOPs act as the foundation of the software development activity and ensure that this activity is not compromised. SageKey maintains the following SOPs to run its core business activities:

SOP and Document Management

Describes how the company manages its standard operating procedures and related documents

Staff Training

Contains records that show that the staff are qualified to do the work

Building Security

Defines how the physical security of the organization is protected and managed

Computer and Network Security

Defines how the electronic security of the organization is protected and managed

Electronic Data Backup and Recovery

Defines how the electronic data of the organization is backed up and protected.

Disaster Recovery

Describes the company’s disaster recovery process.

Coding Standards

Describes the coding standards adhered to by the organization and how code reviews are conducted.

Source Code Control

Describes how source code versions are managed

Issue Tracking

The organization’s policies for tracking software issues from their discovery through to their resolution and testing.

Software Development and Validation

A detailed description of the nine-document software development process adhered to by the organization (as described in the section above)

Software Change Control

Defines how changes are introduced into released software that maintains the integrity of the software.

Evaluation Results from Computer System Validation

SageKey Software was recently evaluated by David Nettleton, founder of Computer System Validation. David is an FDA and HIPAA computer system validation specialist who is considered to be one of the nation’s foremost experts in the field. He is the author of three books on the subject and was on the team that developed the 21 CFR Part 11 regulations.

During the past two weeks I evaluated SageKey Software, Inc. for compliance with 21 CFR Part 11, the FDA’s Electronic Records and Signature regulation that affects all GxP data (laboratory, clinical, manufacturing). Part 11 has three primary areas for compliance; Standard Operating Procedures (SOPs), product features, and validation documentation.

SOPs: I reviewed infrastructure SOPs related to document management, training, facility security, computer and network security, data backup, and disaster recovery. All SOPs show mature processes and commitment to quality standards.

I reviewed software development and validation SOPs related to coding standards, source code control, issue tracking, software development and validation, and software change control. All SOPs show a comprehensive and mature process for developing state of the art software applications that meet industry standards for FDA compliance.

I reviewed the training records of two members chosen at random, a senior software developer and a system administrator. Both sets of records show appropriate training of 21 CFR Part 11 and applicable SOPs.

Product Features: SageKey is a contract software vendor and as such does not market software applications themselves. Therefore no specific product was included in this evaluation. However, I was presented with a demonstration of a medical records application, an EMR for the dialysis industry, that demonstrated compliance with the current industry standard feature set for security, data transfer, audit trails, and electronic signatures related to 21 CFR Part 11, and 45 CFR Part 164, the HIPAA electronic records security standards rule.

Validation Documentation: SageKey has a comprehensive software development and system validation lifecycle with detailed validation documentation. I reviewed all of the validation documents for one project that included: Product Requirements, Software Development and Validation Project Plan, Design Specifications, Technical Specifications, Code Review Report, Build Notes, Software Quality Assurance (SQA) Testing Protocol, SQA Testing Report, and Release Notes. All of these documents follow SageKey SOPs, meet industry standards, and clearly show a commitment to quality and regulatory compliance.

In summary, SageKey shows an excellent level of compliance related to FDA and HIPAA regulations and is a mature contract software development vendor.

We invite you to visit us and audit our example projects, processes and SOPs. SageKey is located in a beautiful part of Western Canada, well known for its wine, vacation spots and low impact industries.