What is Conformance Testing (Compliance Testing)

Conformance Testing

Conformance testing is a software testing approach being used to ensure that a software system meets the guidelines and requirements set by IEEE, W3C, or ETSI. Conformance testing determines how well a system undergoing assessment verifies to fulfill the specific needs of a certain regulation.Compliance testing is another name for conformance testing.

It may deal with certain technical aspects, but it incorporates the following on purpose −

• Performance

• Functions

• Robustness

• Interoperability

• Behavior of system

You will learn the following in this tutorial −

• What is Conformance Testing?

• Types of Conformance Testing

• Why do we need Conformance Testing?

• What do we need to test?

• When and how to perform Conformance Testing?

• Conformance Testing Process/Program

• Advantages of Conformance Testing

• Disadvantages of Conformance Testing

• Conformance Testing for Mobile System

Types of Conformance Testing

Conformity Testing can be either logical or practical, and it includes the following sorts of testing −

• Compliance Testing

• Load Testing

• Stress Testing

• Volume Testing

Why do we need Conformance Testing?

• To ensure that the system's criteria are met.

• To determine if the system records are complete and contain all necessary information.

• To ensure that the development, design, and assessment are in accordance with the requirements.

What do we need to test?

• The principles by which the execution is carried out

• The name of the system that will be created

• Specification scope

• Specification Goals

Management initiates conformance testing with complete confidence in the company and its mastery of guidelines, requirements, and processes.

To minimize ambiguity, standards and requirements must be explicitly stated while developing an application. If that's not the case, then conformance testing may be used to take the required measures to ensure it’s useful and dependable.

When and how to perform Conformance Testing?

• Conformance testing is conducted whenever we need to examine the system's overall uniformity, completeness, and accuracy with regard to user requirements.

• There are numerous approaches for accomplishing it that are similar to our Development Lifecycle Phases, such as;

  • Evaluating specs for demands

  • Making a test plan

  • The objective of creating test scenarios

  • Make documentation for completed test designs.

• We must concentrate on certain extra characteristics of specifications, such as subsets, which are classified into three types: 'Profile,' 'Level,' and 'Modules'.

  • The profile is a collection of specifications that comprises system functionality to meet the requirements and is tailored to a select group of people.

  • Levels are layered subsets of specifications, where Level1 represents fundamental requirements and Level2 represents Level1 with additional/new features.

  • Modules are groups of requirements and guidelines that are highly connected.

Conformance Testing Process

A conformance testing process, also known as a compliance testing process, is required for a software program to assure effectiveness, functionality, and to minimize future dangers. An efficient conformance testing procedure comprises the following steps −

• Standard and Specification Analysis

• Choosing Test Tools and a Test Suite

• Creating Testing Procedures

• Validations are being checked.

• Changing applicable testing policies and certifications

Conformance Testing is sometimes referred to as Compliance Testing, although there are certain fundamental differences that distinguish Conformance Testing from Compliance Testing.

We'll look at how they relate and differ.

Advantages of Conformance Testing

• Ensures that requirements are followed correctly.

• Guarantees mobility and compatibility

• Ensures that standards are used appropriately.

• Allows you to ensure that all interfaces and functionalities are functioning properly.

• Helps to distinguish between regions that must be conformed and those that must not be conformed, such as syntax and semantics.

Disadvantages of Conformance Testing

Conformance Testing, like all other forms of testing, includes some activities that are tough to complete and may pose a barrier. Some of them are as follows −

• To properly do conformance testing, it is necessary to establish the type of system that must be tested, as well as the appropriate technique.

• Specifications are classified into Profiles, Levels, and Modules.

• Values are predefined.

• Creating extensions, choices, and ways to ensure the testing process runs well.

Conformance Testing - Critical Views

Some aspects of conformance testing require special participation and involvement for successful execution.

• Methods of testing that are most appropriate

• Choosing a test tool to streamline the testing process

• A thorough comprehension of conformance Testing that reveals just nonconformance rather than compliance

• Creating and Implementing a Program for Conformance Testing

• Specifying the formality with which it should be carried out

• Regulation and policies

Conformance Testing for Mobile System

Conformance testing, like all other forms of software testing, may be performed on mobile systems. After the system has been constructed, it is conformance tested before delivery to ensure that it is fit for its purpose.

The tests are carried out as per kind of networks, such as GSM or CDMA, in order to ensure conformity and compatibility.

These tests may include −

• Protocol Testing

• Safety/Security Testing

• SIM card Testing

• Radio Frequency(RF) Testing

• Audio Tests

• Specific Absorption Tests

Example Use Case Diagram

The Use Case Diagram below depicts how conformance testing for operational mobile systems is carried out −

Furthermore, for SIM Card Testing in two phases, this may be developed as follows &minbus;

• Password Validation

• Making Call

There can be two cases for a system such as −

• Call Succeed

• Call Failed

Consider the following Use Case for Protocol Testing −

The Test Case Template below will assist you in understanding how we may construct test cases for Protocol Testing.

These words demonstrate that Conformance Testing may also be used to evaluate the application of technical standards.

The test cases are being established to offer standardization to the testing process. Hundreds of test cases may be written and conducted based on the kind of network to validate that the mobile system operates as specified.

Summary

• Conformance Testing, often known as Type Testing, is a systematic method of testing.

• It's being used to evaluate if the system adheres to the required specifications.

• Dress testing, load testing, volume testing, and compliance testing are all part of it.

• It is sometimes known as Compliance Testing, however, there are significant variations between the two.

• Some of the most significant elements of Conformance Testing include the Conformance Testing Program, Testing Methodologies, and Test Tools.

• Conformance Testing in Software Engineering helps ensure standard use and compatibility.

• Mobile Systems are also subjected to conformance testing.

Vineet Nanda

Updated on: 09-Jun-2021

771 Views

Kickstart Your Career

Get certified by completing the course

Get Started