External quality assessment

Last updated

External quality assessment ('EQA), or external quality assessment schemes(EQAS) is a challenge of the effectiveness of a laboratory's quality management system, typically referring specifically to medical laboratories. The term external refers to the fact that the laboratory's results are assessed by a third party. The most common EQA process is proficiency testing, in which an organization sends samples to a group of different laboratories and results are compared among the group. Retesting of the same sample by different laboratories and on-site visits to evaluate laboratory processes may also be part of an EQA scheme. [1]

Contents

Organization

Typically, an EQA scheme consists of several rounds per year. In each round participants receive test items, which are also called samples. The EQA organizer is also called the provider. The organizer ensures that the test items are sufficiently similar and homogeneous. The test items' properties and analyte concentrations are not disclosed to participants before the final report. The participants' results are then compared to check if any participant had a bias towards e.g. higher values, or an unexpected imprecision. At the end of each round, the EQA organizer sends out reports and/or certificates to the participating laboratories. [2]

Accreditation

Laboratories are often accredited for ISO 17025 and ISO 15189 compliance. Internationally, the International Laboratory Accreditation Cooperation establishes global recognition of these standards. Locally, conformance with ISO standards is checked by accreditation bodies. These often mandate, but always encourage laboratories to participate in EQA schemes.

Typically, EQA scheme organizers are accredited according to the ISO 17043 standard.

Motivation

EQA or proficiency testing is different from quality assurance which, in a laboratory setting, is the total process whereby the quality of laboratory results can be guaranteed. This is because relying solely on the lab-internal quality management can create a false sense of safety.

Laboratories are instructed to treat proficiency testing samples in the same way as normal patient samples. [1] For a laboratory, gaining and keeping the ISO 17025 accreditation status is of high commercial importance. For this reason, laboratory employees might treat EQA test items differently. [3]

There are several ways in which PT samples may be given ‘special’ treatment. They may be handled by more experienced staff than those who examine typical routine samples, subjected to more rigorous checking procedures than normal, or results and information from other participants (collusion) may be sought before reporting. These practices must be discouraged by laboratory management. If the scheme organizers suspect collusion then the laboratories concerned will be contacted.

Statistics & scoring

In most EQA schemes, laboratories receive scores for their results. The most popular score is the Z-score, also called standard deviation index (SDI). The score is given per analyte and per test item. [4]

Available schemes

PT/EQA is of paramount importance in food, water and medical testing where the impact of incorrect results can impact on people's health. Many countries have organisations with a government remit to protect people's health such as the Health Protection Agency in the United Kingdom.

Other very important sectors are mining: Ore value estimation is very important commercially, therefore its reliance is usually proven by laboratories with their participation in EQA schemes.

A wide range of global EQA schemes or proficiency testing schemes for laboratories are listed in the online database EPTIS, which is operated by the German Federal Institute for Materials Research.

Further reading

Related Research Articles

Accreditation is the independent, third-party evaluation of a conformity assessment body against recognised standards, conveying formal demonstration of its impartiality and competence to carry out specific conformity assessment tasks.

<span class="mw-page-title-main">Product certification</span> Performance and quality assurance

Product certification or product qualification is the process of certifying that a certain product has passed performance tests and quality assurance tests, and meets qualification criteria stipulated in contracts, regulations, or specifications.

A ringtest for quality management is part of an external quality assurance programme for a measuring method. Ringtest is also called proficiency test or interlaboratory test. Usually a reference institute sends identical samples which have to be analyzed for special parameters to different laboratories. The industrial, medical or research laboratory gets a limited time with a deadline to send in the analysis results. The statistical evaluation and interpretation of the laboratories’ results is a great help for all participating labs as it opens the possibility to assess the quality of their analysis compared to other laboratories. Participation in ringtests is obligatory for accredited laboratories. Nevertheless, non-accredited laboratories can also take part in ringtests.

ISO/IEC 17025General requirements for the competence of testing and calibration laboratories is the main standard used by testing and calibration laboratories. In most countries, ISO/IEC 17025 is the standard for which most labs must hold accreditation in order to be deemed technically competent. In many cases, suppliers and regulatory authorities will not accept test or calibration results from a lab that is not accredited. Originally known as ISO/IEC Guide 25, ISO/IEC 17025 was initially issued by ISO/IEC in 1999. There are many commonalities with the ISO 9000 standard, but ISO/IEC 17025 is more specific in requirements for competence and applies directly to those organizations that produce testing and calibration results and is based on more technical principles. Laboratories use ISO/IEC 17025 to implement a quality system aimed at improving their ability to consistently produce valid results. Material in the standard also forms the basis for accreditation from an accreditation body.

ISO 15189 Medical laboratories — Requirements for quality and competence is an international standard that specifies the quality management system requirements particular to medical laboratories. The standard was developed by the International Organisation for Standardization's Technical Committee 212. ISO/TC 212 assigned ISO 15189 to a working group to prepare the standard based on the details of ISO/IEC 17025:1999 General requirements for the competence of testing and calibration laboratories. This working group included provision of advice to medical laboratory users, including specifics on the collection of patient samples, the interpretation of test results, acceptable turnaround times, how testing is to be provided in a medical emergency, and the lab's role in the education and training of health care staff. While the standard is based on ISO/IEC 17025 and ISO 9001, it is a unique document that takes into consideration the specific requirements of the medical environment and the importance of the medical laboratory to patient care.

The National Voluntary Laboratory Accreditation Program (NVLAP), administered by the National Institute of Standards and Technology (NIST) in USA, offers accreditation for testing and calibration laboratories across various fields. NVLAP evaluates laboratories' technical qualifications and compliance with standards like ISO/IEC 17025. The accreditation process includes application submission, an on-site assessment, proficiency testing, and addressing any identified nonconformities. NVLAP’s accreditation is recognized internationally, indicating a laboratory’s competence but not certifying its performance. NVLAP’s mission is to deliver high-quality accreditation services and promote global acceptance of accredited results.

Public health laboratories (PHLs) or National Public Health Laboratories (NPHL) are governmental reference laboratories that protect the public against diseases and other health hazards. The 2005 International Health Regulations came into force in June 2007, with 196 binding countries that recognised that certain public health incidents, extending beyond disease, ought to be designated as a Public Health Emergency of International Concern (PHEIC), as they pose a significant global threat. The PHLs serve as national hazard detection centres, and forward these concerns to the World Health Organization.

<span class="mw-page-title-main">Certified reference materials</span> Material traceability inspection

Certified reference materials (CRMs) are 'controls' or standards used to check the quality and metrological traceability of products, to validate analytical measurement methods, or for the calibration of instruments. A certified reference material is a particular form of measurement standard.

In experimental methodology, a round-robin test is an interlaboratory test performed independently several times. This can involve multiple independent scientists performing the test with the use of the same method in different equipment, or a variety of methods and equipment. In reality it is often a combination of the two, for example if a sample is analysed, or one of its properties is measured by different laboratories using different methods, or even just by different units of equipment of identical construction.

An independent test organization is an organization, person, or company that tests products, materials, software, etc. according to agreed requirements. The test organization can be affiliated with the government or universities or can be an independent testing laboratory. They are independent because they are not affiliated with the producer nor the user of the item being tested: no commercial bias is present. These "contract testing" facilities are sometimes called "third party" testing or evaluation facilities.

The South African National Accreditation System (SANAS) is the official laboratory accreditation body for South Africa. Founded in 1996, SANAS is headquartered in Pretoria, South Africa. SANAS accreditation certificates are a formal recognition by the Government of South Africa that an organisation is competent to perform specific tasks.

Titled as Agricultural food products—Layout for a standard method of sampling from a lot, the document provides a rule-based guidance on drafting a sampling method of agricultural food products for intended users. Except for milk products which ISO 707:1997 covers, the typical examples of the standards regulated by this document are

<span class="mw-page-title-main">British Approvals Service for Cables</span>

British Approvals Service for Cables is an independent accredited certification body headquartered in Milton Keynes, United Kingdom. Here, the organization's dedicated testing laboratory also operates which is believed to be the largest of its type in Europe. BASEC was established in 1971 and principally provides product certification services for all types of cable and wire, ancillary products and management systems within the cable industry. The organization maintains operations throughout the world including Africa, Middle East, America, Asia and Europe.

The United Kingdom Accreditation Service (UKAS) is the sole national accreditation body recognised by the British government to assess the competence of organisations that provide certification, testing, inspection and calibration services. It evaluates these conformity assessment bodies and then accredits them where they are found to meet relevant internationally specified standards.

Forensic metrology is a branch of metrology applied to forensic sciences. Metrology has evolved various techniques for assessing the margin of error or uncertainty associated with measurements. Forensic laboratories and criminalistic laboratories perform numerous measurements and tests to support criminal prosecution and civil legal actions. Examples of forensic metrology include the measurement of alcohol content in blood using breathalyzers, quantification of controlled substances, and length measurements of firearm barrels. The results of forensic measurements are used to determine if a person is charged with a crime or may be used to determine a statutory sentencing enhancement. Other examples of forensic metrology includes tests that measure if there is a presence of a substance, latent print examination, questioned documents examination, and DNA analysis.

<span class="mw-page-title-main">National Accreditation Board for Testing and Calibration Laboratories</span> Indian accreditation organisation

National Accreditation Board for Testing and Calibration Laboratories (NABL) provides accreditation to Conformity Assessment Bodies (Laboratories) in India. NABL Schemes include Accreditation (Recognition) of Technical competence of testing, calibration, medical testing laboratories, Proficiency testing providers (PTP) & Reference Material Producers (RMP) for a specific scope following ISO/IEC 17025, ISO 15189, ISO/IEC 17043 & ISO 17034:2016 Standards. It has Mutual Recognition Arrangement (MRA) with Asia Pacific Accreditation Cooperation (APAC), International Laboratory Accreditation Cooperation (ILAC).

The International Society for Biological and Environmental Repositories (ISBER) is a professional society of individuals and organizations involved in biospecimen banking. Its main activities include creating educational and training opportunities, providing an online forum service, showcasing related products and services, and creating opportunities for networking. It also has published works.

Molecular/Genomic reference standards are a class of ‘controls’ or standards used to check the performance of molecular diagnostic assays. Molecular/Genomic Reference Materials (RMs) are selected or engineered to model a specific genetic biomarker as it occurs in a patient biopsy. Reference materials (RM) are used for a calibration of the measuring system, for assessment of a measurement procedure, for assigning values to materials, or for quality control.

<span class="mw-page-title-main">International Seed Testing Association</span> International non-profit organization

The International Seed Testing Association (ISTA) is an independent, non-profit organization founded during the 4th International Seed Testing Congress in 1924. Its members work to promote uniform methods of evaluating seeds being sold internationally to facilitate the international trading of seeds and to contribute to global food security. ISTA is involved in the development of internationally approved ISTA Rules for sampling and testing seed quality, laboratory accreditation and the promotion of seed science research and test development.

The National Association of Testing Authorities (NATA) is the recognised national accreditation authority for analytical laboratories and testing service providers in Australia. It is an independent, not-for-profit organisation, governed by a board of directors that has representation from NATA members, industry, government and professional bodies.

References

  1. 1 2 World Health Organization (2 November 2009). "Overview of External Quality Assessment (EQA)" (PDF).
  2. ↑ Miller, W Greg; Jones, Graham RD; Horowitz, Gary L; Weykamp, Cas (1 December 2011). "Proficiency Testing/External Quality Assessment: Current Challenges and Future Directions". Clinical Chemistry. 57 (12): 1670–1680. doi: 10.1373/clinchem.2011.168641 .
  3. ↑ "Assessments and External Quality Assurance" (PDF). National Health Laboratory Service (South Africa). Archived from the original (PDF) on 5 March 2016. Retrieved 29 August 2015.
  4. ↑ Kottke-Marchant, K; Davis, B (2012). Laboratory Hematology Practice (1 ed.). John Wiley & Sons. p. 701. ISBN   978-1-4443-9857-1.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.