Proficiency Testing

General Considerations

Frequency of Participation

Internal Administration and Operation of PT

General Considerations


Laboratories should participate in interlaboratory proficiency testing at a sufficient frequency to enable them to demonstrate confidence in their results. Although participation in proficiency testing is only one of a number of options in ISO 17025 clause 5.9, which deals with the actions laboratory’s need to take to ensure confidence in results, in practice accreditation bodies will regard it as a ‘compulsory option’. Indeed some accreditation bodies regard proficiency testing as vital and will refuse to accredit tests for which no proficiency testing is available. In any event an argument that proficiency testing is difficult to access or expensive will not be accepted by any accreditation body. Where schemes exist which are relevant the laboratory seeking accreditation will be required to participate. Where there is no organised proficiency scheme then some direct interlaboratory comparisons organised by the laboratory will be expected where at all possible.

 

The reason that accreditation bodies accord PT such preeminent importance is that it is the most searching test of a laboratory’s capability. It is as near as possible to a simulation of the real situation in which the laboratory normally functions.

In selecting a proficiency testing scheme the laboratory should take into account the following factors.

  • The scheme clearly needs to provide for as many of the tests carried out by the laboratory as possible and especially those which are included in the scope of any accreditation.

  • The sample types and range of measurement should be as close as possible to the laboratory’s normal area of activity. There is little relevance in calibrating over a special range simply to do the proficiency testing nor is proficiency testing on sample types outside the laboratory’s normal experience of particular relevance. The idea of proficiency testing is to challenge the laboratory’s normal sphere of activity. Some compromise may be necessary, especially in the type of samples being tested. In this case it might be argued that even though the PT uses samples somewhat removed from the laboratory’s normal types it is better to have this compromise rather than no PT at all.

  • Ideally the scheme should be accredited to ISO Guide 43/ISO 17043. Accreditation of PT schemes is a rapidly developing field and it is expected that, within the next five years, there will be adequate coverage for accreditation bodies to insist that only accredited schemes are used by laboratories. This is not the case at present as restriction to accredited schemes would make whole areas of PT unavailable to accredited laboratories. All things being equal, however, a laboratory should use an accredited scheme wherever possible.

  • Be careful to check the currency and frequency of the scheme. Some of the internet sources for PT schemes are unfiltered and include proficiency testing activity which is neither current nor regular. Schemes which have only operated once and well in the past may still be listed.

  • If the scheme is not based in your country check that the organisers are willing and able to ship samples to you. Most of the larger schemes have considerable experience of international shipping and dealing with the inevitable customs and other controls. Schemes which do not have this experience may encounter unanticipated difficulties in shipping samples


Back to top

Frequency of Participation

It is difficult to give definitive guidance on this topic but the following points need to be considered.

  • The minimum frequency for accredited laboratories to participate in PT is at least annually.

  • Bear in mind that should the PT show that you have a problem with a method it immediately calls into question any data which has been generated since the last successful PT. If that successful participation was a year in the past this may represent a great deal of data. Of course you will normally have other quality control data which supports the results, e.g. runs with reference materials and routine quality control samples, but questions will be asked and need to be answered.

  • The frequency of performance of the test should be considered. As a general rule tests which are performed on a reasonable regular daily basis should be subjected to PT at three monthly intervals.

  • The frequency of PT may not be in the laboratory’s control. If there is a limited choice of schemes then the organisers may well dictate the frequency. Typically commercial schemes operate on a three or six month cycle.


Back to top

Internal Administration and Operation of PT


Sample Handling and Administration


In the ideal world the laboratory should ensure that PT samples are treated in exactly the same way as client samples. They should, for example, be submitted blind to the laboratory staff by using a dummy customer. In reality few laboratories will do this especially if they are accredited. Any PT failure will be scrutinised by assessors and there is great temptation to give the samples special and careful treatment. Natural though this reaction is it does reduce the effectiveness of PT as a test of the laboratory’s capability and should be resisted.

 

If the nature and quality of sample allows it is an extremely valuable exercise to allow as many staff as possible independently to test the PT samples. This then makes the data useful as a demonstration of the ongoing competence of individual operators. The results can be incorporated in training records for example.

 

PT is not only a test of the technical competence of the laboratory but also of the overall sample handling and quality system. For example you will not be able to dismiss an error in reporting results or problems with sample identification as irrelevant. Just as a technical failure in PT will need to be dealt with as will a failure in other areas which would have resulted in misreporting to a real client.

 

Evaluation of PT Performance


The report from the proficiency scheme will basically provide the laboratory with a measure of its performance. Parameters of interest are the laboratory’s result, the assigned correct result, from the schemes’ point of view, and an estimate of the acceptable variation. This information is then used to generate a score, usually a z-score or similar. The laboratory should take the score provided by the scheme as an initial indication of performance but should also evaluate its performance in respect of its own internal criteria of quality.

 

In addition to evaluation of the individual round the laboratory should also examine any trends in the data from proficiency schemes to date.

 

  • It might be the case, for example, that the laboratory regularly has a z-score for a test in the acceptable range -2 to +2 but the score is always positive. If this pattern persists it would indicate a positive bias in the measurements. A system properly under control should show a random scatter of positive and negative z-scores.

  • Z-scores, whilst still being in the acceptable range, might develop a trend where the absolute value is decreasing or increasing from round to round. Eventually, if this trend continues, a failure will occur. The laboratory should respond and take preventive action to redeem the situation before the failure occurs.


There must be a documented procedure for evaluating and responding to PT results. The general approach should be as follows.

  • The key personnel should meet to consider the report form the PT scheme. This would normally include the laboratory manager and the quality manager plus any senior scientific staff relevant to the tests being evaluated.

  • A brief report should be prepared either noting that the results are satisfactory or identifying any failures or unsatisfactory trends.

  • Any failures should be treated as non-conforming work, investigated and corrective action planned and recorded.

  • The results of the investigation and the corrective action taken need to be recorded. There should also be evidence, in the form of satisfactory results from quality control checks, that the corrective action has been successful.


Accredited laboratories will have their PT results and reports examined by assessors at surveillance visits. What should be presented is the report form the PT scheme, details of the evaluation by the laboratory and reports on successful corrective actions. The accreditation body will not be concerned by the occasional problem with PT provided the laboratory is shown to be taking effective and prompt corrective action. Persistent problems with a particular test which are not successfully addressed will, however, result in eventual suspension of accreditation for that test.

 

The worst scenario is where a laboratory fails take seriously any problems revealed by PT. In this case accreditation will be immediately jeopardised.

 

Some Proficiency Testing Schemes in Textiles and Leather Testing


Scheme Title Summary of Tests Frequency Organisers Contacts Other Information
ASTM Yarn and Thread Performance Testing Twist, linear density, tensile strength and elongation. Twice per year ASTM www.astm.org/STATQA New in 2009
ASTM Textiles Air permeability, tearing strength, fabric count, mass per unit area, breaking and tearing strength, elongation, Twice per year ASTM www.astm.org/STATQA
TEPS (Textile Testing Proficiency Testing) FabricsChemical parameters, physical parameters, colour fastness, flammability, colour stability, construction.YarnPhysical parameters. 20 per year Bureau Veritas www.x-reference.co.uk
www.bureauveritas.co.uk
Very comprehensive scheme. Currently working towards ISO Guide 43 accreditation.Mandatory for participants in BV LACE accreditation.
Bremen Cotton Round Test Totally comprehensive set of tests on cotton covering physical and chemical tests. 4 times per year Faserinstitut Bremen e.V www.faserinstitut.de
Textile Proficiency Test Mass per unit area, tearing strength,
Martindale abrasion
and pilling,
colour fastness to
laundering,
perspiration, and rubbing.
Not available Danish Technology Institute henning.d.smidt
@teknologisk.dk
Not clear whether
routinely run but good coverage.
Azo Dyes in Leather and Fabrics Range of banned and controlled dyes. Once per year Institute of Interlaboratory Studies, Netherlands. www.iisnl.com
Textiles PTS Textiles, composition, colour fastness to dry cleaning, laundering, rubbing, water, sea water and perspiration. Once per year Laboratorio de Consumo de Galicia www.xunta.es/igc/
PEP CTCCalcado Leather and coated fabrics; ash content, volatile matter, pH, chromium, soluble matter, tensile strength, tear strength, thickness, adhesion to fabrics, abrasion resistance. Once per year if demand SENAI, Brazil www.senairs.org.br
Textiles PT Extension, breaking load, composition (qualitative), mass per unit area, threads per unit length. Once every two years. Proficiency testing Australia www.pta.asn.au
Textiles PT TextilesFriction,
tensile strength,
ripping, water
robustness.
GarmentsDimensional
stability, abrasion
resistance, washing stability, fastness to artificial light.
Annually Portuguese Accredited Laboratories Association. www.relacre.pt

Back to top

Shop Software

Shop Symantec shop

Borland Software shop http://www.prosoftwarestore.com/

Shop Microsoft Software

Adobe Software Software Store Windows Software

Shop Autodesk Software

VMware Software MAC Software