Home > PJ (current issue) > News Feature | Search

PJ Online homeThe Pharmaceutical Journal
Vol 275 No 7356 p12
2 July 2005

This article
Reprint   Photocopy

PDF 68K, Acrobat Reader

News feature

User testing of PILs now mandatory

Legislation implemented this week makes user testing of patient information leaflets mandatory. Dawn Connelly finds out what this involves



Making medicines information easier for patients to understand took a leap forward this week when user testing of patient information leaflets became compulsory in the UK.

What is user testing?

The method of user testing illustrated in the Medicines and Healthcare products Regulatory Agency guidance specifies that leaflets are tested on 20 participants in a target group. Participants do not have to suffer from the condition to which the leaflet relates, but should be able to imagine that they may suffer from the disease to be treated in the future. It might be difficult for people to imagine they suffer from a rare disease and hence leaflets for these medicines should be tested on people who have the disease. The target group should not include people who have previously taken or are currently taking the medicine in question.
Participants can be recruited from, for example, self-help groups, patient support groups, community centres or parent and toddler groups, but the guidance specifies that they must not be paid consumers who have become experts.
The test takes the form of a 45- minute interview which consists of a series of 12 to 15 questions designed to determine whether participants are able to locate and understand specific information. The information reflects key safety and compliance issues related to the drug under scrutiny. To test participants’ understanding they are asked to explain the requested information in their own words.
The leaflet passes the test if 90 per cent of literate subjects are able to locate the information, and 90 per cent of these are able to explain it. If the leaflet fails the test, it can be modified and re-tested on a different group of participants until the 90 per cent pass mark is attained.
Marketing authorisation holders can either carry out in-house testing using standard operating procedures or use a suitably qualified agency to carry out the tests. Copies of the SOP, questions,answers and interviewers’ observations, along with the all versions of the leaflets tested, are required to be submitted to the MHRA.

A review of European Medicines legislation in 2001 led to the requirement that user testing of all PILs would be mandatory in EU member states from 1 October 2005. The UK chose to introduce the legislation three months early, on 1 July, in order to coincide with the UK assuming the EU presidency.

The concept of user testing was first mooted in Australia in the early 1990s and it has now been mandatory there for over five years. The EU adopted the term “user testing” in its “Guideline on the readability of the label and package leaflet of medicinal products for human use” in 1999 and until now it has been voluntary in EU member states.

This week, the Medicines and Healthcare products Regulatory Agency issued guidance to marketing authorisation holders to help them decide how and when to apply a user test to PILs. The guidance describes user testing as “a performance based, flexible development tool which identifies barriers to people’s ability to understand and use the information presented, and indicates problem areas which should be rectified”. It provides an illustration of one method of user testing (see Panel) but says that other performance-based methods are equally valid and will be judged on a case by case basis.

Initially, pharmaceutical companies will be required to submit the results of user testing of PILs to the MHRA with all marketing authorisation applications for new drugs. However, by 2008 the MHRA will expect all PILs to have been tested, unless the marketing authorisation holder can provide justification for exemption. This will apply to PILs for branded products, generic products, parallel imports and herbal products.

User testing does not only apply to PILs: packaging and promotional material is expected to be tested. Although the legislation only specifies PILs, the MHRA guidance makes it clear that packs that do not contain PILs should be tested on potential users.

Theo Raynor, professor of pharmacy practice and director of research at the University of Leeds and a member of the Committee on Safety of Medicines patient information working group, says that the benefits of user testing are clear. “Patients will have the opportunity to test the leaflets themselves, and that can only mean that the leaflets will meet their needs better,” he explains. He adds that during his research over the past few years he has noticed a consistent message: patients believe the information they get about their medicines is focused on what the manufacturer or health professional thinks they need rather than what they actually need. User testing should resolve this.

The Association of the British Pharmaceutical Industry welcomes the new legislation. A spokesman for the ABPI told The Journal: “We have certainly been working on [improving patient information leaflets] for some time. . . it will help patients understand what the medicine is about and how to take it. That it is an area that we have been getting better at but this will push us into doing even better.”

Cost to the industry

However, the spokesman voiced concerns about the possible costs of user testing to the pharmaceutical industry. “We estimate the average cost to be somewhere in the region of £12,000 to £15,000 per leaflet. If you multiply that by the 20,000 products that are on the market then you are talking in terms of £250m — that is a substantial sum of money.”

Professor Raynor, whose university spin-off company is providing user testing services to the pharmaceutical industry (PJ, 11 June, p702), believes that testing of PILs is relatively cheap compared with testing of the drugs themselves. He says: “The user testing that the MHRA and the rest of the EU is suggesting is an extremely cost-effective method. It involves a minimum of 20 participants . . . and it has been shown to be, even with small numbers of participants, very effective in identifying problems with leaflets and how they might be rectified.”

The MHRA guidance states that, as knowledge and experience grows, it is likely that not all PILs will need to be user tested. Products may be exempt if the PIL for a similar product has already been successfully tested. However, in certain circumstances evidence of successful user testing will always be required. These are product switches, new chemical entities, medicines with a novel presentation or formulation and medicines with particularly critical safety issues.

Professor Raynor explains that the guidance does not say explicitly whether a new user test will be required every time a PIL is amended. However, he anticipates that the need for another user test will depend on the information that is added or deleted. “The key issue is whether the change in question is likely to be one of the 15 points that are most important for the safe and effective use of the medicine.”

The new legislation will ensure that the information provided to patients in PILs is legible, clear and easy to use, and this should hopefully lead to improvements in patient compliance.

Back to Top


©The Pharmaceutical Journal