Diversity in clinical guidelines: the role of repertoires of evaluation
Introduction
Defined as ‘systematically developed statements to assist practitioner and patient decisions about appropriate health care for specific clinical circumstances’(Field & Lohr (Eds.), 1990), clinical practice guidelines (CPG) are presently one of the main tools through which clinicians, policy makers and patients hope to make health care less variable, more reliable and efficient. While clinical guidelines have been developed in western countries since the second half of the 20th century, the last decade has heightened their appeal as tools for supporting health care practice and policy. In the UK, the National Institute for Clinical Excellence is a Special Health Authority within the National Health Service that provides primary and acute care trusts, patients and clinicians with guidance on ‘best practice’, addressing the clinical management of specific conditions.
This strengthened interest in clinical guidelines can be linked with structural and epistemic alterations in contemporary health systems: a shift from provider-driven to buyer-driven health care delivery, and the emergence of managed care (Light, 2000); correlated shifts in the position of the medical profession and its regulation within health care systems in the UK (Harrison, 1996); and transformations in the organisation and understanding of medical knowledge and practice, particularly with the emergence of evidence-based medicine (EBM) in the 1990s (Sackett, Haynes, Guyatt, & Tugwell, 1991; Sackett, Rosenberg, Muir Gray, Haynes, & Richardson, 1996). Clinical guidelines have followed the EBM lead by adapting consensus-based development procedures to the requirements of secondary research (systematic reviews, meta-analysis, etc.) (Eccles & Grimshaw, 2000; Lohr, Eleazer, & Mauskopf, 1998). This adaptation has demanded the creation of ‘robust methodologies’ of guideline development with an increasing interest in understanding the factors that influence the development and implementation of guidelines (Berg, ter Meulen, & van den Burg, 2001; Berkwits, 1998).
The research here presented addresses the following question: how do guideline development groups put together their recommendations for appropriate health care for specific clinical circumstance? Drawing on qualitative analysis of guideline development meetings, this paper argues that in the construction of clinical guidance CPG groups attend to different sets of epistemic concerns organised around recursive forms of judgement (Thevenot & Boltanski, 2000). Data analysis identified four mains types of collective judgement by which CPG development groups endorse clinical guidance: the technical robustness of knowledge, its usability, political acceptability and its methodological adequacy.
The paper draws on the sociology of situated judgement of Boltanski and Thevenot (Boltanski & Thévenot, 1991) and the social studies of science, technology and medicine (Berg & Mol, 1998) in exploring how the diversity of knowledges is important in the development of medical standards such as guidelines. In the biomedical domain, more specifically, there has been an increasing awareness the multifarious knowledge worlds within biomedicine (Barbot & Dodier, 2002). The paper suggests that clinical guidance comes to existence through the combination of repertoires of evaluation of knowledge that are usually described by practitioners as not easily merged—‘biomedical science’ and ‘clinical practice’(Smith & Egger, 1998)—or recommended to stay apart—‘biomedical science’ and ‘health politics’. Acknowledging the diversity of forms of knowledge in the construction of clinical guidance might be a fundamental step in understanding the reported lack of impact of CPGs (Cabana et al., 1999) and is furthermore vital to achieve transparency in evidence based health care practice.
Section snippets
Method
Between 2002 and 2003, two guideline development processes were studied in their entirety, using a multiplicity of qualitative techniques. The groups, convened in an English University, were multidisciplinary, and of the total 20 participants. Two consultants per group, four general practitioners per group, two patients representatives in Group 1 and one in Group 2, one pharmacists per group, one nurse practitioner and one health services researcher in Group 1, and one methodologist acting in
The multiple ‘worlds’ of a guideline
The practice of evidence-based CPG development is nowadays an institutionalised procedure. Based upon the interaction between two units—a multidisciplinary development group and a research and support team—this process is aimed at facilitating the group's evaluation of the information requirements for appropriate clinical practice.1 The
The repertoire of ‘science’: technical robustness
Guideline groups’ attention to the criteria of reliability of the knowledge they produce and/or endorse is managed through their orientation towards a specific field and its form of discourse. This field is usually designated by group members as ‘science’. The robustness of a statement is evaluated by its possible resistance to critique by other researchers and/or guidelines developers. The resistance to possible critique is thus imagined in relation to a field of action that is dominantly
The repertoire of ‘practice’: usability
Guideline groups’ attention to the criteria of usability of the knowledge they produce and/or endorse is managed through their orientation towards a mode of discourse that has ‘practice’ as its central figure. The usability of a statement is evaluated by discussing its concrete usefulness in typical situations of doctor–patient interaction. In order to evaluate the ‘practice’ worth of a statement, members estimate (a) whether or not the statement proposes a change to the dominant health care
The repertoire of ‘politics’: acceptability
When judging the relative importance of information included in a clinical guideline, guideline groups also assess how acceptable it is to endorse statements or recommendations. The acceptability of a statement is evaluated by discussing how it might affect what members see as the relevant distributions of power in the institutions in which the guideline is going to be implemented. The repertoire of politics has to do with the collaborative evaluation of the political sensibleness of evidence
The repertoire of process: methodological adequacy
Guideline development group's evaluation of the knowledge endorsed in the document is also concerned with its own conditions of production. Their orientation towards the group as an apparatus of knowledge construction figures at the core the criteria of adequacy. In these types of situation, the quality of knowledge claims is seen as connected to the procedures—methods, discussions, etc.—through which it was elaborated. In this repertoire of evaluation, guideline groups make visible, orientate
Conclusion
The research presented here suggests a picture of evidence-based CPGs and their development that is different from the one frequently disseminated. Most guideline research has been mainly focused on the methodological aspects of recommendation development or, more recently, on the group processes (Pagliari & Grimshaw, 2002) and normative assumptions (Berg, ter Meulen, & van den Burg, 2001) that support such development. Through the theoretical approach that underpinned this study, it was
Acknowledgments
Drafts of this paper were presented at the SATSU ‘Brown Bag’ Seminar Series, University of York, in April 2003, and at the BSA MedSoc Group 35th Annual Conference, University of York, 26–28 September 2003. I thank the participants of both sessions for lively discussions, Richard Tutton for the invitation and Andrew Webster for his encouraging comments. For their generous comments I thank Nicolas Dodier, Neil Jenkins, James Mason, Carl May, Jeanette Pols, Tim Rapley, Dick Willems and the members
References (30)
From practice to researchthe case for criticism in an age of evidence
Social Science and Medicine
(1998)- et al.
Evidence based medicine and clinical practice guidelineshealth policy issues and applications
Health policy
(1998) - et al.
Incommunicable knowledge? Interpreting and applying the results of clinical trials and meta-analyses
Journal of Clinical Epidemiology
(1998) - et al.
Achieving clinical behaviour change; a case of becoming indeterminate
Social Science and Medicine
(1998) - et al.
Multiplicity in scientific medicinethe experience of HIV-positive patients
Science, Technology & Human Values
(2002) - et al.
Guidelines for appropriate carethe importance of empirical normative analysis
Health Care Analysis
(2001) - et al.
De La Justification. Les Économies de La Grandeur
(1991) - et al.
Why don’t physicians follow clinical practice guidelines? a framework for improvement
Journal of the American Medical Association
(1999) Action as a combination of ‘common worlds’
Sociological Review
(1993)
Clinical guidelinesfrom conception to use
Getting evidence into clinical practicean organisational behaviour perspective
Journal of Health Services Research Policy
The discovery of grounded theorystrategies for qualitative research
Epistemology, evidence and experienceevidence based health care in the work of accident alliances
Sociology of Health and Illness
Cited by (111)
Working with epistemic uncertainties: Emerging entanglements within conditional reimbursement practices
2024, Health Policy and TechnologyOrganizing implementation in healthcare: Balancing orders of worth
2024, Social Science and MedicineKaleidoscopic integration: Advancing the integration of incommensurable knowledge in healthcare guidelines
2023, Social Science and MedicineA few panel members dominated guideline development meeting discussions: Social network analysis
2022, Journal of Clinical EpidemiologyClinical practice guidelines in courts’ representation of medical evidence and testimony
2021, Social Science and MedicineCitation Excerpt :This downplaying of the political character of guideline development and the expressed propriety of abiding by the guidelines is interesting in the light of earlier social scientific literature that discusses CPGs, in which consensus statements are shown to be a product of negotiation and agreement on contradicting, inconclusive or non-existing scientific evidence (Cartwright, 2011; Deaton and Cartwright 2018; Kelly et al., 2010; Knaapen, 2013; van Loon et al., 2014), crafted by a specifically convened group of medical professionals, and increasingly involving patient advocates as well. Thus, rather than being technical documents of best scientific evidence, CPGs are developed in a process that combines and contrasts pragmatic and political concerns with the epistemological concerns of the statistical procedure that produces the evidence hierarchy (Knaapen et al., 2010; Moreira, 2005). Another way to circumvent the tension between the guideline consensus and the obvious “differences in line” between the featured experts is to emphasize the field as being fundamentally contested: