Skip to main content
  • Research article
  • Open access
  • Published:

Pain relief that matters to patients: systematic review of empirical studies assessing the minimum clinically important difference in acute pain

Abstract

Background

The minimum clinically important difference (MCID) is used to interpret the clinical relevance of results reported by trials and meta-analyses as well as to plan sample sizes in new studies. However, there is a lack of consensus about the size of MCID in acute pain, which is a core symptom affecting patients across many clinical conditions.

Methods

We identified and systematically reviewed empirical studies of MCID in acute pain. We searched PubMed, EMBASE and Cochrane Library, and included prospective studies determining MCID using a patient-reported anchor and a one-dimensional pain scale (e.g. 100 mm visual analogue scale). We summarised results and explored reasons for heterogeneity applying meta-regression, subgroup analyses and individual patient data meta-analyses.

Results

We included 37 studies (8479 patients). Thirty-five studies used a mean change approach, i.e. MCID was assessed as the mean difference in pain score among patients who reported a minimum degree of improvement, while seven studies used a threshold approach, i.e. MCID was assessed as the threshold in pain reduction associated with the best accuracy (sensitivity and specificity) for identifying improved patients. Meta-analyses found considerable heterogeneity between studies (absolute MCID: I2 = 93%, relative MCID: I2 = 75%) and results were therefore presented qualitatively, while analyses focused on exploring reasons for heterogeneity. The reported absolute MCID values ranged widely from 8 to 40 mm (standardised to a 100 mm scale) and the relative MCID values from 13% to 85%. From analyses of individual patient data (seven studies, 918 patients), we found baseline pain strongly associated with absolute, but not relative, MCID as patients with higher baseline pain needed larger pain reduction to perceive relief. Subgroup analyses showed that the definition of improved patients (one or several categories improvement or meaningful change) and the design of studies (single or multiple measurements) also influenced MCID values.

Conclusions

The MCID in acute pain varied greatly between studies and was influenced by baseline pain, definitions of improved patients and study design. MCID is context-specific and potentially misguiding if determined, applied or interpreted inappropriately. Explicit and conscientious reflections on the choice of a reference value are required when using MCID to classify research results as clinically important or trivial.

Peer Review reports

Background

It can be challenging to decide whether a modest effect in a randomised clinical trial, or a meta-analysis of several such trials, is clinically relevant. Statistical tests inform on the probability of a result being a chance finding; however, they convey no information on whether a given effect will be experienced as important by patients. The degree of pain reduction that is considered clinically relevant has an impact on which analgesic interventions are regarded clinically useful. This interpretation problem for clinical relevance has been at the core of debates of the importance of several types of interventions intended for reducing acute pain, for example, paracetamol [13], non-steroidal anti-inflammatory drugs [4, 5], morphine or synthetic opiates [6], corticosteroids [7], muscle relaxants [4], laser therapy [8], transcranial direct current stimulation [9], EMLA cream [10], and acupuncture [11]. A related challenge involves the calculation of sample sizes for clinical trials, where researchers need to know the smallest clinically important effect that the trial should not miss to be able to determine an adequate sample size.

Jaeschke et al. [12] characterised the concept of minimum clinically relevant difference in 1989 as “the smallest difference in score in the domain of interest which participants perceive as beneficial and which would mandate, in the absence of troublesome side effects and costs, a change in the patient’s management”. The strength of the concept is that it defines a relevant effect size based on clinical considerations and not only statistical significance [13, 14]. It has subsequently been supplemented by a related concept – the substantial (and not only minimum) clinically relevant difference [15].

The minimum clinically important difference (MCID) is sometimes chosen on the basis of expert consensus judgement [16], statistical models [17] or objective criteria [18]. However, in acute pain, it seems reasonable to anchor clinical relevance to the patients’ experience. This approach is in accordance with the increasing awareness of the relevance of patient-reported outcomes in clinical research [19]. Several such empirical studies have been conducted to determine the MCID in acute pain, but they differ with regard to methodology, clinical condition and findings, and have not yet been systematically reviewed. Since acute pain is a core symptom in healthcare, an assessment of the MCID and a clarification of the causes for its variation will have broad interest. It has been suggested that baseline pain influences absolute values of MCID, but study reports have been conflicting [20, 21], and it remains unclear which other clinical or methodological factors are of importance.

We therefore decided to systematically review empirical studies of the MCID in acute pain relief and to examine possible causes for variation between study results, especially their likely dependency on baseline pain levels. We also reviewed studies of the substantial clinically important difference in acute pain relief as well as clinically important differences for worsening of pain.

Methods

Eligibility criteria

We included prospective studies of patients with acute pain, regardless of age, clinical condition, and intervention, in which pain intensity was assessed on a one-dimensional scale, e.g. a 100 mm visual analogue scale (VAS) or a 0–10 point numerical rating scale (NRS), and in which the MCID was determined using an anchor-based method using patients’ perception of change to determine clinical importance. Pain was considered acute when its duration was less than 1 month or, if duration was not indicated, when it was described as such in a study report.

Studies were excluded if they were not clinical (i.e. used healthy volunteers) or determined the MCID from objective criteria (e.g. return to work), the distribution of data (e.g. the minimum detectable difference) or expert consensus.

A typical eligible study would ask patients to score their pain intensity, e.g. using a VAS, at baseline and follow-up. At follow-up, patients were also asked to categorise their change in pain intensity using response options such as ‘no change’, ‘a little better’/‘somewhat better’, and ‘a lot better’/‘much better’. The MCID was then determined from the change in scores on the pain scale among patients having categorised their change as ‘a little better’ (or a similar expression indicating a minimum clinically important improvement).

We included studies with two types of analytical approaches (1) the ‘mean change approach’, i.e. the mean difference in pain scores among patients who reported a minimum degree of pain relief [22]; or (2) the ‘threshold approach’, i.e. the threshold value for pain score change which most accurately (yielding best sensitivity and specificity) identified patients experiencing relevant pain relief in analogy with a diagnostic test where the gold standard is patients’ perception of change [23].

Search strategy

We searched PubMed, EMBASE and Cochrane Library until August 2016 with no language restrictions. The core search string was: (minimal OR minimally OR minimum OR ‘clinically significant’ OR ‘clinically important’ OR ‘clinically meaningful’ OR ‘clinically relevant’) AND (difference OR change OR relief OR reduction) AND (‘pain measurement*’ OR ‘visual analog scale’ OR ‘numeric rating scale’) AND (pain) with variations according to the specific database (Appendix 1). The reference lists of all included studies and relevant review papers were read systematically to identify further studies.

Screening of titles and abstracts to determine the eligibility of studies was done by the primary author (MFO), while the selected full-text records were examined by two researchers independently (MFO and either EB, NEL, BT, or MDH). Any disagreement was solved by discussion.

Data extraction and retrieval

Data extraction was conducted by two researchers independently (MFO and EB, BT, or NEL) using pretested data extraction forms generated in EpiData (EpiData Association, Odense, Denmark). Any disagreements were solved by discussion.

For each study, we extracted descriptive data including publication year, study design, setting, clinical condition, type of intervention, sampling method, sample size, and definition of patients with relevant change (see Appendix 2 for complete list). For studies using a mean change approach, we extracted the following outcome data: the MCID for pain relief (absolute values in mm or points and relative value in percent change from baseline) and for pain worsening (absolute and relative values), as well as the substantial clinically important difference for relief and worsening of pain (absolute and relative values). We extracted MCIDs as the mean change in pain score among patients who indicated a one-category improvement (e.g. ‘a little better’). If unavailable, we extracted the mean change among patients who were minimally improved by authors’ definition (e.g. some authors defined minimum important change as the mean change in pain score among patients with either a one- or two-category improvement). Similarly, we extracted the substantial clinically important differences as the mean change among patients with a two-category improvement or used the authors’ definition. We extracted the point estimate of outcomes with their corresponding standard error or, if unavailable, other measures of variation such as standard deviation or 95% confidence interval.

For studies using a threshold approach, we extracted information about definition of responders (i.e. patients with relevant change) and non-responders and the cut-off point with its corresponding sensitivity (i.e. percentage of responders correctly classified as such) and specificity (i.e. percentage of non-responders correctly classified as such). If studies reported pain scores from several concurrent pain assessments (e.g. back pain and leg pain), we extracted the assessment where more data were available or, if no difference found, we randomly selected which to extract. All scales were standardised to a 0–100 mm scale. When studies reported pain assessments based on both VAS and NRS, we used the assessment based on VAS.

If the primary outcome or other key variables were unclear or incompletely reported from a study, we contacted the corresponding author. In cases where authors provided individual patient data, we first checked whether we could replicate a main result of the published paper. We then calculated estimates of absolute and relative MCIDs and their corresponding standard error.

For each study, we assessed risk of attrition bias (studies were considered low risk when attrition < 10%) and risk of non-representative study sample (studies were considered low risk if using consecutive or random sampling).

Data synthesis and analysis

For each study, we extracted or calculated the MCID for pain relief (absolute and relative change), and noted results of any study-based exploration of causes for variation, e.g. baseline pain.

We then summarised results qualitatively as there was considerable clinical and methodological variation between studies and heterogeneity in their results. To provide an overview, we first reported the range of results for all studies and then the range and median results with inter-quartile ranges (IQR) of studies according to analytical strategy (mean change or threshold approach). To facilitate exploration of reasons for heterogeneity, we then pooled results of studies using mean change approach with inverse-variance meta-analysis using random effects models. We studied the association with baseline pain scores in three different analyses. First, we explored the impact of the average population baseline pain in a mixed-effects meta-regression (acknowledging the limitations of aggregated data-level analysis [24]). Second, we pooled individual patient data to estimate the MCID (absolute and relative changes) using a two-stage individual participant data meta-analysis. In these models, MCIDs were first estimated in each individual study using a mixed model based on all repeated measurements and participant specific random effects to capture the serial correlation within each participant. Results were then pooled using random-effects inverse-variance meta-analysis. Third, we used the same model to derive outcomes measured at different time points in studies with multiple measurements per patients (i.e. the use of a ‘moving baseline’).

We furthermore used subgroup analyses to explore whether between-study variation was explained by differences in other clinical and methodological factors including clinical condition, type of pain scale (VAS vs. NRS), directionality of global transition scale (one-sided vs. two-sided scale), definition of minimum clinically important change (one category vs. several categories improvement vs. distinction between meaningful and non-meaningful change), number of pain assessments per patients (single vs. multiple assessments adjusted for correlation vs. multiple unadjusted assessments), risk of attrition bias (low vs. high or unclear) and risk of non-representative sample (low vs. high or unclear).

Finally, we used the same analysis strategy for the substantial clinically important difference for pain relief (absolute and relative change) and the minimum and substantial clinically important differences for worsening of pain (absolute and relative change).

All data analyses were done using Stata/IC version 13.

Results

Study selection

We screened 1553 database records and read 273 full-text publications (Fig. 1). We excluded 237 publications, mostly because they included patients with chronic pain (n = 63) or multi-dimensional pain scales (n = 53). Thus, we included 36 publications [21, 2559] reporting 37 studies (8479 patients).

Fig. 1
figure 1

Flow chart of study identification. MCID = Minimal Clinically Important Difference, aAdditional records identified through “related papers” function in databases and reference lists of screened papers, bTwo records include both acute and chronic pain studies, cIncludes studies in which MCID was not based on subjective patient-reported assessment of pain relief

Characteristics of included studies

The majority of studies were based in emergency departments and included a mix of patients with acute pain of both traumatic and non-traumatic origin (10 studies) or unspecified pain (7 studies). Additional studies included patients with post-operative pain, cancer-related pain, sickle cell crisis, rheumatic pain, abdominal pain, low back pain, or headache (Tables 1 and 2). All studies were published in English.

Table 1 Studies determining minimal clinically important difference as a mean changea (35 studies, 7894 patients)
Table 2 Studies determining minimal clinically important difference as a threshold valuea (7 studies, 2602 patients)

Twenty studies assessed pain using a 100 mm VAS (or the similar Color Analog Scale), and 12 studies used an 11-point NRS (0–10), while five studies used both scales. In 32 studies, patients compared their current pain intensity with pain at their previous assessment, while they were asked to assess the effect of their treatment in five studies [25, 49, 58]. Transition scales were either two-sided (29 studies) with 3–15 response categories for both improvement and deterioration, or one-sided (8 studies) with five response categories addressing only improvement.

For studies using the mean change approach, the majority defined the minimum clinically important improvement as a one-category improvement on the transition scale (31 studies). The response categories were similar with wordings such as ‘a little less pain’, ‘a bit better’, ‘slightly improved’, or ‘slight relief’. In four studies, the MCID was defined as the mean change in pain score among patients with a one- or two-category improvement, thereby combing patients answering ‘some relief’ and ‘partial relief’ [55], or ‘much improved’ and ‘best ever’ [4951]. Finally, two studies differentiated between non-important and important change, using the categories ‘inadequate relief’ and ‘moderate relief’ in one study [40], and ‘poor’ and ‘less good’ efficiency of treatment in another [25] (Table 1). Studies using the threshold approach had large variation in transition scales and definitions of responders versus non-responders; patients were regarded as importantly improved if they indicated a one-category relief in two studies [41, 57], while they needed a five-category improvement in another [58] (Table 2).

Pain intensity was assessed at baseline and a single follow-up measurement in 14 studies, while it was assessed at multiple (from 2 to 16) follow-ups with intervals between 10 and 45 minutes in 23 studies. The latter group then derived their outcome as the summarised mean difference in pain score from the patients’ previous pain assessment when they reported minimum relief (i.e. a series of ‘moving baselines’). In eight of these studies, the P values of analyses were adjusted for correlation between estimates, for example, with Generalised Estimation Equation, while the remaining studies either made no adjustment or did not report this. Access to individual patient data increased the number of studies with adjusted estimates to 11.

In 10 studies, the MCID was defined as a numeric change for all patients with minimum change, regardless of whether pain had improved or worsened. After contacting authors, separate estimates for pain relief were available from eight of these.

MCID regardless of analytical approach

Standardised to a 100-mm scale, the absolute MCID in 30 studies ranged from 8 to 40 mm, and the relative difference in 15 studies ranged from 13% to 85%.

MCIDs in studies using the mean change approach

The determination of the MCID was based on a mean change approach in 35 studies, of which 30 (6598 patients) were included in our analyses and five were disregarded (see below). Twenty-nine studies (6517 patients) reported absolute values ranging from 8 to 40 mm, with a median of 17 mm (IQR 14–23 mm) (Fig. 2a). Only nine of the 30 studies reported relative MCIDs, but access to individual patient data made relative values available from 14 studies (1617 patients) ranging from 13% to 85%, with a median of 23% (IQR 18–36%) (Fig. 2b).

Fig. 2
figure 2

a Range of absolute minimal clinically important differences in acute pain assessed by the mean change approach* (29 studies, 6517 patients). *MCID assessed as the mean change in pain score among patients with minimal improvement of pain, MCID = Minimal Clinically Important Difference (mm reduction on a 100 mm scale), Studies where standard error (or data for obtaining this) was unavailable are presented as point estimates without 95% CI (NA = not applicable). b Range of relative minimal clinically important differences in acute pain assessed by the mean change approach* (14 studies, 1617 patients). *MCID assessed as the mean change in pain score among patients with minimal improvement of pain, MCID = Minimal Clinically Important Difference (% reduction from baseline), Studies where standard error (or data for obtaining this) was unavailable are presented as point estimates without 95% CI (NA = not applicable)

For data syntheses, we did not include results from five of the 35 studies (1567 patients) as they did not differentiate between pain relief and pain worsening [21, 48], because median (and not mean) differences in pain were reported [26, 33], or because outcomes were reported for subgroups and no overall estimate could be derived [36]. The range of MCID in these studies was comparable to the included studies: 10–19 mm. An additional six studies (493 patients) were not included in meta-analysis since information about standard error of estimates was unavailable [40, 49, 53, 54]. The results from these studies ranged from 11 to 40 mm.

We had data usable for meta-analyses from 23 studies (6024 patients) reporting absolute values and 11 studies (1397 patients) reporting relative values. Meta-analyses of both the absolute and relative values showed considerable heterogeneity: I2 = 93%, P < 0.001 and I2 = 75%, P < 0.001 (Table 3). We present the meta-analyses for completeness and as a basis for exploring reasons for the heterogeneity, but stress that medians and interquartile ranges are more appropriate descriptors of the results.

Table 3 Clinically important differences in acute pain

MCID in studies using the threshold approach

Seven of the 37 included studies (2602 patients) determined clinically important differences as a threshold to differentiate between patients with or without relevant pain relief. Absolute thresholds ranged from 10 to 35 mm in six studies (2331 patients) with a median of 10 mm, and the relative threshold ranged from 15% to 50% in four studies (534 patients) (Table 3). In one additional study [58], patients were defined as responders if they indicated at least a five-category improvement. The corresponding clinically important differences were thus higher (34 to 63 mm depending on baseline pain) than in studies where patients only needed a one- [41, 57], two- [49], or three-category improvement [25], respectively, to be defined as responders (Table 2).

Impact of baseline pain scores on the MCID

Eleven studies had assessed the possible influence of baseline pain on minimum clinically improvement (Appendix 3). Of nine studies assessing absolute change, seven reported an association [31, 33, 36, 43, 58, 59]. The two remaining studies found no association, but these were disregarded since they determined the MCID without differentiating between pain relief and pain worsening [21, 45]. Six studies assessed the association between baseline pain and relative change and either found the association to be non-significant or found it to be weaker than for absolute change.

Based on meta-regression, we found no association between baseline pain and either absolute (20 studies, P = 0.70) nor relative (9 studies, P = 0.83) estimates of MCIDs.

However, based on individual patient data meta-analysis from seven studies (918 patients), we found a strong association between baseline pain and absolute MCID, showing that patients with higher baseline pain need larger pain reduction to reach a minimum clinically relevant difference compared to patients with lower baseline pain. For each 10 mm increase in baseline pain, MCID increased by 3.1 mm (95% confidence interval, 2.8–3.5 mm, P < 0.001, I2 = 0%). Thus, for patients with initial pain levels < 40, 40–70, and > 70 mm, the MCIDs were 6 (4–8) mm, 13 (11–14) mm, and 21 (20–23) mm, respectively (Fig. 3). The corresponding relative estimates of MCIDs did not differ significantly: 17 (4–30) %, 23 (20–25) %, and 24 (22–26) %, respectively. In contrast, we found that patients with more severe pain perceived worsening of their status with smaller increases of pain intensity: the absolute MCID was 2.3 mm less for each 10 mm increase in baseline pain (1.4–3.0, P < 0.001, I2 = 67%).

Fig. 3
figure 3

Minimum clinically important difference by baseline pain (individual patient data from 7 studies, 918 patients). MCID assessed as the mean change in pain score among patients with minimal improvement of pain, MCID = Minimal Clinically Important Difference (mm reduction on a 100 mm scale). Forest plot of mean pain difference in 723 episodes where patients reported pain to be “a little better” in 7 studies including a total of 918 patients

From individual patient data, we also found that the MCID decreased with increasing time from baseline, from 17 (12 to 21) mm at 30 minutes to 11 (8 to 14) mm at 120 minutes. However, patients’ pain level declined accordingly during the multiple follow-ups and estimates expressed as a relative change from the previous assessment therefore did not decline.

Impact of other clinical and methodological factors

Other causes for variation in the MCID were addressed in 10 studies. These included sex [33, 35, 36, 4448, 51, 54, 57, 59], age [33, 35, 36, 4446, 48, 51, 54, 57, 59], education level [35, 48, 51, 54], ethnicity [54, 57], primary language (English or Spanish) [57], and religion [54], as well as cause (traumatic or non-traumatic) [4448, 57], duration [35] and location [35] of pain. None of the studies found associations except for one [48], which reported higher MCIDs for men compared to women and for non-traumatic pain compared to traumatic pain. However, these analyses were not adjusted for differences in baseline pain.

The MCIDs of subgroups are presented as medians and pooled averages, respectively (Table 4). For most clinical and methodological factors, the number of studies in each subgroup was too small to ensure detection of relevant differences between them. Nevertheless, although only few studies defined the MCID as the mean pain reduction among patients with several categories of improvement, or patients with ‘meaningful’ (and not just ‘minimum’) change, it was clear that these studies found higher MCIDs (medians 25 (IQR 23–29) and 34 (IQR 27–40), respectively) than studies where it was defined as the mean pain reduction among patients with a one-category improvement (median 16 (IQR 13–21)). It was also clear that the MCID was higher when based on a single assessment involving one fixed baseline value (median 25 (IQR 23–29)), than when summarised from multiple assessments with the previous assessment applied as a ‘moving baseline’ (medians 15 (IQR 13–16) and 16 (IQR 10–21), respectively). Subgroups of studies among patients with various clinical conditions were underpowered to detect relevant differences. The comparison of one- and two-sided transition scales was also underpowered, but the difference in scales did not seem to affect study results, while the comparison of VAS and NRS included enough studies to conclude that type of pain scale did not influence the MCID. Finally, we did not find differences in outcomes relating to the risk of attrition bias or risk of non-representative samples.

Table 4 Subgroup analyses of absolute minimum clinically important differences (MCIDs) for pain relief

Supplementary outcomes

The supplementary outcomes for pain relief and worsening were only reported from studies using the mean change approach (Table 3). The results showed similarly high heterogeneity. The substantial clinically important difference for pain relief ranged from 18 to 54 mm (23 studies), while minimum and substantial clinically important differences for worsening of pain ranged from 8 to 21 mm increase (18 studies) and from 0 to 66 mm increase (16 studies), respectively.

Discussion

We included 37 studies (8479 patients) assessing the MCID in acute pain, of which 35 used the mean change approach and seven used the threshold approach. Meta-analyses found considerable heterogeneity between studies and, consequently, no single value of minimum clinical important difference could be meaningfully determined. Study results ranged widely both when they were reported as absolute change (from 8 to 40 mm) and as relative change from baseline (from 13 to 85%). The median of study results based on the mean change approach was 17 (IQR 14 to 23) mm and 23 (IQR 18 to 36) % for absolute and relative values, respectively. Reasons for heterogeneity were explored and baseline pain was identified as a cause of variation in absolute, but not relative, outcomes. In addition, the definition of minimum clinically important change and the use of multiple assessments per patient influenced study results. High heterogeneity was also found for assessments of substantial clinically important difference as well as for worsening of pain.

Strengths and limitations

To our knowledge, this is the first systematic review of MCIDs in acute pain. We identified 37 studies involving over 8000 patients and a broad range of clinical conditions, study approaches and pain scales. We gained access to unpublished data from 10 studies, including individual patient data from seven studies (918 patients). This ensured high data quality and uniform analysis, and enabled an adequate assessment of the association with baseline pain avoiding the risk of ecological fallacy [24] inherent to aggregated study-level data. The median results of studies providing individual patient data was comparable with the remaining studies and we have no reason to believe these studies were not representative. Association with baseline pain has been reported from individual studies [31, 33, 36, 43, 5759], but the present review is the first comprehensive assessment of the impact of baseline pain across studies. In addition, we identified variation in study designs (single or multiple assessments) and definitions of patients with minimum relief as factors influencing the MCID.

However, we were not able to fully explain the large heterogeneity among studies. We found no effects of pain scale, but for the comparison of clinical conditions and directionality of transition scale, subgroups involved too few studies to ensure detection of all relevant associations. In addition, our ability to assess clinical condition was limited by the fact that many studies included a mixed patient group and we did not have access to individual patient diagnoses. Similarly, the studies included a variety of analgesia and other treatments which did not allow an assessment of potential impact of interventions. Regarding the risk of attrition bias and non-representative sampling, the majority of studies were categorised as unclear and potential impact could therefore not be assessed. Most importantly, acknowledging the association with baseline pain, it would have been more accurate to base subgroup analyses on relative outcomes, but the data available only allowed comparison of absolute outcomes. We could not assess impact of various description of pain (e.g. “intensity”) or the follow-up time between measurements since there was not enough variation between studies. Furthermore, the available data did not allow an assessment of the potential influence of pre-existing pain level (e.g. if patients are affected by chronic pain in addition to their current episode of acute pain), pre-existing use of pain relief or the psychological state of patients, since this was not reported by any of the studies. Finally, we cannot dismiss the risk of recall bias in studies where patients simultaneously assess their pain status and perceived change [60]. Differences in baseline pain or other methodological or clinical factors may influence subgroup analyses of study-level data. Thus, better access to individual patient data would greatly improve the chances of identifying causes of heterogeneity.

Other studies

Only few systematic reviews of the minimum clinically relevant change have been published despite a vast number of primary studies. Stauffer [20] and Erdogan [61] reviewed studies of minimum clinically relevant change in pain scales used for chronic rheumatologic conditions, but we have not identified any systematic reviews focusing on acute pain.

The problem of variability in results of studies of minimum clinically relevant change has previously been addressed primarily when attempting to reconcile dissimilar results from different approaches, e.g. anchor-based and distribution-based studies [62]. Our study demonstrates considerable unexplained variation also within anchor-based approaches. In line with our findings, Terwee [63] found variability between results of five studies of minimum clinically important change on the Western Ontario and McMaster University pain subscale for osteoarthritis. In a systematic review of the minimum clinical important difference in chronic pain, we have found similar issues of high study variability (manuscript in preparation).

Mechanisms and perspectives

We included studies with a patient-reported anchor. While some find that using a patient-reported criterion as an anchor for a patient-reported score is circular and basically flawed [64], we would argue that pain intensity is essentially a subjective experience best expressed by and anchored to those experiencing it. Other observer-based anchors may be used when the outcome of interest is return to work or daily level of activity [65]. The varying content of the patient-reported anchors is, however, problematic. The applied transition scales were either one- or two-sided, allowing patients to report their degree of change (or only relief) by choosing between anywhere from three to 15 response categories. The majority of studies then determined the MCID as a mean change in pain score among everyone reporting a one-category pain relief. However, this value does not apply to all individuals in the group, since their differences in pain are distributed around the mean [14]. In contrast, MCIDs expressed as threshold values are derived with the intention of obtaining the best possible discrimination between patients with and without relevant relief. The frequency of false-positive and false-negative results may be reduced but is not eliminated by this approach. Therefore, caution is always merited when bringing an overall estimate of important change to the level of interpretation for an individual patient [66, 67].

The studies we included varied considerably both in methods and analytical approaches. As would be expected, differences in the definition of patients with minimum important change impacted study results. We also found that the use of multiple measurements per patient resulted in lower outcomes. This corresponded with the finding that outcomes decreased during several follow-ups as patients’ pain declined over time. Furthermore, one in four of the reviewed studies did not differentiate between minimum relief and minimum worsening of pain in their original study reports. The practice of combining groups with minimum change, regardless of its direction, is sometimes based on a seemingly similar distribution of data in the two groups [44]. However, although they may be similar at one point, the MCID for pain relief and worsening will change in opposite directions with variations of baseline pain (since patients with higher baseline pain require larger pain reduction to perceive relief, but smaller increase to perceive worsening of their condition).

The association between MCID and baseline pain may to some extent be explained by ‘regression towards the mean’ as patients are likely to score closer to the mean if their initial scores were more extreme because of chance [68]. However, it is also very plausible that patients with higher pain require greater decrease to perceive relief. Relative changes are therefore more stable indicators of clinically important differences, although they lack interval scale properties at the scale extremes, e.g. when baseline values are close to zero and small degrees of pain change result in very large relative changes [69]. From this review, however, it is clear that the advantage of relative values is largely overlooked, since only 10 of 37 studies (27%) reported relative change.

This review included studies that determined MCID from an anchor-based method using patients’ perception of change to determine clinical importance. Although this is the most common approach, it is just one among a wide range of alternative methods. Revicki noted that retrospective self-reports of pain relief tend to correlate more strongly with the end-level of pain than the start level, implying that the current status matters to patients more than the degree of improvement [70]. This has led to the development of the concept of ‘patient acceptable symptom state’, defined as the level of symptoms which patients feel is acceptable [71, 72]. Patient acceptable symptom state corresponds with the dominant aim of clinical patient care to reduce pain to an acceptable level [73] and could be a strong candidate for an alternative to MCID. Other promising approaches have integrated intervention costs and side effects [7477].

It is likely that the challenges of MCID, apparent for acute pain, may not be isolated to that specific research area. Acute pain stands out because of the many studies that have been conducted, reflecting the status of acute pain as a core symptom in clinical practice. Our study can thus be seen as a model for a more general challenge with empirical assessments of the MCID.

The methodological challenges embedded in the empirical assessment of MCID are of such an extent that merits caution for its use and interpretation. It is clearly inappropriate to use and interpret MCID as a kind of clinical scale constant – a characteristic which, once empirically determined, is universally valid. This is, however, often the practice seen [78]. Nevertheless, there is a strong and reasonable demand for a structured approach for evaluating whether effects of interventions are clinically meaningful to patients.

Implications

The choice of a reference value has large consequences for the number of patients needed in a trial, e.g. four times as many patients will be included, if researchers accept a MCID value of 12 mm as compared to 24 mm. Further, the conclusion about the clinical relevance of a trial result is often based on whether a mean difference exceeds a chosen reference value, but with the large span of MCIDs available in the literature, it is highly problematic to randomly pick one or a few single assessments for guidance. The considerable variation means that it is necessary to conscientiously and explicitly reflect on the span of results in relation to context-specific clinical and methodological factors, as presented in this review, with a particular focus of the baseline pain of patients, whether repeated measurements were used, and how minimum relief was defined. A starting point for such an exercise by individual clinicians or researchers, or by consensus building committees, could very well be our overview of studies and their results.

In future studies there is a clear need for uniform guidelines for standardised conduct, analyses and reporting of the MCID, especially for how transition scales and questions are structured and how data are analysed. We strongly encourage using values relative to baseline pain – also for multiple measurements where the patient’s last assessment should be applied as a ‘moving baseline’, standardising the definition of relevant pain relief, and distinguishing clearly between improvement and worsening of pain. In addition, since the influence of clinical and methodological factors is difficult to identify from aggregated data, we encourage improved access to individual patient data to enable further exploration of the causes of heterogeneity.

Conclusion

The MCID in acute pain varied greatly between studies. Absolute MCID ranged from 8 to 40 mm in 29 studies, and relative values ranged from 13% to 85% in 14 studies. Baseline pain was strongly associated with absolute, but not relative, values and variation in definitions of minimum relief and study designs influenced study results. Due to the heterogeneity between study results, no meaningful overall value of minimum clinically important change can be concluded. Instead, we recommend that MCIDs are considered context-specific and take account of baseline pain. The MCID in acute pain is central for the interpretation of results of randomised trials and meta-analyses and for determining appropriate sample sizes for new trials, but it is potentially misguiding if determined, applied or interpreted inappropriately. Explicit and conscientious reflections on the choice of a MCID value are required, when using it to classify research results as clinically important or trivial.

Abbreviations

AH:

Asbjørn Hróbjartsson

BT:

Britta Tendal

EB:

Eik Bjerre

JH:

Jørgen Hilden

MCID:

Minimal clinically important differences

MDH:

Maria Damkjær Hansen

MFO:

Mette Frahm Olsen

NEL:

Nino Emmanuel Landler

NRS:

Numerical rating scale

VAS:

Visual analogue scale

References

  1. Sinatra RS, Jahr JS, Reynolds L, Groudine SB, Royal MA, Breitmeyer JB, et al. Intravenous acetaminophen for pain after major orthopedic surgery: an expanded analysis. Pain Pract. 2012;12:357–65.

    Article  PubMed  Google Scholar 

  2. Stockler M, Vardy J, Pillai A, Warr D. Acetaminophen (paracetamol) improves pain and well-being in people with advanced cancer already receiving a strong opioid regimen: a randomized, double-blind, placebo-controlled cross-over trial. J Clin Oncol. 2004;22:3389–94.

    Article  CAS  PubMed  Google Scholar 

  3. Dalton JD, Schweinle JE. Randomized controlled noninferiority trial to compare extended release acetaminophen and ibuprofen for the treatment of ankle sprains. Ann Emerg Med. 2006;48:615–23.

    Article  PubMed  Google Scholar 

  4. Friedman BW, Dym AA, Davitt M, Holden L, Solorzano C, Esses D, et al. Naproxen with cyclobenzaprine, oxycodone/acetaminophen, or placebo for treating acute low back pain: a randomized clinical trial. JAMA. 2015;314:1572–80.

    Article  CAS  PubMed  Google Scholar 

  5. Jones P, Dalziel SR, Lamdin R, Miles-Chan JL, Frampton C. Oral non-steroidal anti-inflammatory drugs versus other oral analgesic agents for acute soft tissue injury. Cochrane Database Syst Rev. 2015;7:CD007789.

    Google Scholar 

  6. Farahmand S, Shiralizadeh S, Talebian M-T, Bagheri-Hariri S, Arbab M, Basirghafouri H, et al. Nebulized fentanyl vs intravenous morphine for ED patients with acute limb pain: a randomized clinical trial. Am J Emerg Med. 2014;32:1011–5.

    Article  PubMed  Google Scholar 

  7. Chau JKM, Seikaly HR, Harris JR, Villa-Roel C, Brick C, Rowe BH. Corticosteroids in peritonsillar abscess treatment: a blinded placebo-controlled clinical trial. Laryngoscope. 2014;124:97–103.

    Article  CAS  PubMed  Google Scholar 

  8. Santamato A, Solfrizzi V, Panza F, Tondi G, Frisardi V, Leggin BG, et al. Short-term effects of high-intensity laser therapy versus ultrasound therapy in the treatment of people with subacromial impingement syndrome: a randomized clinical trial. Phys Ther. 2009;89:643–52.

    Article  PubMed  Google Scholar 

  9. Luedtke K, Rushton A, Wright C, Geiss B, Juergens TP, May A. Transcranial direct current stimulation for the reduction of clinical and experimentally induced pain: a systematic review and meta-analysis. Clin J Pain. 2012;28:452–61.

    Article  PubMed  Google Scholar 

  10. Biran V, Gourrier E, Cimerman P, Walter-Nicolet E, Mitanchez D, Carbajal R. Analgesic effects of EMLA cream and oral sucrose during venipuncture in preterm infants. Pediatrics. 2011;128:e63–70.

    Article  PubMed  Google Scholar 

  11. Madsen MV, Gøtzsche PC, Hróbjartsson A. Acupuncture treatment for pain: systematic review of randomised clinical trials with acupuncture, placebo acupuncture, and no acupuncture groups. BMJ. 2009;338:a3115.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials. 1989;10:407–15.

    Article  CAS  PubMed  Google Scholar 

  13. Crosby RD, Kolotkin RL, Williams GR. Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol. 2003;56:395–407.

    Article  PubMed  Google Scholar 

  14. Dworkin RH, Turk DC, Wyrwich KW, Beaton D, Cleeland CS, Farrar JT, et al. Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. J Pain. 2008;9:105–21.

    Article  PubMed  Google Scholar 

  15. Glassman SD, Copay AG, Berven SH, Polly DW, Subach BR, Carreon LY. Defining substantial clinical benefit following lumbar spine arthrodesis. J Bone Joint Surg Am. 2008;90:1839–47.

    Article  PubMed  Google Scholar 

  16. Ostelo RWJG, Deyo RA, Stratford P, Waddell G, Croft P, Von Korff M, et al. Interpreting change scores for pain and functional status in low back pain: towards international consensus regarding minimal important change. Spine. 2008;33:90–4.

    Article  PubMed  Google Scholar 

  17. Auleley G-R, Benbouazza K, Spoorenberg A, Collantes E, Hajjaj-Hassouni N, van der Heijde D, et al. Evaluation of the smallest detectable difference in outcome or process variables in ankylosing spondylitis. Arthritis Rheum. 2002;47:582–7.

    Article  PubMed  Google Scholar 

  18. Chansirinukor W, Maher CG, Latimer J, Hush J. Comparison of the functional rating index and the 18-item Roland-Morris Disability Questionnaire: responsiveness and reliability. Spine. 2005;30:141–5.

    Article  PubMed  Google Scholar 

  19. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167.

    Article  PubMed  Google Scholar 

  20. Stauffer ME, Taylor SD, Watson DJ, Peloso PM, Morrison A. Definition of nonresponse to analgesic treatment of arthritic pain: an analytical literature review of the smallest detectable difference, the minimal detectable change, and the minimal clinically important difference on the pain visual analog scale. Int J Inflamm. 2011;2011:231926.

    Article  Google Scholar 

  21. Lopez BL, Flenders P, Davis-Moon L, Corbin T, Ballas SK. Clinically significant differences in the visual analog pain scale in acute vasoocclusive sickle cell crisis. Hemoglobin. 2007;31:427–32.

    Article  CAS  PubMed  Google Scholar 

  22. Guyatt GH, Osoba D, Wu AW, Wyrwich KW, Norman GR, Clinical Significance Consensus Meeting Group. Methods to explain the clinical significance of health status measures. Mayo Clin Proc. 2002;77:371–83.

    Article  PubMed  Google Scholar 

  23. Deyo RA, Centor RM. Assessing the responsiveness of functional scales to clinical change: an analogy to diagnostic test performance. J Chronic Dis. 1986;39:897–906.

    Article  CAS  PubMed  Google Scholar 

  24. Lambert PC, Sutton AJ, Abrams KR, Jones DR. A comparison of summary patient-level covariates in meta-regression with individual patient data meta-analysis. J Clin Epidemiol. 2002;55:86–94.

    Article  CAS  PubMed  Google Scholar 

  25. Aicher B, Peil H, Peil B, Diener H-C. Responsiveness of efficacy endpoints in clinical trials with over the counter analgesics for headache. Cephalalgia Int J Headache. 2012;32:953–62.

    Article  Google Scholar 

  26. Bailey B, Daoust R, Doyon-Trottier E, Dauphin-Pierre S, Gravel J. Validation and properties of the verbal numeric scale in children with acute pain. Pain. 2010;149:216–21.

    Article  PubMed  Google Scholar 

  27. Bernstein SL, Bijur PE, Gallagher EJ. Relationship between intensity and relief in patients with acute severe pain. Am J Emerg Med. 2006;24:162–6.

    Article  PubMed  Google Scholar 

  28. Bijur PE, Latimer CT, Gallagher EJ. Validation of a verbally administered numerical rating scale of acute pain for use in the emergency department. Acad Emerg Med. 2003;10:390–2.

    Article  PubMed  Google Scholar 

  29. Bijur PE, Chang AK, Esses D, Gallagher EJ. Identifying the minimum clinically significant difference in acute pain in the elderly. Ann Emerg Med. 2010;56:517–21. e1.

    Article  PubMed  Google Scholar 

  30. Bijur PE, Chang AK, Esses D, Gallagher EJ. Problems with measurement of the minimum clinically significant difference in acute pain in elders. Acad Emerg Med. 2011;18:135–9.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Bird SB, Dickson EW. Clinically significant changes in pain along the visual analog scale. Ann Emerg Med. 2001;38:639–43.

    Article  CAS  PubMed  Google Scholar 

  32. Bulloch B, Tenenbein M. Assessment of clinically significant changes in acute pain in children. Acad Emerg Med. 2002;9:199–202.

    Article  PubMed  Google Scholar 

  33. Cepeda MS, Africano JM, Polo R, Alcala R, Carr DB. What decline in pain intensity is meaningful to patients with acute pain? Pain. 2003;105:151–7.

    Article  PubMed  Google Scholar 

  34. Chow E, Ling A, Davis L, Panzarella T, Danjoux C. Pain flare following external beam radiotherapy and meaningful change in pain scores in the treatment of bone metastases. Radiother Oncol. 2005;75:64–9.

    Article  PubMed  Google Scholar 

  35. Degerli V, Karcioglu O, Larkin GL, Karaduman S, Korkmaz T, Tunc MA. The minimum clinically significant difference in acute nontraumatic thoracoabdominal pain in adult emergency department patients in Turkey. J Emerg Med. 2012;19(3):171–6.

    Google Scholar 

  36. Farrar JT, Polomano RC, Berlin JA, Strom BL. A comparison of change in the 0-10 numeric rating scale to a pain relief scale and global medication performance scale in a short-term clinical trial of breakthrough pain intensity. Anesthesiology. 2010;112:1464–72.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Fosnocht DE, Chapman CR, Swanson ER, Donaldson GW. Correlation of change in visual analog scale with pain relief in the ED. Am J Emerg Med. 2005;23:55–9.

    Article  PubMed  Google Scholar 

  38. Gallagher EJ, Liebman M, Bijur PE. Prospective validation of clinically important changes in pain severity measured on a visual analog scale. Ann Emerg Med. 2001;38:633–8.

    Article  CAS  PubMed  Google Scholar 

  39. Gallagher EJ, Bijur PE, Latimer C, Silver W. Reliability and validity of a visual analog scale for acute abdominal pain in the ED. Am J Emerg Med. 2002;20:287–90.

    Article  PubMed  Google Scholar 

  40. Grilo RM, Treves R, Preux PM, Vergne-Salle P, Bertin P. Clinically relevant VAS pain score change in patients with acute rheumatic conditions. Jt Bone Spine Rev Rhum. 2007;74:358–61.

    Article  Google Scholar 

  41. Grotle M, Brox JI, Vøllestad NK. Concurrent comparison of responsiveness in pain and functional status measurements used for patients with low back pain. Spine. 2004;29:E492–501.

    Article  PubMed  Google Scholar 

  42. Holdgate A, Asha S, Craig J, Thompson J. Comparison of a verbal numeric rating scale with the visual analogue scale for the measurement of acute pain. Emerg Med (Fremantle). 2003;15:441–6.

    Article  Google Scholar 

  43. Jensen MP, Chen C, Brugger AM. Postsurgical pain outcome assessment. Pain. 2002;99:101–9.

    Article  PubMed  Google Scholar 

  44. Kelly AM. Does the clinically significant difference in visual analog scale pain scores vary with gender, age, or cause of pain? Acad Emerg Med. 1998;5:1086–90.

    Article  CAS  PubMed  Google Scholar 

  45. Kelly AM. The minimum clinically significant difference in visual analogue scale pain score does not differ with severity of pain. Emerg Med. 2001;18:205–7.

    CAS  Google Scholar 

  46. Kelly AM. Setting the benchmark for research in the management of acute pain in emergency departments. Emerg Med. 2001;13:57–60.

    Article  CAS  Google Scholar 

  47. Kendrick DB, Strout TD. The minimum clinically significant difference in patient-assigned numeric scores for pain. Am J Emerg Med. 2005;23:828–32.

  48. Mark M, Au T, Choi Y, Wong T. The minimum clinically significant difference in visual analogue scale pain score in a local emergency setting. Hong Kong J Emerg Med. 2009;16:233–6.

    Google Scholar 

  49. Martin WJ, Ashton-James C, Skorpil N, Heymans M, Forouzanfar T. What constitutes a clinically important pain reduction in patients after third molar surgery? Pain Res Manag. 2013;18:319–22.

    Article  PubMed  PubMed Central  Google Scholar 

  50. McConahay T, Bryson M, Bulloch B. Clinically significant changes in acute pain in a pediatric ED using the Color Analog Scale. Am J Emerg Med. 2007;25:739–42.

    Article  PubMed  Google Scholar 

  51. Mohan H, Ryan J, Whelan B, Wakai A. The end of the line? The Visual Analogue Scale and Verbal Numerical Rating Scale as pain assessment tools in the emergency department. Emerg Med J. 2010;27:372–5.

    Article  PubMed  Google Scholar 

  52. Myrvik MP, Brandow AM, Drendel AL, Yan K, Hoffmann RG, Panepinto JA. Clinically meaningful measurement of pain in children with sickle cell disease. Pediatr Blood Cancer. 2013;60:1689–95.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Powell CV, Kelly AM, Williams A. Determining the minimum clinically significant difference in visual analog pain score for children. Ann Emerg Med. 2001;37:28–31.

    Article  CAS  PubMed  Google Scholar 

  54. Sloman R, Wruble AW, Rosen G, Rom M. Determination of clinically meaningful levels of pain reduction in patients experiencing acute postoperative pain. Pain Manag Nurs. 2006;7:153–8.

    Article  PubMed  Google Scholar 

  55. Stahmer SA, Shofer FS, Marino A, Shepherd S, Abbuhl S. Do quantitative changes in pain intensity correlate with pain relief and satisfaction? Acad Emerg Med. 1998;5:851–7.

    Article  CAS  PubMed  Google Scholar 

  56. Todd KH, Funk JP. The minimum clinically important difference in physician-assigned visual analog pain scores. Acad Emerg Med. 1996;3:142–6.

    Article  CAS  PubMed  Google Scholar 

  57. Tsze DS, Hirschfeld G, von Baeyer CL, Bulloch B, Dayan PS. Clinically significant differences in acute pain measured on self-report pain scales in children. Acad Emerg Med. 2015;22:415–22.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Tubach F, Dougados M, Falissard B, Baron G, Logeart I, Ravaud P. Feeling good rather than feeling better matters more to patients. Arthritis Rheum. 2006;55:526–30.

    Article  PubMed  Google Scholar 

  59. Voepel-Lewis T, Burke CN, Jeffreys N, Malviya S, Tait AR. Do 0-10 numeric rating scores translate into clinically meaningful pain measures for children? Anesth Analg. 2011;112:415–21.

    Article  PubMed  Google Scholar 

  60. Guyatt GH, Townsend M, Keller JL, Singer J. Should study subjects see their previous responses: data from a randomized control trial. J Clin Epidemiol. 1989;42:913–20.

    Article  CAS  PubMed  Google Scholar 

  61. Doganay Erdogan B, Leung YY, Pohl C, Tennant A, Conaghan PG. Minimal clinically important difference as applied in rheumatology: an OMERACT Rasch Working Group systematic review and critique. J Rheumatol. 2016;43:194–202.

    Article  PubMed  Google Scholar 

  62. Wyrwich KW, Metz SM, Kroenke K, Tierney WM, Babu AN, Wolinsky FD. Triangulating patient and clinician perspectives on clinically important differences in health-related quality of life among patients with heart disease. Health Serv Res. 2007;42(6 Pt 1):2257–74. discussion 2294–323.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Terwee CB, Roorda LD, Dekker J, Bierma-Zeinstra SM, Peat G, Jordan KP, et al. Mind the MIC: large variation among populations and methods. J Clin Epidemiol. 2010;63:524–34.

    Article  PubMed  Google Scholar 

  64. Gatchel RJ, Mayer TG. Testing minimal clinically important difference: consensus or conundrum? Spine J. 2010;10:321–7.

    Article  PubMed  Google Scholar 

  65. Glassman SD, Carreon L, Dimar JR. Outcome of lumbar arthrodesis in patients sixty-five years of age or older. Surgical technique. J Bone Joint Surg Am. 2010;92 Suppl 1 Pt 1:77–84.

  66. Hageman WJ, Arrindell WA. Establishing clinically significant change: increment of precision and the distinction between individual and group level of analysis. Behav Res Ther. 1999;37:1169–93.

    Article  CAS  PubMed  Google Scholar 

  67. Beaton DE, Bombardier C, Katz JN, Wright JG, Wells G, Boers M, et al. Looking for important change/differences in studies of responsiveness. OMERACT MCID Working Group. Outcome Measures in Rheumatology. Minimal Clinically Important Difference. J Rheumatol. 2001;28:400–5.

  68. Copay AG, Subach BR, Glassman SD, Polly Jr DW, Schuler TC. Understanding the minimum clinically important difference: a review of concepts and methods. Spine J. 2007;7:541–6.

    Article  PubMed  Google Scholar 

  69. Rouquette A, Blanchin M, Sébille V, Guillemin F, Côté SM, Falissard B, et al. The minimal clinically important difference determined using item response theory models: an attempt to solve the issue of the association with baseline score. J Clin Epidemiol. 2014;67(4):433–40.

    Article  PubMed  Google Scholar 

  70. Revicki D, Hays RD, Cella D, Sloan J. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. J Clin Epidemiol. 2008;61:102–9.

    Article  PubMed  Google Scholar 

  71. Mercadante S, Adile C, Torta R, Varetto A, Fulfaro F, Giarratano A, et al. Meaningful cut-off pain intensity for breakthrough pain changes in advanced cancer patients. Curr Med Res Opin. 2013;29:93–7.

    Article  CAS  PubMed  Google Scholar 

  72. Tubach F, Ravaud P, Baron G, Falissard B, Logeart I, Bellamy N, et al. Evaluation of clinically relevant states in patient reported outcomes in knee and hip osteoarthritis: the patient acceptable symptom state. Ann Rheum Dis. 2005;64:34–7.

    Article  CAS  PubMed  Google Scholar 

  73. Moore RA, Straube S, Aldington D. Pain measures and cut-offs - “no worse than mild pain” as a simple, universal outcome. Anaesthesia. 2013;68:400–12.

    Article  CAS  PubMed  Google Scholar 

  74. Ferreira ML, Herbert RD, Ferreira PH, Latimer J, Ostelo RW, Grotle M, et al. The smallest worthwhile effect of nonsteroidal anti-inflammatory drugs and physiotherapy for chronic low back pain: a benefit-harm trade-off study. J Clin Epidemiol. 2013;66:1397–404.

    Article  PubMed  Google Scholar 

  75. Ferreira ML, Ferreira PH, Herbert RD, Latimer J. People with low back pain typically need to feel “much better” to consider intervention worthwhile: an observational study. Aust J Physiother. 2009;55:123–7.

    Article  PubMed  Google Scholar 

  76. Barrett B. Sufficiently important difference: concepts, caveats, and challenges. Med Decis Mak. 2013;33:869–74.

    Article  Google Scholar 

  77. Carragee EJ. The rise and fall of the “minimum clinically important difference”. Spine J. 2010;10:283–4.

    Article  PubMed  Google Scholar 

  78. Ruyssen-Witrand A, Tubach F, Ravaud P. Systematic review reveals heterogeneity in definition of a clinically relevant difference in pain. J Clin Epidemiol. 2011;64:463–70.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank the following authors for sharing unpublished data with us: Individual patient data: Polly Bijur, Albert Einstein College of Medicine, Bronx, NY; Anna Holdgate, Liverpool Hospital; Helen Mohan, UCD School of Medicine and Medical Science, Belfield, Dublin; and Yu Fai Choi, Pamela Youde Nethersole Eastern Hospital, Hong Kong. Additional data: John Farrar, Center for Clinical Epidemiology and Biostatistics, University of Pennsylvania; Blake Bulloch, University of Arizona College of Medicine, Phoenix; Knox H Todd, University of Texas MD Anderson Cancer Center; and Terri Voepel-Lewis, Department of Anesthesiology, University of Michigan.

Funding

The study was funded by the Nordic Cochrane Centre.

Availability of data and materials

The dataset analysed during the current study is available from the corresponding author upon request. The review protocol has been submitted to BMC Medicine and can be obtained from the corresponding author upon request.

Authors’ contributions

AH, BT and MFO conceptualised the study. MFO, EB, MDH, NEL and BT contributed to the acquisition of data. Data was analysed by MFO with the assistance of JH. MFO, JH and AH contributed to the interpretation of results. MFO drafted the manuscript, all co-authors contributed to reviewing the manuscript. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

No ethics committee approval was needed for this systematic review.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Asbjørn Hróbjartsson.

Appendices

Appendix 1

Search strategy

Last search conducted August 2016:

PubMed: (Minimal OR minimally OR minimum OR “clinically significant” OR “clinically important” OR “clinically meaningful” OR “clinically relevant” [Title/Abstract]) AND (Difference OR change OR relief OR reduction [Title/Abstract]) AND ((“Pain Measurement*” OR “Visual Analog Scale”[MeSH Terms]) OR (“numeric rating scale” [Title/abstract])) AND (Pain [MeSH Terms] AND pain [Title]) OR ((correlation AND change AND “visual analog scale” AND “pain relief”[Title]) OR (“minimum clinically significant change” AND pain) OR (“pain intensity ratings” AND “change scores”) OR (“pain assessment tools” AND “acute pain”) OR (“changes in pain intensity correlate with pain relief”) OR (“minimally important difference” AND “pain measurement”) OR (“Minimally important change” AND pain) OR (“minimum clinically important difference” AND pain) OR (“meaningful change” AND pain [title]) OR (“assessing change” AND pain [title]) OR (“minimum clinically important difference” AND “patient-reported outcome”) OR (“detect changes” AND “pain intensity”)).

Filters: Humans

EMBASE: ((Minimal or minimally or minimum or clinically significant or clinically important or clinically meaningful or clinically relevant).ti. or (Minimal or minimally or minimum or clinically significant or clinically important or clinically meaningful or clinically relevant).ab. or (Minimal or minimally or minimum or clinically significant or clinically important or clinically meaningful or clinically relevant).kw.) AND ((Difference or change or relief or reduction).ti. or (Difference or change or relief or reduction).ab. or (Difference or change or relief or reduction).kw.) AND ((exp pain assessment/) OR (exp visual analog scale/) OR (exp rating scale/)) AND exp pain/dm, dt, ep, th [Disease Management, Drug Therapy, Epidemiology, Therapy].

Limit to human, Limit to exclude MEDLINE journals

Cochrane Library: (Minimal OR minimally OR minimum OR “clinically significant” OR “clinically important” OR “clinically meaningful” OR “clinically relevant”:ti,ab,kw in Cochrane Reviews (Reviews and Protocols), Other Reviews, Trials and Methods Studies) AND (Difference OR change OR relief OR reduction:ti,ab,kw in Cochrane Reviews (Reviews and Protocols), Other Reviews, Trials and Methods Studies) AND (“Pain Measurement” OR “Visual Analog Scale” OR “numeric rating scale”:ti,ab,kw in Cochrane Reviews (Reviews and Protocols), Other Reviews, Trials and Methods Studies) AND (Pain:ti in Cochrane Reviews (Reviews and Protocols), Other Reviews, Trials and Methods Studies) (Word variations have been searched).

Appendix 2

Data extraction

Descriptive data

For each study we extracted the following data: Publication year, study design, setting, type of intervention, sample size, sex, age and clinical condition of patients, pain level at baseline, type of pain scale (VAS, NRS or other) and scale dimensions, type of anchor including wording of the transition question, concept (e.g. perception of pain relief, overall status or treatment effect), directionality (one- or two-sided), number of discriminating subcategories, wording of items used to obtain minimal clinically important difference, method of data collection including follow-up time, number of follow-up measurements per participant, whether analysis was adjusted for dependency between measurements and applied method, sampling method (e.g. consecutive, random or convenience), attrition rate, and information about any subgroup analysis that had been undertaken in the studies.

Outcome data

For studies assessing clinically important differences using the mean difference approach, we extracted the following outcomes as mean change scores with corresponding standard error or, if unavailable, other measures of variation such as standard deviation or 95% confidence interval:

  • The minimal clinically important difference for pain relief (mean absolute and relative change)

  • The substantial clinically important difference for pain relief (mean absolute and relative change)

  • The minimal clinically important difference for pain worsening (mean absolute and relative change)

  • The substantial clinically important difference for pain relief (mean absolute and relative change)

For studies assessing clinically important differences using the threshold approach, we extracted information about the definition of responders (patients with relevant pain relief) and non-responders and the cut-off point that differentiated between them with its corresponding sensitivity and specificity.

Appendix 3

Table 5 Relationship between baseline pain and the minimum clinically important differencea

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Olsen, M.F., Bjerre, E., Hansen, M.D. et al. Pain relief that matters to patients: systematic review of empirical studies assessing the minimum clinically important difference in acute pain. BMC Med 15, 35 (2017). https://0-doi-org.brum.beds.ac.uk/10.1186/s12916-016-0775-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12916-016-0775-3

Keywords