Screening Questionnaires for Obstructive Sleep Apnea: An Updated Systematic Review

Obstructive sleep apnea (OSA) is the most common sleep-related breathing disorder and is associated with significant morbidity. We sought to present an updated systematic review of the literature on the accuracy of screening questionnaires for OSA against polysomnography (PSG) as the reference test. Using the main databases (including Medline, Cochrane Database of Systematic Reviews and Scopus) we used a combination of relevant keywords to filter studies published between January 2010 and April 2017. Population-based studies evaluating the accuracy of screening questionnaires for OSA against PSG were included in the review. Thirty-nine studies comprising 18 068 subjects were included. Four screening questionnaires for OSA had been validated in selected studies including the Berlin questionnaire (BQ), STOP-Bang Questionnaire (SBQ), STOP Questionnaire (SQ), and Epworth Sleepiness Scale (ESS). The sensitivity of SBQ in detecting mild (apnea-hypopnea index (AHI) ≥ 5 events/hour) and severe (AHI ≥ 30 events/hour) OSA was higher compared to other screening questionnaires (range from 81.08% to 97.55% and 69.2% to 98.7%, respectively). However, SQ had the highest sensitivity in predicting moderate OSA (AHI ≥ 15 events/hour; range = 41.3% to 100%). SQ and SBQ are reliable tools for screening OSA among sleep clinic patients. Although further validation studies on the screening abilities of these questionnaires on general populations are required.

Keywords: Obstructive Sleep Apnea, Surveys and Questionnaires, Validation, Sensitivity

Introduction

Obstructive sleep apnea (OSA) is the most common sleep breathing disorder and manifests as repeated apneas and hypopneas during sleep. 1-3 OSA increases the risk of hypertension, glucose intolerance, cardiovascular, and cerebrovascular disorders. 4-7 Untreated OSA is also associated with daytime sleepiness, cognitive dysfunction, and increased risk of automobile accidents. 8-10 Polysomnography (PSG) is the gold standard for the diagnosis of OSA, but it is an expensive and time-consuming and requires trained personnel. PSG is a noninvasive technique that involves overnight monitoring of several physiological variables including electroencephalography, eye movements, and muscle tone as well as respiratory effort, airflow, and oxygen saturation. 11 Therefore, different clinical models have been developed to evaluate patients at high risk for OSA. 12-14 Screening questionnaires are simple, low-cost tools that can be used to prioritize patients eligible for PSG.

OSA screening questionnaires (OSA-SQs) were evaluated in surgical patients in a systematic review by Abrishami et al. 15 In addition to being easy-to-use, the STOP and STOP-Bang questionnaires were found to have a higher methodological quality. Over the past few years, the accuracy of OSA-SQs has been an area of growing research interest and a number of studies have been published on the subject. This systematic review aimed to assess the accuracy of OSA-SQs including the Berlin questionnaire (BQ), STOP-Bang questionnaire (SBQ), STOP questionnaire (SQ), and Epworth Sleepiness Scale (ESS), based on an updated search of the literature.

We performed a literature search using Medline, Cochrane Database of Systematic Reviews, and Scopus for articles published between January 2010 and April 2017 using the following terms: OSA or OSAHS (obstructive sleep apnea hypopnea syndrome), hypopnea or hypopnoea, obstructive sleep apnea or sleep apnea syndrome and sensitivity, specificity, validity, or validation, sleep apnea questionnaires, and screening sleep apnea. The reference list of identified studies was also searched manually to detect eligible studies for inclusion. The flow diagram of study selection process is depicted in Figure 1 .

An external file that holds a picture, illustration, etc. Object name is OMJ-D-17-00145-f1.jpg

Flow diagram of study selection.

Two authors independently reviewed the titles and abstracts of the search results and disagreements were solved in group discussion. The studies had to meet the following criteria to be included: a) participant age > 18 years; b) the accuracy of the screening questionnaire had been assessed against various apnea-hypopnea indexes (AHI) or respiratory disturbance indexes (RDI) based on PSG as the gold standard; and c) studies were published in English. We also included studies if the validity of screening questionnaires was reported as a secondary outcome. Letters to the editor, review articles, case reports, and commentaries were excluded.

Two independent reviewers extracted the following information from each study that met the inclusion criteria: name of the first author, country and year of publication, study design, number of participants, age, gender, body mass index (BMI), neck circumference, validation tool (various types of PSG included), sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for each AHI or RDI cut-off point including, AHI or RDI of ≥ 5 events/hour (mild OSA), ≥ 15 events/hour (moderate OSA), and ≥ 30 events/hour (severe OSA).

Thirty-nine studies qualified for inclusion in the present review, 11,16-54 with sample sizes ranging from 30 to 4770. These studies were carried out in seven different geographic regions including, North America, 17,18,20,22,27,38,47,50,52 West Asia, 11,16,24,29,30,42,51,53 East Asia, 25,26,28,32,36,49,54 Europe, 19,31,37,39,43,45,46 South Asia, 40,48 North Africa, 21,44 and South America. 23,33-35 The results of our analysis of the relevant studies are presented below for each of the four OSA-SQs.

Berlin questionnaire (BQ)

Table 1

Overview of studies included looking at the accuracy of screening questionnaires for obstructive sleep apnea against polysomnography (PSG) as the reference test.

StudyNo. of patientsPatient typeAge, yearsMale, %Body mass index, kg/m 2 Validation tool
Ong et al. 2010 36 314Sleep clinic patients46.8 ± 1570.527.9 ± 6Lab PSG
Sagaspe et al. 2010 43 123Sleep clinic patients47 ± 13.267.5-Lab PSG
Gantner et al. 2010 25 143Patients with high cardiovascular risk62.2 ± 7.65826.6 ± 3.7Level II PSG
Silva et al. 2011 47 4770General population62.4 ± 10.351.5-Level II PSG
Saleh et al. 2011 44 100Sleep clinic patients45.63 ± 9.675136.34 ± 10.70Lab PSG
Srijithesh et al. 2011 48 121Acute stroke patients56.5 -Lab PSG
Sforza et al. 2011 46 643General population65.6 ± 0.0340.9025.3 ± 0.2Level III PSG
Enciso et al. 2011 22 84Dental clinic patients54.93 ± 12.6377.3826.60 ± 3.74Two-night ambulatory somnography
Thurtell et al. 2011 50 30Patients with idiopathic intracranial hypertension32 ± 6.32024.4 ± 4.1Lab PSG
Martinez et al. 2012 34 57Patients with angina complaints54 ± 6.94623 ± 11Level III PSG
Hesselbacher et al. 2012 27 1897Sleep clinic patients53.84 ± 1557.5635.42 ± 5Lab PSG
El-Seyed et al. 2012 21 234Sleep clinic patients50.38 ± 11.2958.537.77 ± 9.54Lab PSG
Firat et al. 2012 24 85Bus drivers-10029.1 ± 3.8Daytime PSG
Amra et al. 2013 11 157Sleep clinic patients52.3 ± 13.655.431.5 ± 6Lab PSG
Bouloukaki et al. 2013 19 189Clinic outpatients47 ± 1361.935.0 ± 25.1Lab PSG
Kang et al. 2013 28 1305General population52.78 ± 16.5547.722.81 ± 4.86Lab PSG
Best et al. 2013 17 82Patients with treatment resistant depression47.1 ± 926.8333.34 ± 8.6Level II PSG
Yunus et al. 2013 54 150Clinic outpatients44.7 ± 11.56436.3 ± 11.2Lab PSG
Boynton et al. 2013 20 219Sleep clinic patients46.3 ± 13.944.833.43 ± 8.76Lab PSG
Pereira et al. 2013 38 128Sleep clinic patients50 ± 12.365.6231 ± 6.6Lab PSG
Scarlata et al. 2013 45 254Clinic outpatients65.8 ± 12.168.638.5 ± 7.7Lab PSG
Vana et al. 2013 52 47Sleep clinic patients46.4 ± 13.23436.3 ± 9.2Lab PSG
Pataka et al. 2014 37 1853Sleep clinic patients52 ± 1474.4232.8 ± 7Lab PSG
Karakoc et al. 2014 29 217Surgical population42.5 ± 10.78828.10 ± 4.1Lab PSG
Margallo et al. 2014 33 422Patients with resistant hypertension62.4 ± 9.93131.2 ± 5.7Lab PSG
Ha et al. 2014 26 141Sleep clinic patients44.82 ± 1281.625.33 ± 5Lab PSG
Ulasli et al. 2014 51 1450Sleep clinic patients50 ± 9.8362.9631.25 ± 9.09Lab PSG
Kim et al. 2015 32 592Sleep clinic patients47.8 ± 12.783.524.7 ± 3.5Lab PSG
Alhouqani et al. 2015 16 193Sleep clinic patients42.87 ± 11.8377.734.90 ± 8.60Lab PSG
Sadeghniiat-Haghighi et al. 2015 42 603Sleep clinic patients45.8 ± 12.774.829.18 ± 5.9Lab PSG
Yuceege et al. 2015 53 433Sleep clinic patients47.5 ± 10.565.8231.1 ± 5.6Lab PSG
Nunes et al. 2015 35 40Coronary artery bypass grafting patients56 ± 77330 ± 4Lab PSG
Nunes et al. 2015 35 41Abdominal surgery patients56 ± 86829 ± 5Lab PSG
Faria et al. 2015 23 91Patients with chronic obstructive pulmonary disease69.4 ± 9.663.723.6 ± 3.9Lab PSG
Popevic et al. 2016 39 100Commercial drivers43.4 ± 10.710029.0 ± 5.7Lab PSG
Khaledi-Paveh et al. 2016 30 100Sleep clinic patients45.66 ± 11.836029.5 ± 6.1Lab PSG
Kicinski et al. 2016 31 123Sleep clinic patients54.6 ± 11.166.4033.5 ± 5.2Lab PSG
Tan et al. 2016 49 242General population48.3 ± 1450.426.2 ± 5Level 3 PSG
Bhat et al. 2016 18 85Sleep clinic patients50.5 ± 12.670.632 ± 1.55Lab PSG/Level III PSG
Prasad et al. 2017 40 210Sleep clinic patients46.5 ± 13.772.931.9 ± 7.4Lab PSG

Table 2 shows the BQ data for the sensitivity, specificity, PPV, and NPV for one or more AHI cut-off points as reported in the selected studies. The BQ highest sensitivity (97.3%) and NPV (95.4%) for the detection of OSA was found at AHI cutoffs ≥ 30 events/hour. However, the BQ had the highest detection specificity for moderate OSA (91.7%). Our analysis indicates a PPV ranging from 11.5% to 91% at AHI ≥ 5 events/hour.

Table 2

Predictive parameters of the screening questionnaires.
StudyAHI ≥ 5AHI ≥ 15AHI ≥ 30
Sensitivity %Specificity
%
PPV %NPV %Sensitivity
%
Specificity
%
PPV %NPV %Sensitivity
%
Specificity %PPV %NPV %
Berlin
Sagaspe et al. 2010 43 727363 766143 715316
Gantner et al. 2010 25 ----8935765892264981
Saleh et al. 2011 44 97909693--------
Srijithesh et al. 2011 48 68.258.868.258.8--------
Sforza et al. 2011 46 ----76.6939.3463.1755.44----
Enciso et al. 2011 22 ----67.954.87250----
Thurtell et al. 2011 50 83.358.37570--------
Martinez et al. 2012 34 ----72505370----
El-Seyed et al. 2012 21 95.072592.7933.3395.487.4187.112097.310.7174.2360
Firat et al. 2012 24 ----45.684.677.156.8----
Amra et al. 2013 11 84.061.596.025.887.936.775.358.087.826.551.570.9
Bouloukaki et al. 2013 19 764094128461865279398036
Kang et al. 2013 28 6983--8963------
Best et al. 2013 17 25.085.456.560.024.591.735.593.3----
Yunus et al. 2013 54 92179729--------
Pereira et al. 2013 38 862591.715.8912873.457.9891845.968.4
Pataka et al. 2014 37 71.817.211.580.2781816.580.49028.55674
Karakoc et al. 2014 29 83.422.276.430.889.322.642.176.9----
Margallo et al. 2014 33 684685246940585076403977
Ha et al. 2014 26 7530.2983.1728.217532.1462.3846.1580.3932.5840.5974.36
Ulasli et al. 2014 51 73.144.5--76.439.5--80.335.3--
Kim et al. 2015 32 71.532.084.318.075.535.462.150.6----
Yuceege et al. 2015 53 ----84.231.748.763.4----
Nunes et al. 2015 35 ----67265042----
Nunes et al. 2015 35 ----82626183----
Faria et al. 2015 23 4068.42581.2--------
Popevic et al. 2016 39 50.986.082.956.978.377.951.492.37570.425.795.4
Khaledi-Paveh et al. 2016 30 77.323.1682258.545.7--30.880--
Kicinski et al. 2016 31 ----93.1016.201.1142----
Prasad et al. 2017 40 33.539.1834087.537.872.162.289.432.156.475.6
STOP-Bang
Ong et al. 2010 36 84.752.684.453.291.140.460.881.395.435.043.593.5
Silva et al. 2011 47 ----8743.3--70.459.5
El-Seyed et al. 2012 21 97.5526.3293.435097.743.786.932098.655.3673.3760
Firat et al. 2012 24 ----8748.766.676----
Boynton et al. 2013 20 82.248.084.244.493.240.558.287.096.833.136.496.3
Pereira et al. 2013 38 904293.729.4932873.964.7962148.688.2
Pataka et al. 2014 37 904.912.276.8945.5178498.79.952.788.4
Ha et al. 2014 26 81.0857.1488.2443.2485.7145.4570.5967.5786.2734.0943.1481.08
Alhouqani et al. 2015 16 90.2431.0388.1036.0096.7530.0070.8384.0097.7021.7050.6092.00
Kim et al. 2015 32 97.018.685.954.698.010.660.678.8----
Sadeghniiat-Haghighi et al. 2015 42 91.645.278.271.697.135.256.993.39829.441.896.6
Tan et al. 2016 49 ----66.274.750.685.069.267.120.294.8
Prasad et al. 2017 40 8943.584.952.693.439.273.876.396.232.158.189.5
STOP
Silva et al. 2011 47 ----6256.3--68.859.5--
El-Seyed et al. 2012 21 91.672592.5722.7394.3525.9389.341.1895.9519.6472.5564.71
Firat et al. 2012 24 ----41.392.386.457.1----
Boynton et al. 2013 20 74.634.079.228.380.634.552.266.783.931.832.783.3
Pataka et al. 2014 37 91.76.412.88492.76.617.372971152.378.4
Ha et al. 2014 26 74.7750.0085.5733.3376.1940.0065.9852.3880.3936.3642.2776.19
Sadeghniiat-Haghighi et al. 2015 42 86.346.581.954.891.137.161.57994.130.740.291.1
Nunes et al. 2015 35 ----100554100----
Nunes et al. 2015 35 ----88134260----
Prasad et al. 2017 40 87.843.584.75091.939.273.572.595.23358.287.5
Epworth Sleepiness Scale
Silva et al. 2011 47 ----3971.4 46.170.4--
Hesselbacher et al. 2012 27 ----54576447----
El-Seyed et al. 2012 21 72.557596.7321.1375.7148.1590.5423.2379.7346.4379.7346.43
Scarlata et al. 2013 45 ------------
Vana et al. 2013 52 31.353.358.826.7--------
Pataka et al. 2014 37 33.350.69.183.644.552.117815762.45960
Ulasli et al. 2014 51 46.960--49.961.1--52.858.2--
Faria et al. 2015 23 6073.737.587.5--------
Kicinski et al. 2016 31 ----53.2058.801.9079----
Bhat et al. 2016 18 ----46.265.27534.9----
Prasad et al. 2017 40 55.567.485.929.859.666.276.447.166.465.165.166.4

AHI: apnea-hypopnea index; PPV: positive predictive value; NPV: negative predictive value.

STOP-Bang questionnaire (SBQ)

The SBQ includes four subjective (STOP: Snoring, tiredness, observed apnea, and high blood pressure) and four demographics items (BANG: BMI, 56 Age, Neck circumference, Gender). A score of 5–8 is categorized as high risk for OSA. 57

For the SBQ, we included 13 studies with a total 9584 subjects and sample sizes ranging from 85 to 4770. The studies mostly included sleep clinic patients with an age range of 42.8 to 62.4 years old [ Table 1 ]. Overnight laboratory PSG was used as the validation tool in 10 studies. 24,47,49 The highest sensitivity and NPV were reported at AHI thresholds of ≥ 30 events/hour. The PPV value ranged between 12.2% and 93.7% at AHI cutoffs ≥ 5 events/hour. The SBQ showed the highest specificity (74.7%) in detecting moderate OSA [ Table 2 ].

STOP Questionnaire (SQ)

The SQ is a concise and easy-to-use screening tool for OSA with high sensitivity. SQ can classify patients as being at high risk of having OSA if they answer yes to two or more questions. 57 SQ was evaluated in nine studies (8196 subjects) of which six studies were carried out on sleep clinic patients and three on the general, community population, 47 surgical patients, 35 and bus drivers. 24 The number of subjects in the studies varied from 40 to 4770 and the mean age was 44.8–62.4 years. Two studies used type II and daytime PSG for validation, 24,47 while the others used overnight laboratory PSG. Our review indicates that the SQ had the highest prediction sensitivity (100%), specificity (92.3%), and NPV (100%) in the case of moderate OSA, while in the case of mild OSA the PPV ranged from 12.8% to 92.5% [ Table 2 ].

Epworth Sleepiness Scale (ESS)

The ESS is an eight-item questionnaire to measure daytime sleepiness; it uses a four-point Likert response format (0–3), and the score ranges from 0 to 24. An ESS score ≥ 11 indicates excessive daytime sleepiness and high risk for OSA. 58 Eleven of the 39 studies investigated the accuracy of ESS with a total of 11 014 subjects. The sample size in the 11 studies ranged from 47 to 4770 with an average age between 46.4 and 69.4 years. Eight of the 11 studies were conducted on sleep clinic patients, while the remaining three studies were carried out on respiratory patients, 23 the general population, 47 and clinic outpatients. 45 The laboratory PSG was used by the majority of the reviewed studies [ Table 1 ]. The highest ESS sensitivity was observed at AHI ≥ 30 events/hour and ranged between 46.1% and 79.73%. However, the highest values for specificity (75%), NPV (87.5%), and PPV (96.7%) were found in mild OSA with a decreasing trend from mild to severe OSA [ Table 2 ].

Discussion

Sleep apnea is a common and potentially serious disorder in which breathing stops and repeatedly restarts during sleep. Hundreds of such breathing interruptions can occur over the course of a single night with each interruption lasting 10 to 20 seconds. Following each of the long apneic periods, the individual is jolted out of the normal sleep phase - the sleep rhythm is disrupted and the individual suffers from fatigue and daytime sleepiness. Other indicative signs of serious sleep apnea include long apneic periods (> 15 seconds), loud snoring, choking or gasping during sleep, irritability, headache, depression, and nightmares. If untreated, sleep apnea can lead to serious disorders including obesity, diabetes, hypertension, and stroke. There are three main types of sleep apnea depending on their cause. The most common variety is OSA, which results from upper airway obstruction because of hypotonia and collapse of the posterior pharyngeal muscles. OSA is characterized by cyclic loud snoring, which is a common problem in obese individuals and patients with endocrine disorders such as hypothyroidism and acromegaly. A common cause of OSA in children is hypertrophy of the tonsils and/or the adenoids. Central sleep apnea results from the reduced central respiratory drive. Complex sleep apnea is a combination of both obstructive and central apneas. 59

In light of the profound impact of OSA on the health and quality of life, 5,18,40 it is essential that patients are adequately screened to receive the necessary medical care. It is estimated that over 80% of people with moderate to severe OSA remain undiagnosed. 60 Thus, a screening tool is necessary to stratify patients based on their clinical symptoms and anthropometric risk factors.

Some easy-to-use questionnaires have been developed as low-cost alternatives to PSG for detecting OSA. In this review, we assessed the accuracy of four self-reported OSA-SQs against PSG as the reference test. The SBQ had the highest sensitivity for the prediction of mild and severe OSA (97.55% and 98.7%, respectively). However, the BQ showed the highest specificity for the detection of mild and severe OSA (90% and 80%, respectively). Compared to other questionnaires, the SQ had the highest sensitivity (100%) and specificity (92.3%) for predicting moderate OSA. The validity of our results for the general population may be questioned based on the fact that most of the subjects in the studies we reviewed were sleep clinic patients where the prevalence of OSA is relatively high. In addition, there is no standard definition of OSA unifying the various validation studies. Features of an appropriate screening questionnaire vary according to the population being surveyed. For example, cultural differences in urban and rural populations require the questionnaire is modified according to those being surveyed. However, it must be noted that it was not our objective of this review. Diagnosis of true positive OSA patients in a clinical setting using a questionnaire with high sensitivity minimizes negative health consequences and avoids unnecessary and costly diagnostic tests. PSG, the gold standard for OSA diagnosis, is an expensive and time-demanding procedure. Therefore, it is necessary to decrease the number of false-positive subjects in the general population using a screening tool with high specificity. An effective screening tool must also have a high sensitivity to minimize the number of false negatives.

There was no standard definition for OSA in various studies that investigated the validity of OSA screening questionnaires against PSG. A recent meta-analysis indicated that the BQ has a moderate sensitivity and specificity in the general population for detecting hypopnea defined as a 3% oxygen desaturation. However, its sensitivity decreased when the hypopnea definition of 4% oxygen desaturation was applied. 39 Based on these observations it is clear that the definition of OSA significantly affects the accuracy of validation studies.

Therefore, it is necessary to test the validity of various OSA-SQs in the general population against the reference standard PSG. Because sleep clinic patients constituted the majority of the subjects in the reviewed studies, it is not possible to extend our conclusions to the general population.

Conclusion

SBQ and SQ are appropriate screening tools to determine OSA in sleep clinic patients. Further validation studies designed specifically for the general population are necessary.

Disclosure

The authors declared no conflicts of interest. No funding was received for this study.