Are you sure that’s impaired? The swallowing norms you’re using might not be as meaningful as you think.
Imagine this: you hear about a new test of an Important Swallow Measure and check out the article for its normative data. You see this table:
The next day, you try out the test and your 25-year-old patient scores 1.57 seconds.
Is their Important Swallow Measure within normal limits?
Hold that thought while we consider what within normal limits even means.
Whenever we make a clinical judgement, we’re doing some kind of assessment of whether the patient’s behavior is normal, functional, or disordered. Often, we collect quantitative data from our patients and then want to see how their performance compares with “normal limits.” To define those limits, we typically ask: What are the lower and upper values that include the vast majority (commonly 95%) of the results from a healthy sample?
In some areas of our field, finding these values might be relatively straightforward, like a score on a published norm-referenced cognitive assessment. But a lot of the normative data for up-and-coming quantitative measures of swallow function are coming straight from research articles that aren’t trying to provide a normal range (like this one). These articles might look like they present the data we want—even when they don’t. So we need to be careful not to accidentally use the wrong values to make clinical judgements, just because they are the only values available.
There are a number of appropriate ways to define a normal range. For example, we might use +/- 2 standard deviations (SD) from the mean to capture ~95% of the normal values (if we know the data is normally distributed). Or, we could define normal limits based on percentiles (especially if the data is skewed). For example, 90% of US women’s heights fall between the 5th percentile of 4’11” and the 95th percentile of 5’8” . If you don’t remember much about SD and percentiles, don’t worry. Just know that these are both meaningful ways to describe a range within which most of the values fall. And, therefore, they are good measures to use when defining normal limits or thresholds.
Now let’s go back to that table. Is your 25-year-old patient’s score of 1.57s within the normal range?
Based on this table alone, we don’t know. All we’re given is the mean and the 95% confidence interval (CI) around the mean. 
So, what is a CI around the mean? The CI of a mean is a measure of how precisely we estimated the mean. Oversimplified, there is a 95% chance that a particular 95% CI includes the true population mean. For example, if we took a survey of women’s heights, we might find a mean of 5’3” and a 95% CI of 5’2”–5’4”. This tells us that the true average height among all women is highly likely to be between 5’2” and 5’4”. (If you want to learn more about CIs, here is a less technical explanation or here is a more technical one.)
There’s three important points to take away about a 95% CI:
By now, you’ve probably gotten the point that we shouldn’t use CI values to inform clinical decisions. But if you’ve ever looked at CIs in a table or forest plot and thought they were values of a normal range, you wouldn’t be the first. It’s a common mistake. So before you use “healthy reference ranges” for quantitative swallowing measures (even if you see them used in a peer-reviewed article) check that those values are based on SD or percentiles, and not CIs. The source of those normative values should make this information clear—it’s even sometimes in the abstract.
We’re all trying to do best by our patients. When we incorporate more standardized, quantitative data on swallowing into clinical practice, we’re typically spending extra time in the hopes of making more accurate judgements. So let’s make sure that we are using meaningful normal ranges and interpreting our data appropriately. Because no one wants to be accidentally labeling normal swallow function as impaired.
By: Stephanie Muñoz, MS, CCC-SLP
With: Natalie Douglas, PhD, CCC-SLP
 Fryar, C.D., Carroll, M.D., Gu, Q., Afful, J., & Ogden, C. (2021) Anthropometric reference data for children and adults: United States, 2015-2018. Vital Health Stat. https://www.cdc.gov/nchs/data/series/sr_03/sr03-046-508.pdf
 Technically, you could calculate a SD from a CI if you know the sample size and that the data is normally distributed. But some swallowing measures are skewed and journal articles with normative values do not always indicate whether the findings are normally distributed. See here for more details.
members of The Informed SLP
Blog posts by title:
In a fog: Five facts + twelve clinical takeaways about chemo brain
#AmIQualified: Let’s talk about bilingualism and white supremacy in CSD, one layer at a time
#AmIQualified: Let’s talk about privilege in speech–language pathology
#AmIQualified: Let’s talk about moving from cultural competence to cultural humility
The Not-New Speech Norms Part 2: An American Tale
Motivational interviewing and behavioral change in clinical practice
Standardized language tests: That score might not mean what you think it means
The grammar guide you never knew you always wanted
Top 12 questions about ASHA CEUs—answered
Schools, safety, SLPs, and the evidence
Response to #BlackLivesMatter, 2020
COVID-19 and Dysphagia: Considerations for the Medical SLP
COVID-19 and Cognition: Impact for the Medical SLP
Looking for evidence on telepractice for SLPs?
"I don't get what the difference is between ASHA's Evidence Maps, speechBITE, and The Informed SLP..."
SLPD vs. PhD: What's the difference?
That one time a journal article on speech sounds broke the SLP internet
The difference between respecting our science and loving our science
What does the evidence show about treatment intensity?
EBP as a blame game
The EBP barrier nobody is talking about
Guest post: On evidence analysis
Guest post: On trauma and language development
Guest post: Working memory, processing speed, and language disorder
Guest post: Push-in services—how to collaborate!
Guest post: Complexity approach for speech sound disorders
How am I supposed to find time to read research?!?
SLPs: How to make sure you're using EBP
SLPs: How to get access to full journal articles