The Informed SLP: Speech Language Pathology Research
  • Home
  • What We Do
    • What is The Informed SLP?
    • Team
  • Members Login
    • Birth to Three
    • Preschool & School-Age
    • Adults
  • Blog
  • Join

That one time a journal article on speech sounds broke the SLP internet

12/30/2018

8 Comments

 
Picture
This is the story of when a journal article broke the SLP internet.
 
On accident.
 
Oops.
 
And it was kind of a good thing, and kind of a bad thing, and mostly just really confusing to everyone observing it.
 
So allow me to play out this series of events—trust me, it’s relevant to why someone would ask the question above!
This fall, McLeod and Crowe published this article. Here's a paraphrase of our review of the article:
"This study provides a cross-linguistic review of children’s acquisition of consonants in 27 languages. The authors reviewed 64 studies from 31 countries to inform practicing SLPs’ expectations of children’s speech sound development across languages… SLPs can use this information and the overall patterns of speech sound development to decide what is “typical” across languages and to inform their clinical decisions.”
Sounds great for SLPs working with non-English-speaking children, right? What a great cross-linguistic resource! And when we sent our review to the authors (that’s part of our internal audit process) they said Yep, yep, looks good! And we published it.
 
Then all hell broke loose. Not because of our review. But because the authors released infographics describing their data. Here’s the infographic set that put U.S.-based SLPs in a tizzy. 
 
Now, here’s what SLPs thought this was:
  • Oh, wow, “new” norms
  • Oh crap, this is going to explode my caseload!!?!
 
So! We have some things to talk about here. I’ll try to group them into question themes, below:
​

Are these new norms?

​
​No, man! They’re not! McLeod and Crowe’s norms data wasn’t new OR different from what’s been published for the last several decades. Instead, this article is basically a summary of previous developmental norms studies. Think about it like the authors grouped previous data together, and combined it all so you could view an average across studies. First, they asked—at what age do 90% of children produce the sound correctly? They grabbed that data from our field's best studies, and averaged it. The infographics represent the average age, across studies, at which 90% of kids produce the sound correctly (or 90% of productions are correct; see article for details). Cool? It may look weird because it's displayed with categories instead of bar graphs or some other version you've been used to seeing. But, frankly, if you’re going to use any study at all for age of acquisition, it should be this one! Because it's aggregated data.

Why are these norms so shocking to everyone?

Picture

​Well, first you have to ask the question, “What norms are SLPs using now? And how are they interpreting them?” 

Google “Speech Sound Development Chart” or “Speech Norms”. See the massive range of what SLPs have been looking at? See how different they look at face value?
 
And that’s the part of the problem, here: often times, SLPs will look at a norms chart and interpret the ages to mean “age at which a kid should qualify for therapy”. Don't do that! All the norms charts look a little different because they’re based on different studies with different methods of interpreting and displaying the data. Some show bar graphs with the range of mastery, from 50% to 90%. Some charts show the average age of mastery instead. Sometimes "mastery" is defined differently. Some charts collapse across word positions. Or clusters. Or isolated words vs conversation. The list goes on, and on, and on…
 
But, basically, the point is this: When you look across multiple reliable sources for age of consonant acquisition and mastery, they’re not very different at all. Sources like this and this align well with these “new” (not new!) norms charts.

Guys, the details matter. Other bloggers and scientists have talked about this before. You can’t read all these charts the same way! And when you are reading the charts, make sure you're interpreting them correctly! And, whatever you do, do not interpret bars like this to mean that it’s “normal” to not acquire the sounds until age 8. That’s not what that says. Students qualify for therapy well before the tail-end of that bar graph. 

(Further, qualification decisions just can’t be based on norms charts alone because too many other factors are at play (e.g. patterns of errors). For a deeper explanation on qualification and speech sound disorders, see #week31 in the Clinical Research for SLPs Facebook group).


Are these norms accurate?


​Yes. I know that's not necessarily what you wanted to hear. But, yes.
​

So what does that mean for my caseload? What am I supposed to do?!


​Yeah. That’s the yucky part, right!?
 
Because the chart itself isn’t really the point, is it? It’s not that the majority of SLPs don’t know how to read these charts. I think the majority of SLPs do know how to read these charts just fine. The problem is that they’re concerned with the general take-home message, and that is:
 
Nearly all speech sounds are typically acquired by age 6; many by age 4.
 
And when we start thinking about what this means for our caseloads, it basically means that we should have a LOT more kids in speech therapy in the late preschool and kindergarten years. It means that waiting to treat things like “r” until after 1st grade isn’t well-aligned with the evidence on when speech sounds are mastered.
 
And that stinks. Because we want to be doing what’s best for these kids. But we're facing barriers (workload, caseload, silly rules our SPED administrators put in place...). So this chart doesn’t feel good to SLPs, at all. This makes us feel:
 
Annoyed
Sad
Frustrated
Angry

 
And that’s the part that non-SLPs just couldn’t see. That's the part that "broke" the SLP internet.

But I can still use a “wait and see” approach for speech sound disorders, right?


​Well, I mean. <sigh> Look, here’s the thing:
 
To-date, many of us have used a “wait and see” approach with speech sound disorders. That’s how we keep our caseloads under control, right? And, of course, those silly scientists who say that “r” should be treated in kindergarten are completely out of touch with reality, right? Right?! Eh—maybe a little. Maybe a little in that it’s easy for them to forget the workload barriers SLPs face. So when publications “come at you” with statements advocating SLPs do something—like getting these kids in speech therapy sooner—it can be annoying because we feel like we have little control over the issue. And then suddenly we have a workload discussion on our hands, and who do we turn to for help with that? (For real: for those of you wanting to help SLPs, we could really use a “Workload Fairy”. Somebody start that business!)
 
Because, seriously​. Nobody’s treating “r” in Kindergarten without first making massive changes to how SLPs work in the schools. (And in the meantime, the private practice SLPs just take these kids. From parents who are able to pay. Which—thank goodness for the private practice SLPs—but what we’re looking for here is speech therapy even for families who CAN’T afford to send their child outside of school.)
 

And that’s why this issue is really frustrating for school-based SLPs! Because we feel like we have zero power to fix it, and we’ve been treating speech sound disorders with a “wait and see” approach for so long that the concept of treating early just feels really foreign.

So, Meredith—how do you feel about the fact that neither your team nor any of the scientists involved in the early interpretation and dissemination of this study accurately predicted how SLPs would feel about it?


​Now, for me, personally, this is the part that’s most fascinating. And disappointing. And sad, frustrating, etc.
 
First, my team is usually really good about interpreting research exactly the way an SLP would. Not picking out the parts that scientists care about, but picking out the parts that SLPs care about. But none of us caught that when we read this study. Probably because these aren’t new speech sound norms, and showing “new speech sound norms” wasn’t the point of the study, at all. So it just didn't cross our minds. (See quote block in first paragraph for what the "point" of the study was, or read here.)
 
But! That doesn't matter. What matters is how and if it impacts clinical practice. So I am disappointed that we didn’t catch this immediately with our review.
 
But watching how this all played out needs to be a lesson for all of us. Things I learned:

  1. Nobody sees science unless it’s shared. And shared the right way. With things like infographics. So BRAVO! to the scientists who did that, truly. They should be super proud that their study went viral.
  2. Dissemination needs to be done by people who deeply understand the audience (the audience of this study was SLPs). Otherwise you get clinicians saying things like, “That study is wrong!” Why? Because you have to be able to understand how your audience will interpret what you say. So there’s a lesson here for scientists and people who care about science communication: your perspective isn't enough. It's your audience's perspective that counts. And you have to spend a lot ​of time with your audience to get that right.
  3. Dissemination is ideally done by people with an audience. Now, here’s the part that’s really funny to me—those original infographics the scientists created? They’re quickly being replaced by copycat images, disseminated by people who know either, a) where to put these things so SLPs can actually find them, or b) already have a massive audience of SLPs (think—people who create products, like therapy materials, for SLPs). Don't believe me? Go Google “New Speech Sound Norms” or any other term you’d use to try to find those original infographics created. Can’t find them, can ya? But if you dig deep enough, you'll start to find other people’s images based off of the originals. (Or go search where you like! Pinterest? Instagram? Yep—a whole bunch of recreations of the originals, in just a few months’ time!) So what’s the lesson here? 1) Make sure to think about the location for dissemination. Will people be able to find it? 2) If you're a scientist, consider partnering with people who understand marketing. I’m a big advocate for more of our scientists partnering with people who have large SLP audiences. That’s a win–win for everyone.
  4. Dissemination needs to be done with bias in mind. Careful analysis of bias. So that we don’t screw it up! For example:
  • Our scientists may be biased by what’s “best”—as in, what minimizes adverse impact, what the best treatment case scenario is for our clients, regardless of what’s realistic (because they don’t operate in clinical reality on a daily basis). So, what's realistic, given our workload burdens as school-based SLPs? What's realistic, given that most SLPs know it’s far easier to treat tough sounds like “r” in slightly older kids because they are so much more self-aware? Sometimes it feels like our scientists are working under the assumption that tough sounds like “r” treated in Kindergarten is equivalent (equivalent in treatment intensity required to get success) to “r” treated later, when clinicians know that’s not the case. And, it's not that our scientists are wrong about sounds needing to be treated earlier. They're right. But they're often unaware of their biases and difference in perspective, and thus don't do a very good job of either communicating what needs done, or planning treatment studies in a way that directly addresses SLPs' concerns.
  • Our clinicians may be biased by what’s “easiest”—as in, requires them to jump through the fewest hurdles to get success. Clinicians also tend to be biased toward the way things have always been. Because it's a pain in the rear end to consider doing something differently! And it’s hard to imagine doing things entirely differently if you’ve found success (or perceived success) in your current path. Clinicians are also biased by the fact that we see more kids with disorders on a daily basis than typically-developing kids. So our *gut* for what's normal tends to be a little low.

So what now?


At this point, I think the next step that matters most is understanding what questions still linger in SLPs’ minds, and using our science to address those. I would predict it’d be things like:
  • Can I successfully treat tough sounds like “r” in Kindergarten? Or am I going to try, and fail, and waste a bunch of time?
  • What would the impact be on my caseload of bringing kids into speech therapy earlier? Could I make that work? If I'm in the schools, is this more likely to be an RTI thing? Regardless of what we call it: who out there has made it work, and how? I want to see what that looks like.
  • Say I choose to disregard this data and keep treating a little later. What is the risk of delaying treatment of speech sound disorders until kids are more mature (e.g. 2nd/3rd grade)? (Hint: Literacy is a huge one. Search #week9 here.)
 
Insert some comments, below, about what questions or concerns you have! Because, frankly, our science doesn’t matter much if it can’t be implemented. And successful implementation is where our focus needs to be now.
​
​

An addendum...

[Updated 1/24/2019] I was chatting with Marie Ireland, and she reminded me of something else that should be said as we're on this topic! Don’t forget that your place of employment may impact how you use information like this in the assessment process. In the U.S., for example:

  • School-based SLPs provide services to children with disabilities who otherwise can't make progress in the classroom. 
  • Private-practice SLPs provide services to children who may benefit from services.
 
Thus, a school-based SLP can’t use these norms alone to make eligibility decisions. Here’s what Marie had to say:
​
"When words like caseload and schools are used, we all need to remember that eligibility for special education—including speech services—has specific steps that have to be considered.

I worry that when we jump to discussions of when to start serving kids by age or sound error we miss the big picture
—the big difference between clinical services and educational identification as a child with a disability who qualifies for speech in schools.

Now of course, if you are not in schools then IDEA doesn’t apply, but since caseload keeps getting mentioned we really should think about decision making requirements in schools. The most basic way to think about special education eligibility and services under IDEA is that to qualify for services you must:

1) have an impairment

2) that impairment results in an educational impact

3) the child requires specially designed instruction to make progress
 
Before we can ever determine the need for treatment in schools, we have to be sure we have data to answer all three questions for eligibility.

The article Evaluation and Eligibility for Speech-Language Services in Schools gives an overview of the regulatory requirements of IDEA and examples of some state differences. Important data like intelligibility ratings, stimulability probes, and any other state required data are needed to answer the IDEA questions.  We should be sure SLPs and decision making teams have data from teachers and parents looking at the educational impact caused by the articulation errors before we begin to discuss services in schools.

We need to remember that IDEA services in schools, 
including speech, are for students who are disabled. Giving services to a student who doesn’t meet all three parts of the federal definition of special education is inappropriate, results in overidentification, and is a violation of the child’s civil rights."   

~ Marie Ireland, SLP Specialist at the Virginia Department of Education
... read here and here to learn more about Marie's work.

Another addendum... because we just can't stop.

[Updated 2/27/2019] Two of my favorite colleagues, Sarah Bevier and Lisa Kathman from SLPToolkit, have a podcast called "True Confessions". Sarah and Lisa bring such clarity to the realities of being a school-based SLP, and incorporating evidence-based practices into that environment. With invited guest Dr. Kelly Farquharson, a top expert in speech sound disorders, the result was a wonderful episode, titled "We've been interpreting the articulation norms all wrong."
​

Dr. Tiffany Hogan, of "See Hear Speak" podcast also has a fantastic episode on this topic! See episode #3, "Speech norms, eligibility for speech treatment, and advocacy".

And finally, four new journal articles on speech sound disorders and qualification decisions were published this week as well! The clinical tips contained within are fantastic:
  • Speech Sound Disorders in Schools: Who Qualifies? (intro to the forum)
  • Standardized Tests and the Diagnosis of Speech Sound Disorders
  • Using Developmental Norms for Speech Sounds as a Means of Determining Treatment Eligibility in Schools
  • It Might Not Be “Just Artic”: The Case for the Single Sound Error
  • Eligibility and Speech Sound Disorders: Assessment of Social Impact

Between this blog, the podcast, and these four journal articles, you'll be set with understanding this topic!

[Updated 8/8/2020]

  • A new paper out on this topic! On only U.S. children. Infographics to accompany it, here. 
Written by Meredith Harold, PhD, CCC-SLP
8 Comments
Kim Okirima-Tiluk
12/30/2018 02:09:58 pm

I actually loved that article and had the literary review group in my district read it. We have many kids that speak languages other than English. I think it is helpful to know that sounds, that occur in many languages, actually develop around the same time as these sounds develop in English. It helps when trying to figure out whether a speaker of Swahili or Spanish or Urdu or whatever language has age appropriate articulation skills...especially when you don’t speak their primary language. Just my take, but I found the information to be helpful in determining difference vs disorder

Reply
Meredith Harold
12/30/2018 02:25:58 pm

YES! Right!? That's what makes this article super value, and aligns with its original intent (or what I perceives the intent to be, from reading it).

Reply
Molly Schenker
12/30/2018 03:13:40 pm

It all comes down to money- to get districts to give SLPs the support they need, we need evidence that treating early is going to have a financial impact later. So we not only do we need clinician/researcher collaboration, but the opinion of an administrator or two wouldn't hurt...

ugh. So many barriers to doing effective, evidence-based work.

Reply
SC in SD
12/30/2018 06:23:20 pm

Couldn’t agree more. From my school-based experience I can say that doesn’t help that the IDEA standards for eligibility are not clear (i.e., the meaning of “adverse effect” and “educational performance”) and that many states offer no further clarification in their specific regulations. While the eligibility decision is indeed multifactorial (i.e., the presence of a disabling condition does not automatically confer eligibility), in the schools in particular, there is little uniformity in this determination - springing from little guidance on which “key factors” (both clinical and educational) should be considered and how they should be weighted. One excellent discussion of this quandary from a legal perspective is at http://campbelllawreview.com/cms/wp-content/uploads/2016/04/Thomas_v38n1_pp75-109B-2.pdf

Reply
Lindsey
12/30/2018 08:21:37 pm

Thank you for this article! When I first saw the new norms I felt panicked.... then I remembered, we have more factors to consider than an age norm chart. If that’s all that we considered our job would be a heck of a lot easier!! Thank you for the clarification and many points to consider.

Reply
Stephanie
12/30/2018 08:47:53 pm

I really appreciate this blog post as a follow up to the article as it really broke down the situation very thoroughly. As a school based SLP, I find that we need support in terms of staffing to address caseload/workload issues and a clear cut definition of adverse effect as you mentioned. It is just too open to interpretation and at the end of the day, every child deserves what they need, whether it is more time, some strategies, or skilled and structured remediation. My concern is that regardless of what is published, many administrators look at the bottom line and they may not have the means or desire to pay for the quantity of therapists required to service students appropriately. I still have mixed feelings about this topic, but thank you very much for breaking it down so well.

Reply
Claudia link
12/31/2018 06:53:20 am

I would love to chat with you about the articles they used for the Spanish Norms. I still don’t feel comfortable about the norms they published for that language. The original particles don’t seem like solid research to draw from.

Reply
Lauren
4/24/2019 10:16:58 pm

I think a big issue is that many SLPs don’t feel that ASHA or our state organizations intervene enough on our behalf. I mean, SLPs are still treated as teachers in many school systems. Caseloads are out of control and good school-based SLPs can’t do good therapy because their hands are tied. Individuals can certainly make a difference, but our organizations (particularly the one we pay $225 for yearly) should be going to bat for us. Maybe they’re doing more behind the scenes than we know, but it doesn’t feel like it.

Insurance companies don’t know what SLPs do. School-based SLPs are expected to do lunch duty, etc. when OTs and PTs aren’t. I don’t see much changing in caseload sizes in schools or increased acceptance of our profession until our organizations do more. So like you said, we should be treating /r/ in kindergarten (I do in private practice), but that’s not feasible until everyone’s caseloads are more manageable! *off soap box*

Reply



Leave a Reply.

    Picture

    By The Informed SLP Team,
    with occasional guests​
    Picture

    Better Information.
    Better Outcomes.

    Learn what works
    Along with
    members of The Informed SLP
    View all blog posts

    Blog posts by title:


    ​In a fog: Five facts + twelve clinical takeaways about chemo brain
     
    #AmIQualified: Let’s talk about bilingualism and white supremacy in CSD, one layer at a time
     
    #AmIQualified:  Let’s talk about privilege in speech–language pathology
     
    #AmIQualified: Let’s talk about moving from cultural competence to cultural humility

    The Not-New Speech Norms Part 2: An American Tale

    ​Motivational interviewing and behavioral change in clinical practice

    ​Standardized language tests: That score might not mean what you think it means

    ​The grammar guide you never knew you always wanted

    ​Top 12 questions about ASHA CEUs—answered

    ​Schools, safety, SLPs, and the evidence

    ​Response to #BlackLivesMatter, 2020

    COVID-19 and Dysphagia: Considerations for the Medical SLP

    ​COVID-19 and Cognition: Impact for the Medical SLP

    ​Looking for evidence on telepractice for SLPs?

    ​"I don't get what the difference is between ASHA's Evidence Maps, speechBITE, and The Informed SLP..."

    ​SLPD vs. PhD: What's the difference?

    ​That one time a journal article on speech sounds broke the SLP internet

    ​The difference between respecting our science and loving our science

    ​What does the evidence show about treatment intensity?

    ​EBP as a blame game

    ​The EBP barrier nobody is talking about

    ​Guest post: On evidence analysis

    ​Guest post: On trauma and language development

    ​Guest post: Working memory, processing speed, and language disorder

    ​Guest post: Push-in services—how to collaborate!

    ​Guest post: Complexity approach for speech sound disorders

    ​How am I supposed to find time to read research?!?

    ​SLPs: How to make sure you're using EBP

    ​SLPs: How to get access to full journal articles 
     
     
     

PlEASE READ ​our  privacy & terms and conditions of service policies.


CONTACT US
© COPYRIGHT The Informed SLP ® 2015. ALL RIGHTS RESERVED.
  • Home
  • What We Do
    • What is The Informed SLP?
    • Team
  • Members Login
    • Birth to Three
    • Preschool & School-Age
    • Adults
  • Blog
  • Join