The Letterboard App Project: Transforming communication for nonspeaking autistic individuals

The Consequences of Silence: Academic, Emotional, and Social Impacts on Nonspeaking Autistic Individuals

Autism research has grown a lot in the past decade, but not much has focused on the 30% of autistic people who can’t speak. In Canada and the United States, millions of autistic children and adults cannot talk effectively. This communication barrier limits their ability to participate in school, work, and community activities, making it essential to support efforts to provide alternative means of communication. This will not only improve their ability to participate in society but also enhance their overall quality of life.

Unfortunately, most nonspeaking autistic people don’t get effective communication alternatives. The usual methods involve training them to use speech or picture-based systems that are inflexible and cannot be adapted to accommodate the needs of each user, resulting in poor outcomes. This is evidenced by a systematic review that found these common approaches did not lead to lasting improvements in communication.

Without a way to express their thoughts and desires, nonspeakers often face negative outcomes. Their academic skills are often underestimated, leading to them being placed in special classrooms where they learn basic life skills instead of engaging in academic subjects. The lack of access to academic content is distressing for nonspeakers who have a strong desire to learn but no way to express that desire. Imagine, for a moment, having a consistent longing to learn but no way to communicate it. Consider the effect that would have on your mental health; it would be incredibly frustrating and disheartening. Also, not having a good way to communicate can limit their access to medical care and job opportunities, further impacting their mental health and ability to integrate into society.

Bridging the Gap: The Importance of Including Nonspeaking Voices in Autism Research

User-centered design is critical, but the inputs of the nonspeaking community have largely been excluded from autism research. This exclusion is partly due to the perception that they are difficult to work with. This is also confounded by the use of behavioral labels that are subjective.

In the absence of an objective means to classifying the autism spectrum, potential participants cannot be allocated to uniform study groups. This means that conducting randomized controlled trials is problematic because participant allocation into homogeneous treatment groups cannot be reliably achieved, thereby compromising a study’s ability to detect meaningful differences. This is why research must go beyond behavioral observations and employ objective outcomes to target interventions that are unique to each nonspeaker. Current research suggests measuring both the kinematic profile of a nonspeaker and their ability to employ their eyes to locate and fixate on visual information. There is ample evidence in other fields that use such techniques in studying neurotypical participants; however, these methods have yet to be sufficiently studied in the nonspeaking autistic community.

The Letterboard App: Tailoring Communication Strategies for Each Nonspeaker

The Letterboard App is a software application that captures the user’s touch interactions with the surface on an iPad and maps this data to a unique statistical distribution. The App also leverages machine learning as a means to help tailor interventions that enhance the user’s kinematic learning and progression to independent spelling.

The Letterboard App is unique in its support of the kinematic learning of spellers, assisting their journey towards independent communication. Kinematic learning, in this context, refers to the interconnectedness of visual, motor, and cognitive skills necessary for effective communication. By addressing these interconnected skills, the Letterboard App provides a path to communication for nonspeaking people. It helps them to better express their thoughts, fostering a deeper level of interaction with the world around them and helping us learn from their lived experiences.

Unlocking Potential: The Kinematic Learning Process with the Letterboard App

Kinematic learning focuses on the interconnectedness of gross motor skills, cognitive engagement, and improved visual tracking through quiet eye training, which are elements critical for independent spelling.

Kinematic Learning begins by running simulations on an iPad to better understand each user’s visual preferences and touch interactions. By optimizing the visual display based on these preferences, we can establish a baseline for the user’s visual tracking abilities and statistical touch profile. Once we understand the user’s visual preferences, we can deliver targeted interventions that track and enhance their kinematic development and eye-tracking capabilities.

Once the user’s visual preferences are defined, we begin the kinematic learning process with simple cognitive tasks requiring minimal motor effort, gradually progressing to more complex challenges. This structured approach helps learners build confidence and proficiency, starting from spelling single words and advancing to full sentences. This progression is mindful of the interdependence between cognitive demand and motor effort, likening it to a cognitive seesaw. As cognitive demand increases, so does the motor effort required to match that demand, and vice versa. This balance is akin to maintaining cognitive equilibrium, where the brain adjusts to manage cognitive load and motor demands effectively. Forming a string of words to communicate involves several mental processes that interact with each other, and it’s crucial to map this progression to avoid overwhelming the user. This is why it is essential to measure the user’s responses throughout all steps of the process.

Throughout the kinematic learning process, we track the user’s interactions with the iPad surface, collecting valuable data on temporal and motion dynamics at each stage. This data is used to model the user’s development over time using machine learning algorithms. By analyzing this information, we can better understand and support each learner’s unique kinematic and cognitive growth. This continuous data collection allows us to map the user’s progression and make positive changes to guide their improvement toward independent spelling.

From Exponential to Gaussian: The Evolution of Movement Patterns in Kinematic Learning

Tracking the user’s spelling movement profile is crucial because research shows that neurotypical individuals, after the age of 3, exhibit evidence of kinematic learning in their movements. This means that as they plan and execute movements, they become more efficient based on previous movement experiences. Research shows that kinematic learning is impaired in nonspeaking autistic people. The statistical distribution describing the movement profile of neurotypical individuals changes from an exponential to a more Gaussian distribution as they age, while this shift does not occur in the same way for autistic individuals. Understanding the distributional properties of the user’s movements throughout the kinematic learning process is vital to map their progression through these distributional phases and to tailor interventions effectively.

Beyond Pointing: Understanding the True Demands of Independent Spelling

Critics claim that if a user can point, it is evidence of their ability to independently spell. Such assertions are naive and demonstrate a lack of understanding of kinematic science. Objective measurement is essential to accurately assess if a user shows signs of impaired kinematic learning. Likewise, careful measurement can also assess when the cognitive demands of spelling exceed their kinematic abilities. The notion that pointing at something demonstrates intact kinematic learning is overly simplistic and fails to recognize the complexity of the kinematic and cognitive processes involved in text-based communication. Comprehensive evaluation is crucial to understanding both the user’s motor skills and the cognitive effort required for spelling.

From Gaze to Gesture: Strengthening Eye-Hand Synergy in Spelling

Another critical component of kinematic learning is addressing the irregular saccadic movements often observed in nonspeaking autistics. As learners engage in spelling activities, they undergo quiet eye training to stabilize their gaze. The “quiet eye,” a concept from sports science and motor learning, refers to the final fixation or tracking gaze held steadily on a target before performing a movement. This focused gaze training enables learners to accurately and efficiently locate specific letters on the letterboard, which directly enhances gross motor pointing skills. As a result, the eye can guide the hand with greater precision.

This synergy between eye and hand boosts first-time letter touch accuracy and supports the development of complex motor sequences needed for spelling longer responses. Therefore, learners experience significant improvements in handling increased cognitive loads, enabling them to answer open-ended questions. Through this integrated approach, nonspeaking individuals can achieve greater independence in communication, ultimately enriching their interactions and contributions to the world around them, and helping us understand their lived experiences.

Empowering Nonspeaking Voices: The Transformative Potential of the Letterboard App Project

The Letterboard App Project offers an innovative approach to addressing the communication barriers faced by nonspeaking autistic individuals. By including Nonspeaking Voices and utilizing innovative technologies and methodologies, this project aims to provide effective communication alternatives tailored to the unique needs of each user. The potential impact of this project is vast, from enhancing the quality of life for nonspeaking individuals to creating broader societal benefits, resulting in positive outcomes for everyone.

We trust you appreciate the potential the Letterboard App Project has to transform the lives of nonspeaking autistic individuals. Please support this project by signing up with your email address to learn more about our progress and how you can get involved.