Clinical Takeaways | O.T. Wizard Research Series, Part 1
By Stephanie Seymore Wick, MSOT, OT/L | Founder and Clinical Architect, O.T. Wizard
Most pediatric OTs are excellent documenters. We write thorough evaluations, set meaningful goals, and log every session. The paper trail is solid. So why is it so hard to answer the one question that matters most?
Is this working and if so, how much?
Not “are we doing the right things?” Not “is this child making progress in a general sense?” The specific question: is this child changing, how fast, and is that fast enough?
That question turns out to be surprisingly hard to answer with the tools most of us are using.
The Snapshot Problem
A standardized evaluation gives you a score at one point in time. A re-evaluation gives you another score. You compare the two and write a narrative about what changed. That is snapshot documentation, and it is useful. It tells you where a child started and where they landed.
What it does not tell you is anything about the line between those two points.
When did the change happen? Was progress steady, or did the child plateau for two months and then accelerate? Did a specific intervention approach produce better outcomes than others? Did an attendance gap create a measurable dip? Did the child actually cross a key functional threshold six weeks before the re-evaluation was even scheduled?
Without structured session-level data linked to domain scores, you simply cannot see any of that. You have two dots. You do not have a trajectory.
Why This Shows Up Differently in Medical vs. School Settings
In a medical outpatient practice, the moment this gap becomes visible is usually an authorization request. You are being asked to justify continued services and the strongest argument is quantitative: here is where the child started, here is the rate at which they are improving, and here is where they are projected to land by the end of this period. Without RTI data, you fall back on clinical narrative. Narrative is defensible. It is not the same as a slope.
In school-based practice, the moment arrives at the IEP table. You are sitting with a team that includes a parent, a classroom teacher, a special educator, and an administrator. They are deciding whether OT services should continue, increase, or be exited. The OT who arrives with a performance slope and a comparison to natural developmental growth is a different professional presence than the one who arrives with quarterly progress notes. Both care about the child. Only one has data that can change a decision.
Exit recommendations are especially difficult without RTI data. Recommending that a child be exited from OT services is a clinical and ethical judgment call. With measurement data showing that the child has reached functional independence or participation and is maintaining gains without direct support, it becomes a defensible milestone. Without that data, it is an opinion.
The Plateau Conversation
Every pediatric OT has been here. A child who was making visible progress has leveled off. The parent is worried. The payer is skeptical. The school team is questioning whether to continue services.
The problem is that a plateau looks the same on paper whether it is stagnation or consolidation. A child consolidating a new skill at a lower level of support may show no numerical gain for several sessions. That is not failure. It is a normal part of skill acquisition. But without session-level performance data, you cannot show anyone the difference. You can only explain it.
With structured data, you can show the team exactly when the plateau began, what changed in the child’s routine or support structure around that time, and whether similar plateaus have resolved in this child’s history. That changes the conversation from “we think this is temporary” to “here is what the data shows.”
What Parents Are Actually Asking
When a parent asks whether therapy is working, the most honest answer most therapists can give without RTI infrastructure is a clinical impression. That impression may be completely accurate. But it is not the same as showing a parent a graph of their child’s performance over twenty sessions and saying: here is where he started, here is the rate at which he is moving, and here is what we project by the end of this period.
For school-based OTs, the parent question arrives at the IEP table, in front of an entire team. The quality of your data shapes what parents understand, what they advocate for, and what they accept when the team recommends a service change. That matters.
The Practical Distinction
Documentation and measurement are not the same system. They are not competing systems either. They serve different purposes.
Documentation records what happened, establishes compliance, and communicates clinical reasoning. Measurement tracks rate of change, identifies what conditions produce better performance, and determines whether progress is sufficient.
Most EHRs were built for the first column. Very few were built for the second. The gap between them is not a failure of clinical intent. It is a gap in infrastructure. EMR’s are typically built by people who are interesting in billing insurance and keeping accounting records. They are not clinical intelligence systems.
One Finding Worth Noting
When the O.T. Wizard re-evaluation data was examined, Participation and Executive Functioning showed flat longitudinal profiles compared to the large gains seen in VMI, ADL, and fine motor domains. The initial interpretation might be that OT did not improve those areas. But there is another possibility worth taking seriously: the first evaluation rating in those domains may not have captured authentic baseline behavior. Children often present their best behavior when meeting a new therapist in a structured evaluation setting. By re-evaluation, the novelty has worn off. The rating that looks flat may simply be more accurate.
That is a question that would not have surfaced without measurement data. It has real implications for how we interpret initial evaluation scores in observation-dependent domains. It is the kind of question that data raises and documentation alone cannot.
A Few Things to Reflect On
At re-evaluation, how do you determine the rate at which a child progressed? Can you identify which sessions produced the most meaningful gains? Can you show a parent the slope of improvement over an authorization period? Can you distinguish a true plateau from a reduction in required support?
If those questions are hard to answer with your current system, the infrastructure gap is real, and it is worth thinking about.
Parts 2 through 4 of this series will move from problem framing to evidence to practice, including composite clinical vignettes, full dataset patterns, and what RTI infrastructure looks like in day-to-day clinical workflow.
Disclosures: The author is the Founder and Clinical Architect of O.T. Wizard and has a financial interest in the platform. All data referenced is de-identified clinical data collected through the O.T. Wizard software platform in routine practice.
About O.T. Wizard: O.T. Wizard is a clinical intelligence system for pediatric occupational therapy professionals. The platform evaluates performance across twelve domains including visual-motor integration, fine motor skills, gross motor skills, praxis, visual perception, executive functioning, activities of daily living, and participation. For more information, visit otwizard.com.
Leave a Reply