STAAR, MAP, DIBLES, Dabbles, Dribbles...
The problem with data is itself. (Caveat - I do love a significant item analysis paired with their stimulus.)
There's just so much data. And we collect more of it before we can do anything with what we already have.
And...none of it tells you why there's a problem. We never know what really caused the results.
And...none of it tells you what we can do about it.
Ah. Kid - you failed STAAR again. Kid, you passed that test, but you didn't show growth. Kid - you are a hopper -you moved from one data bucket to another: GOOD JOB. Kid - you are in the low approaches bucket. Teacher - your kids aren't on track to pass this year. Let's have a data-dig-dialogue and talk about all the data that shows we aren't where we want to be. Teacher, looks like your kids need more on 13A.144.56F. What did you do wrong to teach that?
Um. Y'all. This discussion is nuts. We waller around in statistical **** that doesn't tell us what we are using it for. (I've blogged about that before...for example, STAAR isn't meant to be a single TEK focused instructional tool. It's to be considered as a holistic view of whether or not a kid is on grade level.)
If we haven't acted on the data we have, new data isn't really going to tell us something we didn't already know other than there are kids rising and falling for some invisible reason. We can't show causality or even correlation with instructional/programmatic/curricular actions.
If the data don't tell us why, then we probably aren't making good instructional decisions for anyone.
If the data don't tell us why, then we certainly can't tell how we should respond to individuals or collections of them.
Honestly, the problem with data is that it is legion (Mark 5:9). Ubiquitous. And most of the time absolutely a waste of time and money. Unless you talk to the human that took the assessment.
Only then, can the teacher as scientist and artist, master of the instructional craft and relationship with the learner, make powerful decisions about what that person needs next. Understanding why and how requires a transaction (Vygotsky - sociocultural acquisition) with the learner about their transaction with the text (Rosenblatt) and the author and their own learning processes (Hattie). Data can't do that. The master teacher - in relationship with the learner and with deep instructional pedagogical prowess - the teacher can do what no data can.
(I'll be writing next about how we can listen to kids read, talk to them, and understand what causes their responses to reading, writing, and thinking.)