Tuesday, April 10, 2018

Feedback Spirals vs Loops

Costa and Kallick (1995) favor a model of feedback spirals over Argyris and Schon’s (1978) feedback loop. Conceptualizing feedback as a loop is problematic because a loop is closed. This implies that students are the same place at the conclusion of their learning as when they began. Improvement, Costa and Kallick (1995) insist, must be continual process.  Spirals indicate a more recursive and continued progression of learning. Furthermore, feedback spirals can be used as decision making protocols for “the professional teacher who continually improves instructional practices in the classroom” (Costa & Kallick, 1995, p ?). Feedback Spirals also match Hattie and Timperley’s (2007) conception that feedback must “feed-forward.”. Fisher and Frey (2009) go even further, stating that feed-forward cannot be neglected because it it the very element that helps teachers respond to student learning and plan new lessons.
In the model below, I describe how feedback spirals will be woven into the research design and conversation between teachers and students about their writing. Using the spiral model fits the research design because the research questions are about how a high school teacher uses feedback from students to improve his or her approach to giving feedback that improves the quality of student writing. Using the spiral model to lay out the steps in the study mirrors the decision making protocols recommended by Costa and Kallick (1995). The spiral design also allows the teacher to respond to student attempts and plan lessons to continually address improvement.
Since the study is about how the teacher learns from the feedback continuum with writers, it might be confusing since the teacher is also giving feedback to students. In the model below, I lay out the research design in the spiral and then follow with a description of specific places where the research will focus on the teacher’s learning and use of feedback and not on the student learning. The teacher will evaluate the improvement of student response to her feedback, but the focus of this study is on the teacher’s perceptions and not on the student perceptions.
The feedback spiral begins at the bottom of the chart with the student composition. This study focuses on the teacher’s selection, use, and evaluation of feedback given to students about their writing. I’d like to highlight specific places in the feedback spiral where the study will have the greatest opportunity to reveal the teacher’s perceptions. In step 2, the teacher will read the student’s paper aloud as reader. This will allow the teacher to show how he or she is thinking to comprehend the text and digest the ideas. The think aloud will help the student writer see where the reader struggles to make meaning and how their text impacts the reader.
In steps three and four, the student will respond to the teacher’s reading of the text to clarify his/her intentions, ideas, and approach to writing. This discussion will be a primary place for the teacher to gather information about what the student was thinking and how he/she went about composing.
In step five, the teacher will use the feedback tool developed for the study to select the appropriate level of feedback to give to the student (surface/deep) and the type of feedback (task, process, self-extending) most appropriate for the student and the current writing performance. The teacher will think aloud to describe the choices he/she is making to select the feedback. The recordings and transcriptions will be useful to describe how the teacher uses the data in the previous steps to make a decision about what will be most helpful to the writer.
In steps 6-8, the teacher will deliver the feedback, check for understanding, and clarify if necessary. Before the student leaves the writing conference, the teacher will already begin to evaluate the effectiveness of her feedback. By recording and transcribing the exchange and collecting the artifacts, the teacher will be able to return to his or her decisions to evaluate how the student applies the feedback, collects evidence, and shares progress with the teacher in steps 9 and 10.

In steps 11-16, the teacher helps the writer set goals for the next writing performance and then evaluates how the feedback used in the first writing transfers to the next writing performance. This information can be helpful in learning what kind of feedback works best for particular students, writing situations/genres, etc. The teacher grows in the feedback loop by learning more effective ways to give feedback or searching for solutions to help students become better writers. When the writer grows because of what the teacher did, the teacher can identify his or her own effective practices for future feedback in writing conferences and receive guidance about restructuring lessons for initial instruction or whole class reteaching. Steps 17-19 extend the spiral to more and more sophisticated forms of teaching expertise.

Argyris, C., and Schon, D. (1978). Organizational learning: A theory of action perspective. New York, NY: Addison Wesley.

Costa, A. L., and Kallick, Bena. (Eds.). (1995). Assessment in the learning organization. Alexandria, VA: ASCD. I ordered the book, but the introduction is online here: http://www.ascd.org/publications/books/195188/chapters/Process-Design@-Feedback-Spirals-As-Components-of-Continued-Learning.aspx

Fisher, D. and Frey, N. (2009). Feed up, back, forward. Educational Leadership. 67(3). 20-25.

Murray, D. (1982). Teaching the other self: The writer’s first reader. College Composition and Communication 33(2), 140-147.
Sacks, O. (1989). Seeing voices: A journey into the world of the deaf. Berkley, CA: University of California Press.
Vygotsky, L. (1986). Thought and language. A. Kozulin (Ed). Cambridge, MA: MIT Press.

Wilson, M. (2018). Reimagining writing assessment: From scales to stories. Portsmouth, NH: Heinemann.

Thursday, March 22, 2018

Tell me again...How many do I have to get right to pass the STAAR?


Hello! I hope I’m not sounding ignorant, but I am trying to figure out how many questions the students have to get right on the English I & II EOC.  Can you help me?  Also I have been working on the composition rubric with my kids that ranges from 1-4, but I have been pulling up STAAR rubrics that show the composition  score ranging 1-8.  Now I am confused.  Can you help me figure the rubric for the composition and how questions are needed for passing?  Thanks, XXXXXXXXXX



Interesting question. It’s not ignorant at all. I’m going to CC Sherry on this one to make sure I don’t mess this up. It’s complicated.

Basically, it depends.
  1. It depends on what they make on the essay.
  2. It depends on what the state decides is the difficulty range of the text and test itself compared to previous years (how they scale the test and select the cut points)
  3. It depends on whether the kids took the test on paper or on computer. It depends on what accommodation features for the version of computer test they take. (There's a different scale for each version of the test.) 
  4. It also depends on what level you are wishing them to achieve: meets approaches, exceeds.
  5. You also have to attend to growth in scale score required from the previous year’s individual test results.

To start, you look at the raw score conversion tables to get a guestimate on what might be required. Last year, they had to get 39 correct to pass. (Sort of. More on that later.) Other years it is more. Sometimes less. Usually within 3-5 items. You also have to account for the essay score. Here is the link to 2017-1018: 

For the Essay
For the essay, you are correct in both statements. Yes. The scores are 1-4. Yes. You will see ranges from 1-8. Confusing for sure. Each paper is scored two times. Each person gives the paper a score from 1-4. Then those scores are added together to reach a total from 1-8.

As if that’s not confusing enough, to calculate passing for the whole test, the total score for both raters (1-8) is multiplied times 2. So for English 1 and 2, the essay is worth up to 16 points.

Weighting
Now you add in another factor: the weighting.


The written composition is worth 24% of the test. So they can bomb the essay or write nothing and still pass.
Revising and editing is worth 26% of the test with 18 questions.
Reading is worth 50% with 34 questions.
And then you add in the  10 or so field test items that will be for revising and editing as well as for reading.

Playing Games
You can start playing games like: I’ll get half of the reading questions correct for 25% of the test and nail the 26% for the revising and editing and get a 2 from both raters and multiply that times 2 for a total of 8 which would now make my essay worth half of the 24 points and have 64 percent passing rate. I’d have 18 plus 17 plus 8 to get a raw score of 43. Which would mean I would pass if the cut scores are the same as last year. Maybe. IF the questions I am counting on getting correct are NOT the field test items. So, ultimately, it is impossible to predict how many items they will have to get correct to pass.

Don't Count Items
Which means…drumroll…you can’t count up questions kids think they are going to get right so they know if they need to keep working. I don’t think we want kids spending time counting percentages and numbers of questions and raw score cut points to see if they are going to pass. They’d be better off reading and writing and thinking and doing a two finger check on their answer document.  


From Sherry Clark: 
Shona is correct in the information she provided.  Basically, there are 68 possible points to earn on the English I and II EOC tests.  The multiple choice items are worth 1 point each, where the composition is worth 16 points. 

For 7th grade writing, there are 46 possible points.  The composition score is doubled, so it accounts for 16 of the 46 points.

For the 4th writing, there are 32 possible points.  The composition score is not doubled, so it accounts for 8 of the 32 points.

Here’s a short table to summarize:

But remember - there are weighting charts for 4th and 7th grade too. 









Friday, March 9, 2018

Classroom Visit: Discussion Chips for Outside Reading Project

In this classroom, students must read one book outside of classroom time each grading period. Usually, there is some type of project students must complete. This time, students had to use the Kagan chips to have a discussion with their small group. They drew the chips, and had to answer the questions from the perspective of the main character or concept addressed in their book.



Classroom Visit: Media Annotations

This is an excellent example of annotating media and reflecting on the implications



Classroom Visit: Reader Response Dialogue to King Arthur

Students were about to read Sir Gawin and the Green Giant. They realized that they didn't know much about King Arthur. Instead of "giving notes", the teacher allowed students to conduct their own inquiry. They created presentations, shared them with their small groups, and then completed written dialogue exchanges. You gotta read this first one.








Classroom Visit: Annotations Example

While visiting a classroom, I saw some amazing things. I thought these ideas were well worth sharing so that you could have models of student work.




New ELAR TEKS: Ideas and Implications for School Leaders

The New ELAR TEKS are different. If someone reads them and tells you that's what we've always done, they are delusional.

As an administrator or curriculum leader, there are some important things you need to know and ways you can begin to prepare. PLC Discussion about the Introductions
It's important to spend time in PLC's reading and discussing the introductions to the new TEKS. These seven paragraphs establish why the strands are included and how they "embody the interconnected nature of reading, writing, speaking, reading, writing, and thinking" (TEKS Introductions, Section 110.) Simply put, the introductions guide the form and function of the TEKS. 

PD2Teach recorded a sample PLC to guide leaders in what these discussions can look like and to identify the most salient points that could result from such discussions.If you are interested in viewing the the recording, please join TCTELA at this link.  The video is available to members at http://at.bulb.re/r5n PD2Teach will be recording discussions for each strand and provide important resources to give exemplars of what instruction can look like for each grade. 

Bring your teachers together to read and discuss the introductions to the TEKS. You can find copies at this link.  

Implications for Planning and Budgeting

As you plan ahead for implementation, there are several implications for the differences in the new TEKS. 

1. Teacher Assignments:  Reading, Writing, Speaking, Listening, Thinking, and Research will all be connected. If you have one teacher assigned to reading and another to writing, it will be almost impossible to separate the TEKS into two separate courses. 
2. Scheduling Implications: The new TEKS reflect what we know about best practices in ELAR instruction. This takes TIME. Many schools implement balanced literacy and guided reading in the lower grades. The problem, is that teachers do not have enough time to get all of their groups covered and still have time for grade level instruction. This causes serious problems because instruction always focuses on catching students up that are behind and never gives teachers the time to focus on teaching grade level TEKS. Teachers in K-5 will need a minimum of 120 minutes to teach a blended Reading and Writing Course. Teachers in 6-12 will need a minimum of 90 minutes to teach a blended Reading and Writing Course. 45 minutes is not enough time. I'm not sure how you fit that into the master schedule with orchestra and football, but a key principle in promoting success is to structure the time needed for it (STOIC model). Teachers aren't using time as an excuse. It's an authentic handcuff to accomplishing our goals for literate, empowered citizens.
3. Testing Implications: The new TEKS were completely rewritten. The test will need to be changed. Commissioner Morath talked about his new vision of what the development process could look like. I don't know what it will look like, but I'm pretty sure we won't have a separate reading and writing test. 
4. Budgeting Implications: Self-Selected Reading and Writing are HUGE core beliefs that drive the new TEKS. Teachers will need money for classroom libraries that match the reading interests of their students. Teachers will also need significant staff development and support to understand the conceptual differences in moving away from teaching specific cannonized texts. Teachers will need significant staff development and support to understand how reading, writing, discussion, and research are all blended together and not siloed into isolated units. 
5. English III and IV: English III and IV are no longer solely focused on British Literature and American Literature. Get ready for some angry faces. But you can also count on kids being more engaged in reading. 
6. Spelling and Phonics: Say goodbye to the Friday spelling test - which we have known for YEARS is an abusive practice. Teachers (and parents) will need help in understanding the shift and knowing what to do instead.