1 / 31

RICAS: ELA/Literacy Calibration

Winter 2019. RICAS: ELA/Literacy Calibration. Goals. To understand the purpose and benefits of calibration/looking at student work  To use student work from RICAS Released Items to further understand the RICAS rubric and the implications for instruction. Calibration. PURPOSE:

eferron
Download Presentation

RICAS: ELA/Literacy Calibration

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Winter 2019 RICAS: ELA/Literacy Calibration

  2. Goals • To understand the purpose and benefits of calibration/looking at student work  • To use student work from RICAS Released Items to further understand the RICAS rubric and the implications for instruction

  3. Calibration PURPOSE: • Build CONSISTENCY • Interpretation of rubric • Evaluation of qualities found in student work • Application of rubric to score student work across classes, schools, and LEAs • Establish RELIABILITY of scores • ALIGN student work to the standard(s)

  4. Calibration can: Align the scorers with the existing rubric & anchor papers OR Identify anchor papers using the rubric

  5. RICAS Grade 6 Passage Set Students would  Read:            2 texts   Complete:7  Selected Responses (SR) includes: multiple choice, multiple select, and/or                                                  technology enhanced items based on Reading Informational, Reading Literature or Language standards 1 Essay (ES) based on Language and Writing standards

  6. Grade 6 Passage Set TEXTS: Passage from A Jar of Dreams, by Yoshiko Uchida Poem “Somewhere Among,” by Annie Donwerth-Chikamatsu

  7. Using TestNav Available on the RICAS Resource Center  (http://ricas.pearsonsupport.com/released-items/)​

  8. Calibration Protocol Directions • Independently READ both texts: passage and poem • Complete all the Selected Response Items • Record outline/notes articulating the big ideas you would use to frame your essay response on your scratch paper • Identify evidence you would use to answer the essay prompt yourself • Predict what you will see in a 6th graders’ response

  9. Grade 6 Selected Response

  10. Grade 6 Selected Response

  11. Grade 6 Selected Response

  12. Grade 6 Selected Response

  13. Grade 6 Selected Response

  14. Grade 6 Selected Response

  15. Grade 6 Selected Response

  16. Grade 6 Selected Response

  17. Grade 6 Essay

  18. Calibration: Student Responses INDEPENDENTLY… • Read Student Responses A, B, and C • Rate the 3 responses: HIGH, MIDDLE, LOW  • Is the question asked in the prompt being answered? • What is the quality and development of the central idea of the response? • What is the quality of the evidence and/or details? • How well is this response organized? • How well did the student express his/her ideas? 

  19. Calibration: Student Responses Small Group Work… • Share your ratings with colleagues  • Discuss any differences • Come to consensus on the group rating • Articulate as a group HOW and WHY you all assigned the rating of HIGH, MIDDLE, LOW to each response

  20. Calibrating Student Responses INDEPENDENTLY… • Read Student Responses D and E • Rate the two new responses in relation to previous three responses • Rank them from 1-5, 1 being the highest and 5 being the lowest Keep in mind the qualities of good writing: • Answering the question asked • Development of central idea • Evidence and/or details selected • Organization • Expression of ideas

  21. Calibrating Student Responses Small Group Work… • Share rating with colleagues • Discuss & come to consensus on the progression of all papers from highest to lowest • Articulate WHY your group ranked them as they did  Large Group Discussion to sum up small group discussions

  22. Answer Key Ranking student responses -1 being the highest and  5 being the lowest Student B Student A Student D Student C Student E

  23. Understanding RICAS Rubric Expectations

  24. Calibration: Rubric Analysis INDEPENDENTLY… • Review 2018 RICAS Grade 6-8: English Language Arts Essay Rubric • Highlightwords that signal change between score points

  25. Calibration: Scoring Student Work INDEPENDENTLY… • Assign an Idea Development score to each paper based upon Rubric expectations Small Group Work… • Discuss scores & come to consensus for assigned score

  26. Calibration: Annotations INDEPENDENTLY: • Read Annotations for 5 student response papers • Ask yourself: • Did the annotations help your understanding of the score assigned? • Did the annotations highlight a new interpretation for you of the student response? • Did the annotation help clarify language of the rubric? • What might you add to the annotation(s)?

  27. Calibration: Take Away Discussion Scoring Reflection: • Articulate characteristics found within Score Point 4 response? • Identify differences between Score Point 3 and 4? Score point 3 and 2? • If you had discrepant scores among scorers, how were they discrepant? Was it due to interpretation of rubric language? Student expectations differences? Implications for Instruction: • How do students prepare to understand the expectations of the standard? • How do we support students in answering the essay questions? • Would a Graphic Organizer be appropriate? • Would additional experiences with multiple texts be helpful?

  28. The Calibration Process Ultimate Benefit: Deepens collective understanding of standard & expectations Extensions: • Revise/Review current LEA/school rubrics • Use anchor responses for instruction with students: • Shows students how other peers have responded to Essays • Students can analyze/evaluate sample responses critiquing each writer’s craft & applying to own peer feedback • Review student data to guide current instruction/curriculum

  29. Resources • RICAS Resource Center • Computer-based RICAS Released Items  • Answer key/scoring rubric including Reporting Categories, Standards, and Item Descriptions • Student Work link- This will take users to the Massachusetts Department of Education website. • RIDE Item Analysis Resources • Printable version of Paper-based RICAS Released Items • Item analysis by subject and grade level

  30. Literacy Supports on RIDE website RICAS ELA Test Design  RICAS: Released Items & Student Samples RICAS: Student Score Report/ Item Analysis & Subscore RICAS Graphic Organizers Writing Calibration Tool – Turn Key Protocol  Addresses : • BOTH Holistic & Analytic Rubrics  • If you have Anchors sets and if you do not have Anchor sets

  31. Questions Please direct all  correspondence to:  assessment@ride.ri.gov In the subject line of the inquiry include:  RICAS: ELA/Literacy Calibration 

More Related