Transcript Document
2005-2006 Regional Assessment Workshop Lincoln County School District Goal Overview of New State Test Support Structures and Test Administration Participants will: • Become familiar with key responsibilities and roles of District/School Test Coordinators. • Understand changes in state testing processes and procedures. • Understand links to Oregon EdVantage™. • Identify future district/school training needs. New District Support Structure • ESD’s are involved in training and providing state assessment support. • ODE will be providing information to ESD’s. • There will be no support staff dedicated to answering questions at ODE as in the past. • For the questions and training the state has been divided into three regions. Support Regions Region 1 Support Important numbers to remember: • Susan Halliday, LBL 541-812-2600 • Region 1 TESA Help Desk 800-970-TESA (8372) • Vantage Learning Help Desk 800-326-8328 What will your ESD partner do for you? • Remind you of the need for consistent statewide assessment administration. • Assist with TESA and paper/pencil test support. • Provide you additional paper/pencil testing materials in emergency situations. • Provide e-mail updates of current news and needs. • Provide a link between you and the ODE Office of Assessment and Information Services. What will your ESD partner not do for you? • Take the place of your district or school testing coordinator. • Order your paper/pencil state test materials through the ODE site. Administration Manual The single Administration Manual for the 2005 – 2006 school year will ONLY be found on the web at : http://www.ode.state.or.us/teach learn/testing/manuals/ Administration Manual - Appendix The Appendix for the Administration Manual for the 2005 – 2006 school year will ONLY be found on the web at : http://www.ode.state.or.us/ teachlearn/testing/manuals/ TESA User’s Guide TESA Users Guide 2005-06 Getting Started http://www.ode.state.or.us/search/ results/?id=164 Purposes of State Testing • Individual student learning. • Student performance by various groups for student learning purposes: – Cohort Data – Year-to-Year Data • Student performance by various groups for compliance purposes. LBL: Real Solutions for Education Test Schedule • Located on ODE’s Webpage – http://www.ode.state.or.us/search/results/?id=169 • Highlights include: – – – – Writing window: January 9 – February 24 Social Sciences: Optional and Web only Grade 3 Reading test – available in Spanish! English Language Proficiency Assessment (ELPA) Test Window: April 4 – June 9 Testing Opportunities Mathematics Reading Formats Number of Opportunitie s Gr. 3 (Bnch 1) Gr. 4 Gr. 5 (Bnch 2) Gr. 6 Gr. 7 Gr. 8 (Bnch 3) CIM XA TESA - English 3 R R R R R R R A TESA -Spanish/English 3 Paper/Pencil – English 1 PP – Spanish/English 1 PP – Russian/English 1 TESA - English 3 R R R R R R R A R R R A O O O Paper/Pencil – English ** Grade 3 – Spanish * Science Social Sciences Writing 1 1 TESA - English B2 & B3 (2) – CIM (3) TESA -Spanish/English B2 & B3 (1) – CIM (2) Paper/Pencil – English 1 PP – Spanish/English 1 PP – Russian/English 1 TESA - English 2 TESA -Spanish/English 1 TESA – English 1 -Seniors only Paper/Pencil – English 1 PP – Spanish/English 1 R R R A Planning Testing Times CONTENT AREA Approximate Working Time TESA – long form (1 available) Approximate Working Time TESA – short form (2 available) Approximate Working Time paper/pencil Mathematics 75 – 120 minutes 45 – 60 minutes Two 50-minute sessions Reading/Literature 75 – 120 minutes 45 – 60 minutes Two 50-minute sessions Science 75 – 120 minutes 45 – 60 minutes Two 50-minute sessions Social Sciences 75 – 120 minutes N/A N/A Writing Three 50-minute sessions Three 50-minute sessions The Juried Assessment process is available to all students for any state tests, as are targeted assessments. http://www.ode.state.or.us/search/results/?=175 Knowledge and Skills Testing Schedule • TESA: September 27-May 19 – Availability of test based on SSID. • Paper/Pencil: March 13-April 21 – Assessment Collection for bar code schools sent at end of the testing window, based on tests coded. Go To: https://district.ode.state.or.us/apps/login/ • Bar Code Schools select: BCSpring2006MC Grade Level Performance Standards Performance standards for math and reading knowledge and skills tests are based on content expectations consistent with previous benchmarks. Final performance standards were adopted by the State Board in October 2005. Grade Level Performance Standards Reading and Literature: 4th Grade: 6th Grade: 7th Grade: 223 (Exceeds) 233 (Exceeds) 236 (Exceeds) 208 (Meets) 219 (Meets) 226 (Meets) Mathematics: 4th Grade: 6th Grade: 7th Grade: 223 (Exceeds) 233 (Exceeds) 236 (Exceeds) 208 (Meets) 219 (Meets) 226 (Meets) Writing Testing Schedule • Grades 4, 7, & CIM students: – January 9 - February 24 – Or – • CIM students only: – April 14 - May 5. • Senior Writing Retests on TESA – Either October 31 – November 18 (Early Graduating Seniors Only) – Or April 14 to May 5 Approved Grade Level Performance Standards Writing Composite Scores: 7th Grade: 50 Exceeds 40 Meets 4th Grade: 40 Exceeds 32 Meets A score of three or higher in each of the Following traits: Ideas and Content Sentence Fluency Organization *Conventions * Conventions score doubled for 7th grade. Writing Assessment Opportunities • Students at Grades 9 and 11 may test once during one of the two regular windows; Grade 10 students must test once during one of the two windows • Grade 9 students should only be tested if they are taking CIM-level classes and have produced work that shows they are capable of meeting CIM standards; • Only early-graduating seniors may participate in the October/November window; all other seniors may re-test during either or both of the two later windows. “Practice Testing” ONLY those grade 9 students, receiving instruction at the CIM level, and showing CIM level proficiency, should test at the CIM level. Using the state test as a format for “practice testing” is out of compliance with state policy. Accommodations Overview Accommodation—a change in how a test is presented to or responded to by a student. – Provides the student equal access and equal opportunity to demonstrate proficiency. – Considered “standard administration” and have the opportunity to “meet” or “exceed” the standard. Modification Overview A Modification is a substantial change in the standard administration of the test. – Allows the student to engage productively in the assessment which includes changes in the instructional level, content, and performance criteria. – Under modified conditions scores are not considered for determining whether the student “meets” or “exceeds” the CIM benchmark. Scores obtained under modified conditions: • Are included in AYP (“does not meet”) • Do NOT count toward meeting performance standards for individual students • Are included in participation counts for AYP and Report Card Other Assessments • Targeted Assessments – Either TESA or Paper Pencil • Side-by-Side – Spanish (Mathematics, Science, Social Sciences) – Russian (download only) • Mathematics grades 3, 4, 5, 6, 7, 8, & CIM • Science benchmarks 2, 3, & CIM • Career and Life Role Assessment System (CLRAS) • Extended Reading, Mathematics, Writing, and Science • Juried Assessments • Appeals • English Language Proficiency Assessment Targeted Assessments A Targeted Assessment (formerly challenge) is from a different level than the grade of enrollment – and is consistent with the level of instruction. A student may target a lower grade level ONLY if doing so is described in the students’ IEP. If approved by the USDOE for 2005 – 2006, 2% of all assessments used to determine a district’s AYP may include these tests. Side – by - Side The side-by-side assessments have the same items presented in both Spanish and English or in both Russian and English. Students benefiting from seeing the items in both languages can meet standards for both the CIM and for AYP. These are “standard administration” tests. Extended Assessments/CLRAS What are they? – Alternatives to grade level assessments Who takes them? – Students with significant disabilities that are unable to take the general statewide assessment Who gives them? – Only “qualified” assessors should administer extended assessments For more information about Extended Assessments & CLRAS go to: http://www.ode.state.or.us/search/results/?id=178 Juried Assessments What is it? – Juried Assessments are an alternative path for students who can meet the CIM standards, but are unable to demonstrate mastery on one or more statewide assessments. Who uses the Juried Assessment process? – Any student who has mastered grade level content, but is unable to demonstrate the mastery on statewide assessments. – Students who have entered Oregon schools at grades 11 or 12, and choose not to take the statewide assessments. – “Eligible” students demonstrating reading and/or writing skills at the standard level, but in their native language. Juried Assessments What is a Collection of Evidence? – A set of materials gathered to show that the student is performing at the standard level on the grade level content. – The collection must address the State Board-adopted content and performance standards How does the Juried Assessment Process begin? – Districts are required to notify parents of the opportunity for students to use the Juried Assessment Process Do JA’s “count” for AYP and/or CIM? – In general, yes! For detailed requirements and intent to submit deadlines go to: http://www.ode.state.or.us/search/results/?id=175 Writing Test Appeals • State scores must be in the appropriate range of composite scores. – CIM: 25 – 39 – 7th: 25 – 39 – 4th: 20 – 31 • Trained rater re-scores paper. If score appears higher, resubmit paper. • Attach original paper to ‘Appeals Form’. – Completely fill out form. – Local rater and district test coordinator must sign form. • ODE must receive by May 31, 2006. • Appealed scores always replace original score. Test Security Security procedures are designed to protect the integrity and confidentiality of those test questions, prompts, and problems that are not released for public use; the security of these materials is necessary so that they can be used in later years to measure trends in performance. Test administration procedures are to ensure consistent statewide test administration. When this doesn’t happen: – Report to ODE Office of Assessment and Information Services – Determine an action plan – Conduct an investigation – Report the results of the investigation – If appropriate – contact TSPC re: possible loss of licensure A PowerPoint presentation about test security is available on the ODE website. Go to: http://www.ode.state.or.us/teachlearn/testing/admin/testsecurity.ppt Test Security Q/A • To maintain secure and fair test administration: – Teachers and proctors must sign the Assurance of Test Security form to communicate the importance of “standardized” administration of tests each year. These are to be kept at the district office for one year. – Concepts that had not been taught earlier may not be introduced to students prior to giving the test (don’t give test materials out too soon) – Proctors may not suggest which prompt a student ought to select for writing – Unused test materials, after each testing window, must be returned to the District Test Coordinator. Schools may not keep extra booklets or copy test forms for practice or future instructional use – Test forms have a “core” set of items that are the same year to year. This set links the current test to previous years’ tests and ensures the test is consistent and fair from year to year – Any teacher responsible for proctoring test administration for students “must be in the room monitoring this process and be available for students who may have operational questions.” Online Ordering Tests available for order online – Writing Performance Assessments November 2 – November 23, 2005 February 10 – February 24, 2006 – Knowledge and Skills Tests January 10 – January 27, 2006 – Grade 3 Reading in Spanish January 10 – January 27, 2005 Lincoln County School District staff will work with schools to order appropriate numbers of paper/pencil test documents. Student Staging (formerly PADM) Student Staging Overview: – The intent of the Student Staging web site is to make Assessment data more complete and accurate before state-generated reports are issued. – The Student Staging web site is preloaded with the demographic portion of student records. – Each Assessment Window is a different Student Staging database file. – One student record is displayed on the screen at a time. – Each student will have multiple records if s/he has taken more than one test. For instructions on accessing and using the Student Staging site go to: https://district.ode.state.or.us/docs/asmt/tststg/ StudentStagingUserGuide.pdf NOTE: TESA data updates student staging daily! Work Sample Requirements • For writing, speaking, and mathematics problem solving, students in grades 3, 4, 5, 6, 7 & 8 must complete one work sample scored with the state scoring guide. • Students at the CIM level must complete 2 work samples from different strands (SRCs 3, 4, or 5) in mathematics problem solving; and 3 samples in writing (one persuasive, one expository AND one imaginative or narrative). In speaking, CIM students must complete 3 samples (one persuasive, one informative, and one unrehearsed). Work Sample Requirements • For scientific inquiry, students in grades 4 – 8 and at the CIM level must complete one work sample, scored in the required dimensions. • For social sciences analysis, students in grades 6 – 8 and at the CIM level may complete one work sample, scored in the required dimensions, beginning in 2005 – 06. The Overview of Oregon’s assessment system can be found at: http://www.ode.state.or.us/search/results/?id=239 The phase in schedule for science work samples can be found at: http://www.ode.state.or.us/search/results/?id=240 The phase in schedule for social science work samples can be found at: http://www.ode.state.or.us/teachlearn/subjects/ socialscience/assessment/survey English Language Proficiency Assessments (ELPA) Districts have traditionally used one of four purchased assessments As of 05-06, schools must use Oregon’s ELPA Assessment There are two field test opportunities: fall and spring The operational assessment will be April - June Web-Based assessment, with K-12 being assessed Questions: please contact Elaine Hultengren at 503.378.3600 ext. 2345 or [email protected] Sample Tests • The Oregon Department of Education provides sample tests to demonstrate the types of questions students might encounter on the Oregon Statewide Assessment. • The sample questions were taken from previous years’ tests, are no longer secure and have been released for public use. Sample tests are available in: – Mathematics and Reading at grades 3, 4, 5, 6, 7, 8, and CIM – Science and Social Sciences at benchmarks 2, 3, and CIM – Extended Mathematics, Reading and Writing Sample tests can be found on TESA or on the ODE website at: http://www.ode.state.or.us/search/results/?id=226 Bar-Coding Districts • LBL will bar code ordered documents for the state writing test. • LBL will be prepared to begin coding state writing test answer documents well ahead of testing window. • School districts will be responsible for bar coding all knowledge and skills answer documents locally. WebEx Training Available Go to http://techserv.lblesd.k12.or.us/software/secure/webex/i ndex.php Select: “Other Student Applications” “OSAT” Three options are available for viewing: “OSAT Introduction” “OSAT Secondary School Student Assignments” “OSAT Printing” Bar Code Availability • Bar coding options for the Writing Performance Test will be available in early December. This will allow you to select students well ahead of testing. • Please provide LBL with five working days of lead time for printing of answer documents. Score Loading and Resolution • All state test scores will be loaded into the LBL Student Information System on a weekly basis. • For resolution of duplicates, please view option DO 155 or SO 135. • Changes in scores may only be made through the ODE site. TESA for 2005-2006 A Look at What’s New TESA Access • Secure Browser (Recommended) • TESA Web site New for 2005-06 TESA Availability September 27-May 19 Score that “counts” The highest score on any attempt counts for AYP and Report Card. Long vs. Short tests At the Grade levels for Reading, Math, and CIM Science, there are three testing opportunities. Two of these are shorter tests, which provide no strand information. One of the attempts is a longer exam, providing full strand information. All tests allow students to meet the performance standard. Delivery Method Sample Tests Secure Browser Progressive (Math and Reading at all grade levels and Science at CIM) – Each student receives items at their ability level within grade level. Linear Test (Social Science) – Small pool of items, students will see the same questions in random order. Available on TESA for Math, Reading, Science, and Social Sciences at grades where TESA tests are given. Students will receive the number correct at the end of their test. The password to exit the secure browser has changed to tesa05. New for 2005-06 School Name Confirmation Screen A ‘School Name” confirmation screen has been added. After confirming personal information students will view the School Name and ID number displayed on a separate verification page. Subject Tabs Click on a colored tab to see available tests. Only one test per subject can be opened at a time. Print Reading Passage ODE is still determining how to use this function. It will be on to start the year while we gather feedback. It may be removed if it is shown to not be helpful to students. Reading Questions Students may preview all questions assigned a passage before answering and submitting. Sort Reports Locked out Students Reports can be sorted by clicking on each heading. Teachers can reset locked out students New for 2005-06 Administrative Login All District and School Usernames and Passwords have been reset since last year. Targeted Tests A “Grade Level Challenge Form” must be submitted for all students who will be challenging a benchmark or grade level test. See Appendix A of Administration Manual. Access Key and Test Key During daily login the Access and Test Keys are no longer case sensitive. Test Survey Questions Number of Tests Open Check system requirements Survey questions have been embedded at the beginning of the standard tests. Students will answer the questions the first time a subject test is open. Students may only have one test per subject open at a time. Check to see if your system meets the minimum requirements by clicking on the System Requirement Check button in the upper right corner on the TESA main screen. Number of Opportunities Number of TESA Opportunities for 2005-2006 Reading Math Spanish/English Math Science Spanish/English Science Grade 3 3 3 Grade Grade 5 Grade 6 4 (Benchmark 2) 3 3 3 3 3 3 Grade 7 3 3 Grade 8 Grade 9-12 (Benchmark 3) (CIM) 3 3 3 3 3 3 3 3 3 3 3 N/A N/A 2 N/A N/A 2 3 N/A N/A 1 N/A N/A 1 2 Social Sciences N/A N/A 2 N/A N/A 2 2 Spanish/English Social Sciences N/A N/A 1 N/A N/A 1 1 Test Names Reading Tab Rdg. Test #1 Reg. Test #2 No Strand Data Rdg. Test #3 No Strand Data Grade 3 Grade 4 RLBlueGR3 RLBlueGR4 RLRedGR3 RLRedGR4 RLOrangeGR3 Grade 5 Grade 6 Grade 7 RLBlueGR5 RLBlueGR6 RLBlueGR7 RLRedGR5 RLRedGR6 RLRedGR7 RLOrangeGR5 Grade 8 CIM RLBlueGR8 RLRedGR8 RLOrangeGR8 RLBlueGRCIM RLRedGRCIM RLOrangeGR4 RLOrangeGR6 RLOrangeGR7 RLOrangeGRCIM Test Names Math Tab Rdg. Test #1 Rdg. Test #2 No Strand Data Rdg. Test #3 No Strand Data Grade 3 Grade 4 MAKansasGR3 MAOhioGR3 MAIdahoGR3 MAKansasGR4 MAOhioGR4 MAIdahoGR4 Grade 5 Grade 6 Grade 7 MAKansasGR5 MAOhioGR5 MAIdahoGR5 MAKansasGR6 MAOhioGR6 MAIdahoGR6 MAKansasGR7 MAOhioGR7 MAIdahoGR7 Grade 8 CIM MAKansasGR8 MAOhioGR8 MAIdahoGR8 MAKansasGRCIM MAOhioGRCIM MAIdahoGRCIM Test Names Science Tab Grade Test 1 Test 2 Test 3 (No Strands) 5th SCDolphin SCRabbit GR5 GR5 8th SCDolphin SCRabbit GR8 GR8 CIM SCDolphin GRCIM SCPigGR CIM Test 4 (No Strands) TBD Test Names Social Science Tab Grade Test 1 Test 2 5th Grade SSAsiaGR5 SSEuropeGR5 8th Grade SSAsiaGR8 SSEuropeGR8 CIM SSAsiaGRCIM SSEuropeGRCIM Test Names Other Tab Spanish Math Test 1 Spanish Math Test 2 Spanish Math Test 3 Grade 3 MAHawaiiGR3SPN MAMaineGR3SPN MAFloridaGR3SPN Grade 4 MAHawaiiGR4SPN MAMaineGR4SPN MAFloridaGR4SPN Grade 5 MAHawaiiGR5SPN MAMaineGR5SPN MAFloridaGR5SPN Grade 6 MAHawaiiGR6SPN MAMaineGR6SPN MAFloridaGR6SPN Grade 7 MAHawaiiGR7SPN MAMaineGR7SPN MAFloridaGR7SPN Grade 8 MAHawaiiGR8SPN MAMaineGR8SPN MAFloridaGR8SPN CIM MAHawaiiGRCIMSPN MAMaineGRCIMSPN MAFloridaGRCIMSPN Spanish Science Test 1 Spanish Science Test 2 Grade 5 SCPerroGR5SPN Grade 8 SCPerroGR8SPN CIM SCPerroGRCIMSPN Spanish Social Sciences Test 1 Grade 5 SSAfricaGR5SPN Grade 8 SSAfricaGR8SPN CIM SSAfricaGRCIMSPN SCGatoGRCIMSPN Considerations • • • • • • • • Lab Usage Testing All Students Testing Times Proctoring Computer Rights Testing Location Test Protocol Etc… Data Management HALLIDAY, Susan SSID: 7654321 ABC School School ID: 4321 Look for ‘access key’ and ‘test key’ for today. Similar idea to the data card template found in your TESA Notebook. From a Student’s Perspective TESA 2005: Logging in as a Student TESA 2005: Student Welcome/Confirmation Screen TESA 2005: Student Welcome/Confirmation Screen Student must verify School Name and School ID TESA 2005: Student Test Center Click on a colored tab to see available tests. Only one test per subject can be opened at a time. Spanish tests are located in “Other.” TESA 2005: Starting a Test TESA 2005: SCHOOL NAME ODE is still determining how to use this function. It will be on to start the year while we gather feedback. It may be removed if it is shown to not be helpful to students. School name appears on screen through the entire test TESA 2005: Reading Passage Preview Previews all questions within a passage. TESA 2005: Reading Passage Preview Accessing TESA TESA 2005: HOME PAGE Check to see if your system meets the minimum requirements. Students can take sample tests on TESA. TESA 2005: Administrator, Teacher, Proctor Log In TESA 2005: Teacher/Proctor Welcome/Confirmation Screen TESA 2005: Teacher Main Menu Access Key & Test Key are still no longer case sensitive Teachers can still reset locked out students TESA 2005: Modify Account TESA 2005: Group Setup TESA 2005: Group Information TESA 2005: Group Members TESA 2005: Reports Menu TESA 2005: Reports Criteria TESA 2005: Reports Reports can be sorted by clicking on each heading. How to Test a Student TESA 2005: HOME PAGE Click on Student Login TESA 2005: Logging in as a Student Enter SSID, School ID, and Access Key. TESA 2005: Student Welcome/Confirmation Screen Click on “Yes, this information is CORRECT.” TESA 2005: Student Welcome/Confirmation Screen Click on “Yes, this information is CORRECT.” TESA 2005: Student Test Center Select a tab to see a list of available tests. TESA 2005: Launching a Test Select the test you’d like to take. TESA 2005: Launching a Test Click OK to start the test. TESA 2005: Enter Test Key Enter the Test Key and click on the login button TESA 2005: Modifying the test If modifying the test, enter “modify” in place of the test key. TESA 2005: Modification code screen Click the modifications code(s) that apply for this test and enter the teacher’s email address. TESA 2005: Confirmation Box to Stop Test and Finish Later TESA 2005: Resume a Test Tests to be resumed are listed at the top of the screen. TESA 2005: Math Item with Finish Button Click on COMMENT AND FEEDBACK to report a problem with the question to ODE. The flag will appear on the last question of the test. What’s new in...Language Arts • Reading – 2005-2006 is implementation year for new standards. – New Score Reporting Categories are now in effect for all grades. – New Test Specifications and SRC Charts are now posted on the Web. – New Sample Tests for grades 3, 5, 8, and CIM are also posted. These documents can be found at: http://www.ode.state.or.us/search/results/?id=236 What’s new in...Language Arts • Writing – 2005-2006 is implementation year for new standards. – New Test Specifications have been posted on the Web (http://www.ode.state.or.us/search/results/?id=238). – New anchor papers/exemplars will be posted for 3, 5, 8, and 10 by the end of October. – New process for appealing state assessment scores— see the Administration Manual. – State tests with all 4s except for one 3 will be given a third reading at each of the tested grades in 2005-2006. – New writing scoring guide– minimal changes. What’s new in...Mathematics • Knowledge and Skills: – The standards and new weighting are in effect for all grades and are modeled in the sample tests. – New K/S Test Specifications (for grades 3 & 4, 5 & 6, 7 & 8, and CIM) are now posted – they intentionally represent a sampling of content to be assessed at each grade level. – Item Difficulty Charts (ranges of difficulties for ranges of grade levels by SRC) are posted. These documents can be found at: http://www.ode.state.or.us/search/results/?id=257 What’s new in...Mathematics • Mathematics Problem Solving – At each grade level (3, 4, 5, 6, 7, 8 & at the CIM) and from each strand – statistics/probability, algebraic relationships, and geometry – you can find a task, anchor papers/exemplars (high, medium, and low), scores and commentaries! These can be found at either: http://www.ode.state.or.us/subjects/mathematics/resources/pssupport or http://www.ode.state.or.us/search/results/id=224 • OCTM Professional Development Cadre – contact: – – – – Eastern Oregon: Molly Smith – [email protected] Northwestern Oregon: Lynn Bonser – [email protected] Southern : Giny Christensen – [email protected] General Info: Phil Bartsch – [email protected] What’s new in...Science • Three test opportunities on TESA for CIM • One Benchmark 2 and one Benchmark 3 Spanish/English test on TESA • Scientific Inquiry work sample requirement for 10th graders (CIM) and Benchmark 3 students now includes “Forming” • Scientific Inquiry work sample requirements for Benchmark 2 students now includes “Analyzing” • Scientific Inquiry Teacher Leaders available for scoring facilitation at http://www.ode.state.or.us/teachlearn/subjects/science/ SciInqProfDevelopers0405.doc What’s new in...Social Sciences • Social Sciences Tests are on TESA – ONLY. • Two tests are available at Benchmarks 2 & 3 and at the CIM level. • One Spanish/English test is also available at each level. • Social Sciences Analysis Teacher Leader Cadre available for scoring facilitation are listed at: http://www.ode.state.or.us/teachlearn/subjects/socials cience/curriculum/teachres/leaders.aspx Q&A • What did you learn? • Other QUESTIONS you still have? • Future training needs? Thank You