WELCOME!

K-12 ASSESSMENT

Victoria Ash

(850) 245-0788

K-12 ADMINISTRATION

K-12 Assessment Link

K-12 Assessment
and
General Information
are available online at

Communication

Emails filtered through Leads
- DOE
  - Victoria Ash – Bureau Chief
  - Jackie Mueller – Director, Scoring and Reporting
  - Lynn Ann Tabeling – End-of-Course
  - Daphne Csonka – Administration
  - Mario Zuniga – Scoring and Reporting
- TDC
  - Vince Verges – Director
  - Steve Ash – Mathematics
  - Lyla Springfield – Reading
  - Linda Oravetz – Science
  - Trish Lyons – Interpretive Products

Assessment Schedules

2008-09 and 2009-10 FCAT Schedules
2008-09 Assessment Calendar
Updates
- 2008-09 FCAT Schedule
  - Test Dates
    - March 10 – 19
    - March 3 – 12 (Optional Schedule)
      - Notification Deadline to the Department – September 15
- Grade 11 Science
  - Day 1, Day 2, Day 3, Day 4, or Day 5
    - Must be a DISTRICT (not a school-by-school) decision
  - Notification Deadline to the Department – September 15
- Test Materials Shipment and Pickup Schedule

What’s New for 2008-09

Recycling
Current Strategies
Recycling versus Reuse

What’s New for 2008-09

No NRT administration
No computer-based Retake
High School Competency Test (HSCT)
- No contract for 2009 administration
- FCAT Retake administrations
- Concordant Study in progress

What’s New for 2008-09

FCAT Writing
- NO multiple-choice sessions at any grade level
- Unsealed four-page folder
- No test group codes for the 2009 Writing administration
- Planning Sheets

What’s New for 2008-09

FCAT Reading, Mathematics, and Science
- Test group codes on ALL answer documents, including Grades 3 and 4
- RETAKE PreID Labels
  - One Reading Retake set
  - One Mathematics Retake set
- No PINK Return Labels for Science
  - All TO BE SCORED documents will be packaged with RED, PEACH, or BLUE return labels.

What’s New for 2008-09

Reminders

Electronic Devices
Testing Guidelines
- If a student starts a test and leaves campus without finishing (for an appointment, illness, etc.), he or she will NOT be allowed to complete the test.
  - NO EXCEPTIONS will be made once the student leaves the campus; therefore, if you have concerns about a student, you should not allow the student to begin.
  - Consider administering the test to that student on one of the make-up days.
- Use ALL of the allotted time in each session.
- Test administrators must NOT administer the FCAT to their family members.

Reminders

Students to be Tested
- All students enrolled in Grades 3 – 11
- Certificate of Completion Students
- Home Education Program Students
  - Students MAY participate in the FCAT administration if their parent or guardian has identified the FCAT as the selected measure of their child’s annual progress.
- McKay Scholarship Program Students
  - Students enrolled in PRIVATE schools MAY participate.
  - Students enrolled in PUBLIC schools ARE REQUIRED to participate in statewide assessments as outlined in their IEPs.
- Corporate Tax Credit (CTC) Scholarship Program Students
  - A private school student enrolled in the CTC Scholarship Program MAY participate in the statewide assessments.
  - A parent/guardian is responsible for contacting the district to register the student for the selected assessments and for transporting the student to and from the district-assigned location.

Reminders

Students to be Tested (continued)
- Florida K-8 Virtual School Program Students
  - Connections Academy and Florida Virtual Academy
    - Do not confuse these students with Home Education Program students or high school students enrolled in classes with the Florida Virtual School.
- English Language Learners (ELLs)
  - ALL ELLs are expected to participate in FCAT Reading and Writing; however, if an ELL has been receiving services for one year or less AND the LEP committee determines that it is appropriate, the student may be exempt but must participate in an alternate assessment.
  - ALL ELLs are expected to participate in the FCAT Mathematics and Science tests no matter how long these students have been receiving services.

Forms

Forms located at
- Comment Forms
  Ensure that the online comment forms are reviewed BEFORE testing so that feedback will address the concerns of the FDOE and the contractor.
  - Test Administrator
  - School Coordinator
  - District Coordinator
- Required Administration Information
- Missing Materials
- Administration Irregularities and Breaches

PSAT and PLAN

Comprehensive English
Language Learning Assessment

CELLA Test Dates
- April 14 – May 15
Contacts
Academic Achievement through Language Acquisition
- Mark Drennan (850) 245-0893
- Pat Faircloth (850) 245-0885

K-12 Test Administration
Contact List

Daphne Csonka, Supervisor
(850) 245-9203
Tamika Brinson, FCAT
(850) 245-0786
Susie Lee, FCAT
(850) 245-0785
Linda Rhea, FCAT ESE
(850) 245-0742
Kira Sullivan, FCAT, PSAT/PLAN
(850) 245-0784

Misc. Assessment Topics

Dr. Cornelia S. Orr

Office of Assessment

Florida Department of Education

Misc. Assessment Topics

Senate Bill 1906 – Alternative Credit Pilot Program
Senate Bill 1908 – Many Initiatives: Writing+; Norm-referenced tests; Test Prep; Transitions to New Assessments; Testing Schedules; End-of-Course Assessments; Expanded College Readiness Testing
Assessment Appropriations
MAP Clearinghouse
FTCE Fee Increase

Legislative Update – SB 1906

Senate Bill 1906 – Alternative Credit Pilot Program
- DOE approve end-of-course assessments and minimum passing scores
- Limited to assessments for Algebra 1a, Algebra 1b, Algebra 1, Geometry, and Biology
- Assessments
  - developed by the Florida Virtual School, or
  - end-of-course statewide standardized assessments for these courses which may be adopted or developed by the department

Senate Bill 1908 –Writing+

SB 1908: Removes MC items beginning 08-09
SBE Concurrence (4/15/08): Remove the MC items from the FCAT Writing+ tests and delay its use as a graduation requirement.
Rationale:
- Budget Reduction – Multiple-choice questions do not impact our state or federal accountability systems.
- Technical concerns – Inconsistencies in 2007 between scores on the essay and MC questions, making the combination into a single score problematic for high stakes student decisions (10th).
Next Steps
- Revise SBE Rule 6A-1.09422 to delay FCAT Writing+ graduation requirement
- Prepare for future implementation of a revised writing test
- Revise pupil progression plans

Senate Bill 1908 –Writing+

“Beginning with the 2008-2009 school year, the commissioner shall discontinue administration of the selected response test items on the comprehensive assessments of writing. Beginning with the 2012-2013 school year, the comprehensive assessments of writing shall be composed of a combination of selected-response test items, short-response performance tasks, and extended-response performance tasks, which shall measure a student's content knowledge of writing, including, but not limited to, paragraph and sentence structure, sentence construction, grammar and usage, punctuation, capitalization, spelling, parts of speech, verb tense, irregular verbs, subject verb agreement, and noun-pronoun agreement.”

Senate Bill 1908 –Other Issues

NRT – removes the requirement that the statewide assessment program include norm-referenced tests
- Impact on Progression Plans – local plan revisions needed
- Reading Retention Rule being revised
- Corporate Tax Credit Scholarship
Test Prep - prohibits suspending regular curricula in order to administer practice tests or engage in other test-preparation activities for a statewide assessment (i.e., FCAT or end-of-course assessment). However, schools are permitted to:
- Distribute sample tests and answer keys published by the Department of Education;
- Provide individualized instruction for students who score at Level 1 or Level 2 on the FCAT or who are identified through diagnostic assessments as having deficiencies in the assessed content; and
- Include test-taking strategies in curricula for intensive reading and mathematics courses.

Senate Bill 1908 –Other Issues

Transitions to New Assessments
- Directs the Commissioner to establish procedures for transitioning to new assessments that impact the testing requirements for high school graduation
Testing Schedules - Beginning in 2010-2011
- Writing no earlier than the week of March 1 and other subjects no earlier than the week of April 15
- Statewide end-of-course assessments – within the last two weeks of a course
- Student test results reported by the final day of the regular school year for students

Senate Bill 1908 –Other Issues

End-of-Course Exams
- SB 1908 allows the Commissioner to incorporate end-of-course assessments into the statewide assessment program
- Current Plans Include:
  - Algebra II – Pilot in 2008-09 (Handout)
  - Other State Developed (Handout)
  - Other State Implemented – TBD

Senate Bill 1908 –Other Issues

Expanded Postsecondary Readiness Assessment for
11th graders
- Requires the evaluation of the college readiness of selected students prior to grade 12, beginning with the 2008-2009 school year, based on minimum college placement test scores determined by the SBE.
- High schools, to the extent practicable, must provide 12th grade students access to remedial instruction prior to graduation.
- Students achieving minimum scores upon exit from remedial instruction and enrolling in a community college within 2 years, will not be required to enroll in remediation courses.

Misc. Assessment Topics

Assessment Appropriation – Cut 30%
- Less Paper
- Fewer Products
- Move to more computer-based testing
MAP Clearinghouse
- Request for Application – Clearinghouse Management
- Invitation to Bid – Item Bank

FTCE/FELE Fees

January 1, 2009

Misc. Assessment Topics

Questions?

Next-Generation
Sunshine State Standards
Assessments and Interpretive Products

Vince Verges

Executive Director

Test Development Center

Topics

Test Development Center Staff Changes
Reading, Mathematics, Science, and Writing Updates
Interpretive Products
- Content Focus Report 2008
- Florida Reads! Writes! Solves! Inquires! CD
- Science Lessons Learned
- Released Tests
- Item Specifications for Grades 3-5, 6-8,
  High School
Other Assessment News
Questions

Staff Changes at the
Test Development Center

Lissa Cone, FCAT Writing Coordinator
Sheila Veatch, FCAT Writing Specialist

Mathematics Standards Update

Next Generation Standards
- Math standards were adopted in September 2007
- TDC Math Assessment Transition Crosswalk was released to district coordinators on June 4th
- New Assessment Timeline
  - Currently developing items to match the new item specifications for the new standards; will be reviewed by Item Review Committee in fall 2008; will become field test items for 2010 test
  - 2011 baseline year for new mathematics assessment

High School Mathematics Tests

At this time, FDOE is preparing an Algebra I End of Course (EOC) test and a Grade 11 Comprehensive test*.
Grade 11 test topics may include: Algebra topics related to number sense, concepts and operations; Discrete Math; Financial Literacy; Geometry; Probability; Statistics; and Trigonometry. The assessed benchmarks would be made available with the release of the FCAT Mathematics Test Item Specifications to be discussed later in this presentation. This test would not include performance tasks.

* Rule changes are being developed to address this effort to ensure that students are graduating with exposure to rigorous content outlined in the Next Generation SSS.

New Science Standards

Adopted by State Board – February 2008
K-8 grade-level standards grouped into four Bodies of Knowledge (BOK) which are subdivided into Big Ideas
High School standards organized by BOK
- The Nature of Science
- Earth and Space Science
- Physical Science
- Life Science

New Science Standards

The Office of Mathematics and Science developed a crosswalk showing the transition between the old and new benchmarks. Available at http://www.fldoestem.org/page362.aspx

The Office of Mathematics and Science in conjunction with Florida science educators revised the science course descriptions to match new standards (draft available at http://www.floridastandards.org/index.aspx)
State Board of Education is expected to review the proposed descriptions at their October meeting.

New Science
Assessment Timeline

2010 – 2011: last year for FCAT Science
2010 – 2011: field test new items written to new standards
2011- 2012: baseline (first) year of new standards assessment grades 5, 8, and EOC Biology
2012 – 2013: Standard Setting and reporting of achievement levels

High School
End-of-Course (EOC) Science Exams

At this time the Department is preparing to develop EOC for Biology (baseline 2011- 2012) and another science (baseline 2012- 2013)

New Science
Standards Assessments

Grade 5 and 8 Science Assessments will be comprehensive
- Grade 5 assessment will have items representing benchmarks for grades 3-5
- Grade 8 assessment will have items representing benchmarks for grades 6-8

New Science
Standards Assessment

Benchmarks are likely to be grouped or clustered by content and designated as annually assessed or content sampled
Florida Standards Content Advisory Committee began reviewing and making recommendations for assessment of new standards in April (follow up meetings are scheduled for September 2008 and
January 2009)

Released FCAT Science Test

2007 FCAT Science Grade 8 Test and
Answer Key
- Answer Key has percentage of students who answered correctly, option statistics for multiple-choice items, benchmark and content focus information, and the cognitive difficulty (cognitive complexity) for each item

Released Student Responses
for Grade 8 FCAT Science 2007
Extended Response Item

B131 – Golf Ball Energy from 2007 Released FCAT Science Test currently on DOE website
Scoring criteria (annotations) and student papers
- Example of a top-score response
- Three student examples of a 4-point response
- Three student examples of a 3-point response
- Three student examples of a 2-point response
- Three student examples of a 1-point response
- Two student examples of a 0-point response

Released Student Responses
for Grade 8 FCAT Science 2007
Extended Response Item

Will include letter explaining intent and use of student responses
FCAT Rubric for extended response
Reader Bias
Item Development and Handscoring Flowcharts
To be posted to ww.fass.cecs.ucf.edu
Fall 2008

FCAT Explorer

FCAT Explorer for grades 5, 8, and 11 are now available on DOE website

FCAT Science Lessons Learned

A look at student performance on FCAT Science 2003 – 2006
- Purpose is to provide guidance to educators that can be used to effect positive change and enhance program effectiveness
- Available in print late fall 2008

FCAT Science Lessons Learned

Includes Results by Cluster
- Mean percent correct for each reporting cluster for each year (2003 – 2006)
- Observations and information on what students are successful are able to do and what students have the greatest difficulty doing
- Sample items and performance statistics
- Suggestions for instruction

Language Arts & Social Studies Standards Update

Next Generation SSS Standards
- Language Arts standards will be
  revised again
  - SB 1908 states that plan for accomplishing this should be in place by Dec. 31, 2008
- Social Studies standards will be revised
  - At this time there is no plan for an FCAT in Social Studies

Language Arts
Sunshine State Standards

• December 31, 2008- Review and establish an expedited schedule for adoption of the Next Generation Sunshine State Standards.

Sunshine State Standards . . .

Specific requirements are prescribed for language arts, science, mathematics, and social studies standards.
December 31, 2011 – The Next Generation Sunshine State Standards must be adopted for each subject by the State Board of Education.
Language Arts standards that were adopted in 2007 must be reviewed and must identify significant literary genres and authors that encompass a comprehensive range of historical periods.

New Tests in Reading…

Last FCAT Reading Test - 2010
Field Test new benchmarks - 2010
New Assessment in Reading - 2011
Performance tasks at grades 4, 8, 9.
No Performance Tasks (PTs) at
grade 10
Retakes remain the same, no PTs

Proposed Graduation Progression

* Requirements for Grade 10, 2011 passing scores are still TBD.

** In Grade 11, the 2013 cohort would need to take an FCAT Retake because no Retake would exist for the new assessment yet. A policy for the Grade 12 students might include offering FCAT or new test retake.

Writing Update

Presently, writing as a graduation requirement has been delayed indefinitely.
Writing test multiple-choice items will be removed from test beginning in 2008-2009 due to budget and concerns over year-to-year linking of MC and essays in the current design.
New Writing Assessment in 2012-2013 will have MC, SR, and ER items in a way that provides stable links.
- New Writing Assessment will move to grades 4, 7, and 11
- Grades 7 and 11 are intended to be
  computer-based tests

When will FCAT Writing
be administered?

Field Test : December 2-3, 2008
Census Test: February 10-12, 2009
Tests will be given using unsealed Writing folders to avoid scanning errors

Writing Lessons Learned…

FCAT Writing Lessons Learned: 2001-2008 Data Analyses and Instructional Implications
Scheduled for delivery to districts in December 2009
PDF file posted To FDOE website after ADA compliance requirements - districts will be notified when it is available

Florida Reads!, Writes!,
Solves!, Inquires! CD

Delivered to Districts in July
Packaged and labeled for each school
Contains the released performance task for each grade and each subject
Includes general information about scoring, the FCAT rubrics, the actual test item, an example of a top-score response, anchor papers, qualification papers, and annotations (scoring notes)

Test Item Specifications

Appendix B for Reading and Mathematics to be released this Fall
Spring release of Next-Generation Assessments Reading and Math Test Item Specifications after 2009 testing

2008 FCAT
Content Focus Report

Now available on the DOE website
Has the benchmarks and content focus for each item that counted towards student scores on the 2008 FCAT
Has total points for each reporting cluster/category
Identifies the benchmarks that had performance tasks
Reading, Mathematics, Writing have old to new benchmarks crosswalks

2009 Sample Test Materials

Reading, Mathematics, and Science:
Reprints of ’08 materials
No Writing+ STM
Shipments to districts in early Nov. ’08
Per Legislature, delivery to schools should be after Jan. 1, 2009
PDFs posted to DOE website in Jan. ’09

Print Materials Delivery Times

FCAT Results Folder

Projected Product Delivery Timeframes

FCAT contractors already use eco-friendly production methods.
DOE is now actively promoting recycling.

DOE is going green!

FCAT Interpretive Products
On the Web

FCAT 2009 Nonscannable
Test Book Covers

FCAT Interpretive Products
Contact Information

Other Contact Information

Lyla Springfield, FCAT Reading Coordinator
springfieldl@mail.leon.k12.fl.us
Steve Ash, FCAT Mathematics Coordinator ashs@mail.leon.k12.fl.us
Renn Edenfield, Interim FCAT Writing Coordinator edenfieldr@mail.leon.k12.fl.us
Linda Oravetz, FCAT Science Coordinator oravetzl@mail.leon.k12.fl.us
Vince Verges, Executive Director
Test Development Center vergesv@mail.leon.k12.fl.us

Florida Alternate Assessment
District Assessment Coordinators Mtg.
September 3, 2008

The human brain starts working the moment you are born and never stops until you stand up to speak in public.

George Jessel

Inspirational Quote

2008 Standard Setting

Initial Standard Setting

April 7-11
- Field test data
- 14 standard setting panels
- Panels of special educators, general educators, administrators and parents
- Alternate achievement standards set for all grade levels and content areas

Initial Standard Setting

Using descriptors of Levels of Complexity and Performance Level Descriptors
- Panelists set cuts for Levels of Complexity (LOC)
- Panelists set Performance Level cuts within each of the LOCs

Standard Setting

What are the Performance Levels?

Basic: Students at the basic performance level have little success with the challenging access points
Proficient: Students at the proficient level are having some success mastering the access points
Advanced: Students at the advanced level are very successful with the access points
At each grade level and content area these are tied to specific access points measured on the assessment

Standard Setting Validation

July 15-18
- Operational test data
- Same procedures
- Panelists set Performance Level cuts within each of the LOCs
- Preliminary results under review

Standard Setting - Next Steps

State Board Rule under development
- Establishes the cut scores
- Out for comment in the Fall
Revision to performance level descriptors and labels based on feedback from standard setting and Technical Advisory Committee

2008 Results

Spring 2008 Administration

27,683 answer sheets scanned
- 3,616 not assessed for various reasons
- 734 duplicates or invalid bubble
- 126 cannot be scored in any content area
23,207 students have at least one valid content score

Spring 2008 Administration

Invalid Records
- Incomplete scoring within a content area
- Double bubbles
- Grade level and content area mismatch
- Invalid bubble filled in on document

Spring 2008 Administration

Districts Received
- Individual student reports
- School reports
- District reports

Student and Parent Report

Alternate Assessment Reading Participation

Alternate Assessment Reading Proficiency

Alternate Assessment Math Participation

Alternate Assessment Math Proficiency

Students with Disabilities Taking the Alternate Assessments

Spring 2008 - 1% Cap

Calculation
- Numerator = Number of SWD reported as proficient or advanced on Florida Alternate Assessment in grades 3-10
- Denominator = Number of students participating in an assessment in grades 3-10
Calculated separately for reading and mathematics
Calculated at the district level

Spring 2008 - 1% Cap

Decision Rules
- If district exceeds cap, students with a primary exceptionality of specific learning disability and no other exceptionalities are reverted to non-proficient
- Calculations are re-run
- If district still exceeds the cap, they may apply for a waiver

Spring 2008 - 1% Cap

Waiver consideration is given to districts who submit data in support of the following explanations:
- House multi-district programs for students with significant cognitive disabilities
- Are very small, such that a slight change in number of students produces a large change in percentage

Spring 2008 - 1% Cap

Waiver consideration is given to districts who submit data in support of the following explanations:
- House high-quality, research based programs for students with significant cognitive disabilities that attract families from around the state and country

Spring 2009 - 1% Cap

Districts will need to submit waiver requests by May 15, 2009
Decisions about waiver requests will be made prior to final AYP calculations

The more things change, the more they remain... insane.

Michael Fry and T. Lewis

Inspirational Quote

2008-2009 Activities

Train-The-Trainer

June 23 & 24
- Provided updated materials and information
  - Reading fluency items
  - Renaming of materials
  - Test book wording – Teacher will script
  - Four field test items per content area

Content/Bias Review

June 25 & 26
- Approximately 120 participants
- Panelists include content expects (general and special education teachers, and administrators
- New item review
  - Eight items per grade in Reading, Mathematics, and Writing
  - Twenty-five Items for Science based on newly approved standards

Item Specs for New Development

Reading
- Readability not to exceed 3 years below tested grade – maximum is 6th grade
- Addition of Reading fluency strand
  - Elementary – letter and word identification
  - Secondary – range from reading sentences to one to two paragraphs

Accommodations

Accommodations Workgroup
Met via conference call on August 13
- Approximately 25 special education teachers and administrators participated in one of three conference calls
- Developed recommendations for additional accommodations for VI, DHH, ASD, MH and ELL students

Web-Base Ordering

Available through Piedra Data Services website
- Braille and tactile graphics for students with visual impairments
- One sided response booklets
  - One sided materials will allow teachers to cut out items to have flexibility in item placement

Web-Base Ordering

Available September 4-17, 2008

www.piedradata.com/VIS/Login.php

Practice Materials

Released items from Spring 2008 administration
Delivery to school district alternate assessment coordinators week of September 8th
Includes two items per content area and grade

Practice Materials

All grades and content areas packaged together
- Test Booklet
- Response Booklet
- Passage Booklet
- Cards Packet
- Strips Packet

Administration Manuals

Teacher administration manuals will be delivered along with practice materials to school district alternate assessment coordinators
Teachers should keep their binders and replace contents

Science Field Test

Administration window –
October 13 – 24
Demographics for student participation e-mailed to AA Coordinators in July
25 new items based on approved Sunshine State Standards Access Points

2009 Assessment

Administration Window
- January 12 through February 27
Assessment now has two forms (Form A and B)
- Each form will have 16 core items and four embedded field test items per content area for a total of 20 items

Project to Support Instruction

Discretionary project to support teachers in curriculum/instruction and support implementation of alternate assessment
Steering committee met in July to identify and prioritize needs
- National Inclusive Large Scale Standards and Assessment (ILSSA) Project assisting us

I am easily satisfied with the very best.

Winston Churchill

Inspirational Quote

Peer Review Status

Peer Review

July, 2008 submission
- Results from April standard setting
- Individual, school, and district reports
- Planned studies
Waiting for response letter

Peer Review

Plan for December, 2008 submission
- Final standard setting results and cut scores
- Technical Manual
- Alignment study report

Peer Review

Planned studies
- Alignment – Fall 2008
  - UNC Charlotte – Links to Academic Learning Model
- Reliability - Spring 2009
  - Videotapes of 2009 administrations independently scored
  - Classroom walk through tool development
- Validity – Spring 2009
  - Teacher judgment and assessment performance

Not a shred of evidence exists in favor of the idea that life is serious.

Brendan Gill

Inspirational quote

Thank you
Bambi Lockman, Bureau Chief
Bureau of Exceptional Education and Student Services

Reminder

Those districts participating in NAEP 2009 need to pick up their Resource Binders at the registration counter during the lunch break.

Scoring and Reporting

Jackie Mueller

Director

Data about the 2008 FCAT tests

Number of students with test scores reported
- 1.77 million
Number of individual tests scored and reported
- SSS - 4.4 million
- NRT - 3.1 million
Number of Spring 2008 Retake students passing after manual rescore process completed
- 3 Reading and 20 Math
- Summer 2008 – 4 Math

Data Verification Processes

Validation of scoring
Analyzing data to detect scoring anomalies.
We spend a large amount of our time trying to chase down correct information for a small portion of the students who tested
- Resolving duplicate testers
- Virtual School Students in correct schools
- Correcting SIDs

Common Test
Administration Problems

Examples
- Use of label with incorrect grade information => Off-grade level testing flag - Score Reported Flag of 7
- Incorrect use of label; with hand-gridded information for different student=> duplicate records – Score Reported Flag of 6
- Missing or incomplete hand-gridding=> missing SID, Name, Grade, other important information
- Testing in two separate documents => Does not meet attemptedness - Score Reported Flag of 2
- Missing test group code information => May require holding more students than necessary for investigations if this is missing

Fair Warning –
We are Trying to Reduce
Time until Reporting

Off-Grade Level Testers NR7: In years past we have attempted to clean these up prior to reporting. We can no longer commit to trying to do that. It will be up to districts to check to see whether these students really tested in the correct grade level and should be reported. This should be one thing you check as soon as you receive your DSR.
Example from this year: We attempted to have districts supply missing SIDs when the SIDs were completely blank. This netted in our attempting to update about 7,700 SIDs. We will not be doing this again. Due diligence on the part of districts should be able to minimize this problem. We will check into whether we may be able to give districts early warning about which students have missing SIDs so they can be ready to update the accountability files.

Reporting

Posting DSR files to Navigator
Posting summary files to Navigator
Posting .pdf files of reports
Printing limited to
- Individual Student Reports
- School Lists of Students
- Grade 10 and Retake Results Labels
- Certificates of Achievement

Fall 2009 Retake

Results Delivery Target
- November 21, 2008
- Due in District (DID) – November 26, 2008

2009 Reporting Targets

Results Delivery Targets
- Writing
  - May 7, 2009 and DID May 14, 2009
- Spring Retakes
  - May 7, 2009 and DID May 14, 2009
- Reading and Mathematics Grade 3
  - May 18, 2009 and DID May 26, 2009
- Reading and Mathematics Grades 4-10
  - May 29, 2009 and DID June 05, 2009
- Science Grades 5, 8, and 11
  - May 29, 2009 and DID June 5, 2009

Scoring and Reporting Issues

New Demographic Website
- Beginning with three years of data
- Will eventually expand to cover years 2000-2008
- Similar features to the old website
Old website will be active until November 2008
- Years 2000-2007

New Demographic Website

New Demographic Web site Screen Shots

Jackie Mueller, Director

850-245-0775

Mario Zuniga, Supervisor

850-245-9059

Contact Information

FCAT Scoring Inquiry System

Mario Zuniga

Supervisor

Overview

FCAT Scoring Inquiry System TA Paper (Draft)
- Types of Score Inquiries
  - Score Anomalies (Desk Audits)
  - Not Reported Scores
  - Missing Scores
- Procedures for Submitting Score Inquiries
New Web-Based System
- Implementation Time-Line
- Screen Shots of System
- Contact Information

Technical Assistance Paper

Types of Score Inquiries
- Score Anomalies (Desk Audits)
  - Is poor performance by itself an anomaly?
  - Criteria for automatic audit and manual rescoring of Retake scores
    - Within 25 scale score points of passing
  - Anomalies are red flags based on previous student trends or large difference in performance compared to other measures
    - May represent a bad assessment day for the student
    - Investigated by staff to eliminate possible scoring errors or student bubbling errors

Technical Assistance Paper

Types of Score Inquiries (continued)
- Not Reported (NR) Scores
  - RMS Codes on Individual Student Report
    - NR2: Did not meet attemptedness
    - NR3: Marked as “Do Not Score”
    - NR6: Recorded as duplicate record
    - NR7: Grade mismatch
    - NR8: Invalidated/held by FDOE for further review
  - Writing Codes on Individual Student Report
    - A: Blank answer document
    - B: Off-topic
    - C: Illegible, Incomprehensible, or Insufficient Writing
    - D: Foreign Language
    - U: Response Unscorable

Technical Assistance Paper

Types of Score Inquiries (continued)
- Missing Scores
  - Student is shown as present on the school’s attendance record – but is shown as Not Tested (NT), or is not shown at all, on score reports
Procedures for Submitting Score Inquiries
- Score inquiries should not be submitted for
  Not Reported scores
- Score inquiry submission deadlines established for each administration
- Score audits require additional documentation

New Web Based System

System Walk-Through Ongoing
- FDOE Review
- District/Contractor Beta-Test
Roll-Out Timeline
- Goal is to have this system available for the Fall 08 Retake administration
  - Sept/Oct – Beta Test
  - Early Nov – Final Design Approved
  - Late Nov
    - Districts provided User ID/Passwords
  - System live by November 26, 2008

New Web Based System

Benefits
- Available through secure FDOE web site
- System tracks inquiry FDOE and Contractor response time
- Auto-assigned tracking number
- Real-time status check available to districts
- Individual or batch submissions available
- Score audit documentation kept on file at district level
- Auto-assigned to FDOE specialist
- Eliminates FAX handling and manual tracking
Risks
- Resistance to change
- Score audit documentation filed in the district
- User ID/Password security

Screen Shots of Web Based System

Logon Screen

- Email address for user name
- User reset password
- One logon per district

Screen Shots of Web Based System

Main Menu for District Use

Screen Shots of Web Based System

Main Menu for District Use

Screen Shots of Web Based System

Contact Information Form

- Maintain District Coordinator of Assessment Contact Information
- Potential to Update other FDOE ‘Rosters’ from this Information

Screen Shots of Web Based System

Main Menu for District Use

Screen Shots of Web Based System

K-12 Missing Score/Desk Audit Inquiry

Drop Down Menus

Screen Shots of Web Based System

Main Menu for District Use

Screen Shots of Web Based System

Submit a Batch File of Inquiries

Excel Files Only – File Format will be provided.

Screen Shots of Web Based System

Main Menu for District Use

Screen Shots of Web Based System