|Text Index||Custom Search|
Independent Review of 2010 FCAT Results
Advisory Committees on Assessment and Accountability
- Overview (PDF, 28KB)
September 29, 2010
10 am – 2 pm
Atlantic Coast High School
9735 R.G. Skinner Parkway, Room #330
Jacksonville, FL 32256
- Assessment and Accountability Advisory Committee (PDF, 17KB)
- Technical Advisory Committee (PDF, 10KB)
Florida's school districts and teachers have done a tremendous job over the years in increasing the overall level of achievement for our students. Previous FCAT results and nationally recognized assessments such as the National Assessment of Education Progress (NAEP) exemplify this growth in student performance.
Upon publication of the 2010 FCAT results last month, several school districts have requested further evaluation, specifically as it relates to the learning gains of the 25 percent lowest performing students throughout the state. Two independent auditors have since completed their reviews of this year’s FCAT administration and results and their findings are now available for your review within the Official Findings section below.
- Response to FADSS Press Release - Audit reports are responsive
- Statement By: Education Commissioner Dr. Eric J. Smith regarding the results of the additional independent audits of 2010 FCAT scores
Report from HumRRO
- Exploration of FCAT Equating and Its Impact on Student, School, and District Developmental Scale Scores for 2003 through 2010 (PDF, 1MB)
Report from Center for Assessment
- 2007-2010 FCAT Content Representation - Grades 4 and 5 Reading and Mathematics (PDF, 21KB)
- 2008-2010 Free-Reduced Price Lunch English Language Learners and Students with Disabilities (PDF, 87KB)
- 2009 Plots of Old vs. New Parameter Estimates in Reading (PDF, 2MB)
- 2010 Plots of Old vs. New Parameter Estimates in Reading (PDF, 2MB)
- Achievement on Field Test vs. Anchor Forms – Grades 3-10 (PDF, 15KB)
- Achievement on Field Test vs. Anchor Forms – Grade 5 Reading (PDF, 14KB)
- Analysis of Calibration Samples (PDF, 34KB)
- Analysis of Level Movement (PDF, 56KB)
- Conditional Standard Error of Measurement by Scale Score (PDF, 30KB)
- Conditional Standard Error of Measurement by Developmental Scale Score (PDF, 29KB)
- FCAT 2009 Reading Passage TCCs (PDF, 395KB)
- FCAT 2010 Reading Passage TCCs (PDF, 396KB)
- FCAT Mathematics Test Construction Curves 2007-2010 (PDF, 179KB)
- FCAT Reading Calibration Results Summary – Grades 4 and 5 – 2008-2010 (PDF, 41KB)
- FCAT Reading and Mathematics Test Content - Grades 4 and 5 - 2007–2010 (PDF, 4MB)
- FCAT Reading Test Construction Curves 2007-2010 (PDF, 177KB)
- FCAT Reading Trends in Scale Scores (PDF, 25KB)
- FCAT Scaling and Equating Roles and Responsibilities (PDF, 13KB)
- Level Composition – Lowest 25 Percent (PDF, 93KB)
- Math Pre-Equated TCCs (PDF, 393KB)
- Math Post-Equated TCCs (PDF, 333KB)
- Magnitude of Developmental Scale Score Change (PDF, 183KB)
- Math Conditional Standard Error of Measurement (PDF, 201KB)
- Mean Development Scale Score Gains (PDF, 44KB)
- Reading Conditional Standard Error of Measurement (PDF, 202KB)
- Reading and Mathematics Learning Gains Over Time (PDF, 115KB)
- Reading Pre-Equated TCCs (PDF, 395KB)
- Reading Post-Equated TCCs (PDF, 333KB)
- Relative Performance of Students by Free/Reduced Lunch Status (PDF, 56KB)
- Student Document Verification Processes (PDF, 28KB)
- Summary of Item Position Shifts for Anchor Sets (PDF, 55KB)
- Test Construction Checklist for FCAT Reading and Mathematics Test Construction (PDF, 27KB)
The Department has contracted with the Human Resource Research Organization (HumRRO) to evaluate the learning gains results of the lowest 25 percent of students. Their audit will focus on the test characteristics, score distributions, and changes in score distributions for FCAT reading and mathematics for Grades 3, 4, and 5 for the spring 2008 through 2010 administrations. The results of this analysis will be published as soon as they are available. Learn more by viewing the links below.
In addition, the Department is contracting with The National Center for the Improvement of Educational Assessment to conduct a thorough review of the test design, scaling, and equating with a particular focus on grades 3, 4, and 5 reading and mathematics for 2007 through 2010. The results of this in-depth analysis will be published as soon as they are available. Learn more by viewing the links below.
- View the contract (PDF, 147KB)
- Learn more about The National Center for the Improvement of Education Assessment
Lastly, prior to the release of the 2010 FCAT Results, the Department worked with the independent third party provider, The Buros Center for Testing to ensure the scores of this year's FCAT results are reliable and accurate. The Buros Center for Testing audits were previously completed and can be found by visiting the links below:
- Considerations on the Validation of the Scoring of the 2010 FCAT Writing Test – Buros Center for Testing (Word, 177KB)
- FCAT 2010 Grade 3 Reading: Scaling & Equating Validation Study - Buros Center for Testing (PDF, 105KB)
- FCAT 2010 Grade 10 Reading and Grade 11 Science: Scaling & Equating Validation Study - Buros Center for Testing (PDF, 166KB)
- Learn more about The Buros Center for Testing
School District Questions
Please click on the link below for the school districts that have submitted a request to the Department to review learning gains data for reading and mathematics.
What is a Learning Gain?
Since FCAT reading and math exams are given in grades 3 – 10, it is possible to monitor how much students learn from one year to the next.
Schools earn one point for each percent of students who make learning gains in reading and one point for each percent of students who make learning gains in math. Students can demonstrate learning gains in any one of three ways:
- Improve achievement levels from 1-2, 2-3, 3-4, or 4-5; or
- Maintain within the relatively high levels of 3, 4, or 5; or
- Demonstrate more than one year’s growth within achievement levels 1 or 2 (does not include retained students).
Special attention is given to the reading and math gains of students in the lowest 25 percent in levels 1, 2, or 3 in each school. Schools earn one point for each percent of the lowest performing students who make learning gains in reading and math from the previous year. It takes at least 50% to make “adequate progress” for this group. If a school has less than 50 percent of this group making gains, schools can still make “adequate progress” for the group if they demonstrate improvement over the prior year.
About School Grades
The Department of Education will release 2010 School Grades at 12:00 p.m. on Friday, Aug. 6. The results will be posted on the Department’s website at http://schoolgrades.fldoe.org/.