Comprehensive English Language Learning Assessment (CELLA)

Assessment and Accountability

Annual Meeting

September 5, 2007

2007 Administration of CELLA – “Q/I” Facts

224,482 English language learners were assessed (unduplicated)
25,884 Not tested (Pre-ID file from Survey 7)
Majority of districts or a little over 97% participated (Only two districts did not – had no ELLs)
33,499 secure test documents still missing

(Test booklets, Listening CDs and DFAs)

CELLA Standard Setting

Conducted in Multiple Phases:

Educator Panel Workshop (2006 Results)
Reactor Panel Meeting (Recommendations from Educator Panel)
FDOE Staff Analysis of 2006 Impact Data used in Standard Setting; 2006 and 2007 Score Results
CELLA Policy Advisory Committee (ESOL and Assessment) to review and provide additional recommendation
Rule Development Workshops
Process for Modifying Consent Decree
Final Recommendation to Commissioner
Rule Adoption by State Board of Education

3rd Week of September: Completion of Data Analysis

1st Week of October: Advertisement of Rule Development Workshops

2nd Week of October: CELLA District Policy Advisory Committee

3rd Week of October: Three Rule Development Workshops (Tallahassee, Orlando & Miami)

2nd Week of November: Final Rule Development

2nd Week of January: Rule Adoption by State Board of Education

CELLA Standard Setting:
2007-2008 Timelines

OTHER 2008 KEY DATES:

Last Week of January - Dissemination of new rule, new AMAOs

February - Reporting new AMAOs to USDE

February - Technical assistance offered to districts

CELLA Standard Setting:
2007-2008 Timelines (cont’d)

2007 CELLA Administration

SURVEY RESULTS:

Too many test materials
The test is too long and very difficult to administer
More detailed training on administrative steps
Consistency is needed in all directions – Revised TAM caused problems
Align procedures with FCAT
Test too difficult for kindergarten students
Too much paper work
Too time consuming
Put student names on books or rosters
Return instructions need to be simpler

SURVEY COMMENTS – CAUSE FOR SOME CONCERN

Test administrator unable to respond to survey, not enough training
Test administrators that received no training and were confused on how to administer test
Not all test administrators trained – training should be provided to all that are administering test
Reading listening scripts at a slower pace so “students can more successfully answer questions”
Surprised by the difference in test questions from 2006 test compared to the 2007 test
Unable to test all students – only given one day to test all ELLs at 3 different schools
Use of Locator Test was “Too Confusing”; Received no training

2008 CELLA Administration

2008 TESTING WINDOW

April 23, 2008

May 25, 2008

KEY DATES

September 20, 2007: District Volume Determination (Based on September Count)
January 11, 2008: Survey 7 Due (Pre-Identification Files)
January 8 – 11, 2008: Regional Training (1st Week)
January 16 – 22, 2008: Regional Training (2nd Week)
January 21 to 25, 2008: Shipping of Training Materials to Districts

KEY DATES (cont’d)

March 15 to April 14, 2008: Delivery of Testing Materials
April 1 to April 14, 2008: PreID Labels Shipped to Districts
April 30 to June 9, 2008: Return of Testing Materials; Scoring begins
July 8 to July 21, 2008: Score Reports Shipped to Districts

Training Locations:

Broward, Dade, St. Lucie, Tampa, Orlando, Clay & Washington

Training Agenda:

Morning – CELLA Testing Program Administration

Afternoon – CELLA Test Administration

IMPROVEMENTS:

Addition of DO NOT SCORE & UNDO DO NOT SCORE to Answer Document
Revise Level A Student Book to clearly designate where the core stops and the extension begins
Revise Cover for Level A Reading/Writing Test Book to Clearly Identify use for Functional Level Testing

IMPROVEMENTS (cont’d):

Updating Shipping Algorithms for Training Materials and Test Materials
Revise/Clarify Packing, Shipping and Returning materials Instructions