Updates on Beacon Hill Testing Situation
Updates:
Info from the district:
- Title One and LAP money for Beacon Hill will not be affected by any outcome from this investigation.
- Numbers of students affected (The final state test data has been erased by OSPI.) Grade 3: 72, Grade 4:70, Grade 5:78 for a total of 220 students (this would include Director Blanford's child who was a 5th grader last year).
- Test scores are part of four items in the principals' contract for a bonus of up to $7500; test scores factor into discussions around teacher growth/improvement but are not used in "summative evaluation."
- The last test date was May 8. The tests were returned May 22.
- During that time, the testing booklets stored were stored in the extra custodian’s closet. That location was locked. Those with access were Principal, Assistant Principal, Family Support Worker and Custodians. (per my source, that is not accurate; more people than that had access to that storage area.)
- The district’s independent investigator is Curman Sebree. (My comment here is that apparently this investigator is not well-thought of by numerous district employees.)
- Re: chain of custody
The test materials arrive in sealed boxes at the school. The school’s designated Test Coordinator is responsible for storing them in a secure locked location with limited access by staff. The storage location and the names of any individuals with access to this location must be documented and submitted to the District Assessment Coordinator.
On the day of the test, the tests are distributed to the classrooms with an accounting of the number of tests that go to each teacher.
Following the test, at the end of test period (typically no more than 3 hours) the tests are returned to the secure location and checked-in by the School Test Coordinator. Tests are required to remain secure in the locked location until all tests have been administered, including make-up tests.
Once all tests have been completed and accounted for, the tests are hand delivered to the central warehouse by the School Test Coordinator. This is done by appointment with the District Assessment Coordinator who goes through a detailed process with the School Test Coordinator to ensure proper coding has been completed for all tests and all materials are sorted and processed properly for delivery to the test scoring company. The boxes are then sealed and labeled for shipping by the District Assessment Coordinator.
Going forward:
End of update
Andrew Medina, the Internal Auditor, gave a report last night that included the information about schools hanging onto test booklets for weeks. He said this audit finding had not been triggered by any event (i.e. Beacon Hill). Unfortunately, Mr. Medina did not say nor did any Directors ask what the window of time is to send back test booklets to OSPI (given the test window is about a month.)
I have a query to OSPI about this issue. They could only tell me that they have guidelines given to the districts but they are not anything beyond guidelines and districts make their own rules about where test booklets reside and how long schools should keep booklets. OSPI is also sending me dates for when test booklets have to be sent back to them.
I also learned that there were probably many more people who possibly had keys at Beacon Hill including staff other than teachers/administrators and employees of the on-site child care facility.
The custodian at the building was relatively new. When he found out that multiple people had keys and, he had the building rekeyed (at least parts including that storage closet which did not hold janitorial supplies). He told the principal that the Board policy was that he was to oversee key distribution and had to follow that policy.
I also learned that the principal at Beacon Hill is being considered for a new position at South Shore prek-8.
Will this turn out as the Garfield field trip incident? Nothing happened and no one at fault? Seems hard to believe but that may be the case.
Info from the district:
- Title One and LAP money for Beacon Hill will not be affected by any outcome from this investigation.
- Numbers of students affected (The final state test data has been erased by OSPI.) Grade 3: 72, Grade 4:70, Grade 5:78 for a total of 220 students (this would include Director Blanford's child who was a 5th grader last year).
- Test scores are part of four items in the principals' contract for a bonus of up to $7500; test scores factor into discussions around teacher growth/improvement but are not used in "summative evaluation."
- The last test date was May 8. The tests were returned May 22.
- During that time, the testing booklets stored were stored in the extra custodian’s closet. That location was locked. Those with access were Principal, Assistant Principal, Family Support Worker and Custodians. (per my source, that is not accurate; more people than that had access to that storage area.)
- The district’s independent investigator is Curman Sebree. (My comment here is that apparently this investigator is not well-thought of by numerous district employees.)
- Re: chain of custody
The test materials arrive in sealed boxes at the school. The school’s designated Test Coordinator is responsible for storing them in a secure locked location with limited access by staff. The storage location and the names of any individuals with access to this location must be documented and submitted to the District Assessment Coordinator.
On the day of the test, the tests are distributed to the classrooms with an accounting of the number of tests that go to each teacher.
Following the test, at the end of test period (typically no more than 3 hours) the tests are returned to the secure location and checked-in by the School Test Coordinator. Tests are required to remain secure in the locked location until all tests have been administered, including make-up tests.
Once all tests have been completed and accounted for, the tests are hand delivered to the central warehouse by the School Test Coordinator. This is done by appointment with the District Assessment Coordinator who goes through a detailed process with the School Test Coordinator to ensure proper coding has been completed for all tests and all materials are sorted and processed properly for delivery to the test scoring company. The boxes are then sealed and labeled for shipping by the District Assessment Coordinator.
Going forward:
State testing is transitioning to a new
computer based process in 2015 that will be much more secure. For the
few remaining paper-based state tests (e.g., MSP science, Algebra EOC,
Biology EOC), the District plans to institute the following
changes:
Provide each school with portable locked
storage unit that can be located in a secure room with limited access.
Only one key for the portable locker would be available to the School
Test Coordinator. No other staff would have access.
(This proposal has not gone through a budget approval process.)
Institute a new audit checklist that can be
used by District administrators to spot check schools before, during and
after testing to ensure all tests are secure and the test protocol is
followed during test administration.
Shorten the appointment window for returning
tests to within 1-2 days after the completion of testing. This will be
accomplished by hiring one additional full time staff member plus
seasonal part-time help to support a significantly
faster process for checking in completed tests.
End of update
Andrew Medina, the Internal Auditor, gave a report last night that included the information about schools hanging onto test booklets for weeks. He said this audit finding had not been triggered by any event (i.e. Beacon Hill). Unfortunately, Mr. Medina did not say nor did any Directors ask what the window of time is to send back test booklets to OSPI (given the test window is about a month.)
I have a query to OSPI about this issue. They could only tell me that they have guidelines given to the districts but they are not anything beyond guidelines and districts make their own rules about where test booklets reside and how long schools should keep booklets. OSPI is also sending me dates for when test booklets have to be sent back to them.
I also learned that there were probably many more people who possibly had keys at Beacon Hill including staff other than teachers/administrators and employees of the on-site child care facility.
The custodian at the building was relatively new. When he found out that multiple people had keys and, he had the building rekeyed (at least parts including that storage closet which did not hold janitorial supplies). He told the principal that the Board policy was that he was to oversee key distribution and had to follow that policy.
I also learned that the principal at Beacon Hill is being considered for a new position at South Shore prek-8.
Will this turn out as the Garfield field trip incident? Nothing happened and no one at fault? Seems hard to believe but that may be the case.
Comments
I recall this from the Frontline show that aired several years ago.
http://usatoday30.usatoday.com/news/education/2011-03-28-1Aschooltesting28_CV_N.htm
Eerily similar.
Chris S.
MS Parent
Chris -- I couldn't tell if you were being sincere or ironic -- but assuming sincere, I am curious as to what you think --
my understanding of erasure analysis (which is not extensive) is that it is (or can be, in egregious cases) pretty cut and dried. Not only are there lots of erasures -- but huge majorities of them go to changing wrong answers to right ones -- and there is a statistical norm for comparison that shows when you are way outside the norm -- i.e., when it can't have just been chance. If all that is true -- then don't we pretty much have a clear case of fraud -- and the only issue is -- we have no idea who committed it, and maybe will never know, if the numbers of keys, and the investigations of those holding them, leads to no clear answer? In that case, don't we clearly have test fraud -- and the "alleged" goes only to who did it?
Jan
"testing irregularities"
Which is how USA Today handled it in their story.
There used to be a matrix for middle school math placement that used a combination of MAP and MSP scores (from 4th grade). I can no longer find a link. Seems to change every year...
parent
"Melissa, MSP scores can't affect middle school [math] placement . . ."
parent,
I've been wondering the same thing too, and can't find the answer for our current fifth grader.
What will be the 2015-16 standards for middle school math placement at JAMS, Hamilton and Washington next year? Will they be the same at each school? And also, what are those standards this year?
Can anybody help?
She invariably does sham "investigations" which parrott the District's party line, doesn't bother to interview parties to events, refuses to ask critical questions and "loses" her notes. If an employee asks for a representative to accompany them to an interview, she simply writes up her version of events without interviewing the employee.
JUST how the District likes it.....
Thats how its done in a culture of lawlessness.
-sleeper
Nobody will even dare ask for one of the master keys back that have been given out inappropriately.
As a teacher, I would never put myself at risk like that even given the good intentions of those who did falsify tests to actually help children in the NY Times article.
I think they'll find a scapegoat for this. Time will tell.
so tired of it all
parent
Keep shining a light on it and it may at least pull back (like head lice) but it will take a full dose of the shampoo to really get it out.
Who wants scandal at Seattle Schools?
Algebra 1: MSP 525+, MAP 250+
CMP 3: MSP 476+, MAP 240+
CMP 2: MSP 426+, MAP 231+
CMP 1: not meeting above
HIMSmom
But since the MSP has been discontinued this year, what will the math matrix be for 2015-16?
Will it rely only on the MAP scores, or will it now include some number from that new test that sounds like a diet breakfast cereal, is it Smarter Balanced or something like that?