Basics on School Enrollment Methodology

This post comes from Kellie LaRue who knows her way around a spreadsheet AND statistics.

One item not directly in her post is her thought that for some schools that are underenrolled but also ended after-school childcare. Why not bring it back? Many parents would be ecstatic to have more choices. 

Kellie's Post

Greetings to the new folks trying to interpret SPS enrollment information. Here’s a little bit of information on how read (and not read) SPS’s crappy enrollment charts.

This is written mostly for the new people as it is far too easy to presume that SPS is using common vernacular when they are not. The chart can be found on page 27 of the January 25, Budget Work Session presentation.  Here is the version that was in the Seattle Times article. 

Basics on School Enrollment Methodology
SPS is using a common methodology that is used by the vast majority of school districts. As such, this information may be helpful for Bellevue families who are also trying to make sense of enrollment based closures.

Most school districts consider this methodology to be an enrollment projection. However, it is much closer to a stability analysis. It is most certainly NOT a modeled projection.

The presented enrollment data is based on three data sets:

* a rolling two-year average
* a rolling five-year average
* a rolling five-year average from five year's prior. 

Now to be fair, school enrollment tends to change slowly over time, so this methodology does work fairly well for many districts and in many circumstances. However, it does not work well, when there are large or swift external changes.  (Demographics, a pandemic, local employment shifts, major changes in assignment plans, or major change education options, services, etc)

This methodology completely failed Seattle when Seattle was one of the fastest growing cities in the US for a decade. This methodology also fails when you have a hundred year pandemic.

It should be self-evident that a two-year rolling average during a pandemic is not a very robust data set. Likewise, a five-year rolling average loaded with pandemic data is also not a very robust data set.

But here we are. This methodology is the common methodology and I have no reason to believe that the presented charts are based on anything else. This presumption is based on the simple fact that it would take time, energy and money to do additional modeling, as well as an outside consultant.

How NOT to Read the Crappy Charts
SPS enrollment chart presents “high, low and middle scenarios”. These labels are both redundant and meaningless. (Seriously, no middle line, needs to be labeled “middle,” ever.)

As the labels are so redundant, a reasonable person would easily read the chart as

high - optimistic - decline stops, stabilizes and maybe some growth
middle - status quo - no real change
low - pessimistic - continued decline

Do NOT read the charts like this. These are not “scenarios” they are rolling averages.

How to Read the Crappy Charts

Since the labels are meaningless, you need to do a bit of detective work to read the charts.

The Low number
I suspect that the “low scenario” is the 2-year rolling average. That number is extremely low with a 7,000 enrollment drop over and above the 3,600 pandemic era enrollment drop.

For the low projection to be accurate, SPS would continue to lose enrollment at the same rate as the prior two years. This seems highly improbable. That said, the low number of 42,000 is an extreme number that could drive a lot of the pressure to close schools.

The High number 

I suspect the “high scenario” is the five-year average from 5 years ago. This number is pretty stable and enrollment was fairly stable during the 2012-2017 school years.

This a very probable scenario if families returning to in person school, balances out overall lower birth rates.

The Middle number
I suspect the “middle scenario” is the most recent five-year average. This number shows continued enrollment decline. This scenario is also pretty suspect as two of the five years used for the average incorporate the pandemic enrollment drop.

Notes on the years represented in the chart
SPS is terrible about identifying the data sets used for any chart, on the chart itself. As such, one needs to be cautious any conclusions without validating the source data.

The chart does include the actual 2022-23 headcount. As such, it would be easy to presume the 10-year projections were updated to include this year’s current enrollment.

However, I strongly suspect, that is not the case. SPS generally updates the 10 year projections in March. SPS routinely makes big decisions about assignment plan and budget in January that is based on information from the prior enrollment year. My hunch is that this the normal process using outdated info.

The 2022-23 enrollment was about 300 students higher than projected, if those numbers were included, the decline of the low number should have bottomed out a bit more. On this chart, the slope of the low decline is nearly identical to the slope from the two-year pandemic decline.

That said, because of the law of averages, these charts are going to continue to be somewhat meaningless for the next several years. AND, knowing the data set is critical information and should always have been included on every chart.

The Bottom Line
These “projections” should not be the sole basis for school closures and/or concluding that SPS is looking at ten years of enrollment decline. The middle and low “scenarios" are highly suspect as they are extrapolated from pandemic enrollment shifts.

A far more nuanced approach is required. At a bare minimum, I would want to see two additional lines on this chart that would exclude the pandemic years.

A recent five-year average that excludes the pandemic, for example, using the 2015-2020 average. 

A “no change” or “straight roll up” number from the 2022-23 school year.

Best of luck to all the communities that are starting to organize.

Comments

NE Parent said…
Coming from SPS, without further details, these numbers are meaningless. As I have written before, when SPS was redrawing our neighborhood school boundaries, it used the census track boundaries drawn before I5 was built as the school boundaries and called it a data-driven process.

If I were a board member, I would demand the following of staff:
- The historical number of students in the District each year by grade.
- The historical number of students leaving the District each year by grade.
- The historical number of students joining the District each year by grade.
- The historical number of school-age children in Seattle each year by grade.
- Projected number of school-age children in Seattle each of the next five years by grade.

The District should put all of the above into a spreadsheet and make it available to the public. It shouldn’t take someone at the John Stanford Center more than a day to put this together.

From the above numbers, it would then be possible to calculate the historic capture rate of Seattle Public Schools of school-age children by grade in Seattle and to make assumptions about this rate going forward. It would also be possible to calculate how many students are leaving versus joining the District and to make assumptions about these numbers going forward. Then given projected Seattle demographic changes, current enrollment rates, projected capture rates, and projected leave/join rates, it would be possible to make some reasonable projections.

If anyone has any other ideas, I encourage you to post them here. Probably we, as the public, could put these numbers together. Then members of the public could make projections based on defined assumptions. Perhaps some board members would like to see those.

In other words, open-source the projections and have the community help.
NE Parent said…
Below is a link to 10 years of enrollment data for SPS in an excel spreadsheet. What's missing is census data.

Before COVID, first-grade enrollment had stabilized and actually increased in 2019-2020. So it's not really clear if there is an actual "demographics" problem with regard to the overall school-age population. Rather there was a big hit for 2 years during COVID at the same time Advanced Learning was taking a big hit. This "hit" is going to have to work its way through the system, which by itself means overall lower numbers.

This year 1st-grade enrollment was up by 250 students but has not recovered to pre-covid levels. Two more years of increases like this year, and it will be back to where it was in 2018-2019.

Kelly, please take a look.

https://docs.google.com/spreadsheets/d/1jYavYXKNSOTbrpiixapJ_GVilmxaduf2/edit?usp=share_link&ouid=118381078213649167010&rtpof=true&sd=true

Notice there are multiple "tabs". Should display even without excel.
Anonymous said…
It's the responsibility of the board to manage the future direction of the organization. This seems to never happen with any SPS board. I'm curious what SPS thought would happen when they closed schools then upon re-opening they forced vaccines and mask on students and teachers. Is it really a stretch to see and manage the possibilities?

same story
Juliette F said…
So… census data, pediatrician data, real estate & zoning/development data, childcare data, or even just basic surveying of families regarding younger siblings apparently don’t exist.

Or, more succinctly:
This stupidly flawed data has exactly one virtue: it’s easily legally defensible, and that’s the bar SPS loves to set and meet. :/

- J.
Anonymous said…
The last 4 years of enrollment data by grade are available in the P223 reports. Listed by school and at the end of each monthly report for the whole district.

https://www.seattleschools.org/departments/dots/data-reporting/enrollment-reporting-p223/

Also probably available in the Annual Enrollment Reports. Those are available from 2010-11 to 2021-22 here:
https://www.seattleschools.org/departments/enrollment-planning/enrollment-data/annual-enrollment-reports/

Almost too late to put in a public records request if you want anything older than that if the district has already quietly decided what it's going to do in terms of closures and consolidations and student assignment plans.

Skeptical Taxpayer
Anonymous said…
There is a confluence of factors resulting in this decline in enrollment. Declining student population is a minor part. Two other factors are: (1) the pandemic and (2) the misguided policy of addressing disparities by lowering everyone to the lowest common denominator are two big issues. The pandemic and SPS's poorly thought out response are now largely in the past. Unfortunately the dumbing down of SPS is in full swing.

We live in one of the most highly educated cities in the country. Of course kids from highly educated parents will likely themselves be academically inclined. By taking away advanced education, we are pushing more students away from SPS.

While these trends are falacious, SPS policies of dumbing down education is pushing them towards reality. Keep going this way and even the 'low' line will be too optimistic of a projection.

Pure idiocy. Vote out the board. They are shamefully incompetent.

BLUE SKY
Anonymous said…
Im always so impressed how smart and skilled District parents are!! Thanks for giving a platform Melissa.

A+
Outsider said…
The reasons for enrollment decline are an open secret. Anyone who doesn't know doesn't want to know. But sometimes yet another illustration is poignant, no matter how well you know already. The San Francisco Chronicle just published a story about a 13-year-old Ukrainian refugee who fled the war there, but then had to flee a SF middle school, and now dreams only of going back to Ukraine. You can't make this stuff up. Blogger doesn't seem to like links, but if you search google news for "san francisco ukraine refugee middle school" you will find it.

The excuses never end, and never will.
Anonymous said…
I'd sure like to see it be the policy of the Seattle School District to attract and retain families. Why not make our Superintendent's evaluation contingent on hitting the "high" mark on this project (at least)? (By the way, where is the Superintendent, anyway?) In order to start getting this in focus, how about posting the "Kindergarten Capture Rate" for every attendance area elementary school? This would help to start pushing to think about what schools can do to attract and retain families. Let's be proactive!

Emile

Popular posts from this blog

Tuesday Open Thread

Breaking It Down: Where the District Might Close Schools

Education News Roundup