Achievement x Economic Disadvantage
CHICAGO PUBLIC SCHOOLS / 2023–24

School Scores in context.

Household income is the biggest factor determining whether students meet state math and language standards.1 2 3

Test scores leave out this context. A meaningful comparison asks whether students perform better or worse than income predicts.

DATA SNAPSHOTSpring 2024
SUBJECT
01 / EXPLORE

Across Chicago

AboveBelowmodel predictionNo data

Community boundaries: City of Chicago · Scroll or pinch to zoom

02 / UNDERSTAND

The underlying relationship

SchoolsRegressionActualPredicted
03 / COMPARE

Achievement above or below the model

Studentized residuals · ordered from highest to lowest

← Below predictionAbove prediction →
Approximate 95% sampling intervalWhat does the interval mean?

A higher or lower residual means higher or lower proficiency than the model predicts. The prediction is based on student economic disadvantage, which is strongly associated with academic achievement and is among the strongest predictors of differences in school-level test scores1 2 3. However, the residual still represents an association, not a direct measure of a school’s causal impact on student achievement or its overall quality.

04 / FOLLOW

One school over time

Select a school to see its residual history.

Loading historical residuals…

Zero = predicted performance. Positive residuals are above prediction; negative residuals are below. Each year uses that school year's income data and a separate regression for the assessment, level and subject. Bars, where available, show approximate 95% conditional sampling intervals. Points without bars have unavailable sampling intervals because tested counts are missing. Gaps are not interpolated: 2020 testing was canceled; the source has no 2017 SAT results. Changes reflect relative position within each year's model, not causal improvement or an equivalent scale across assessments.

Annual actual, predicted and residual values
BEHIND THE COMPARISON

A clearer comparison.
A still-limited model.

The difference between where a school should land, and where it does land, is exciting and illuminating. But it’s foolish to believe the school is responsible for the entire difference. Parents, families, neighborhood culture, and how screens are warping their heads matters more. A teacher can make a difference! But let’s not kid ourselves.

Can states, regions and tests be compared?

Comparison population: Chicago Public Schools. Select Statewide for Illinois IAR and SAT comparisons.

Illinois assessment standards apply to the results shown here. Each state sets its own assessment system and proficiency thresholds. The same percentage proficient in two states can represent different standards. Test changes within a state also break direct comparisons. Studentizing residuals does not turn these results into a common achievement scale.

Every model is tied to its source population, year, assessment, level and subject. A region filter and the population used for the regression are distinct choices; the current comparison population is named at the start of this section. Low-income measures retain their source definitions, which may differ between states and reporting systems.

The Illinois pilot imports the 2024 Report Card's separate IAR and SAT rates. Statewide IAR rankings use tested counts published by Education Data Center v3.1 from ISBE records. Grade counts must be exact, cover all expected tested grades, and reconcile to the Report Card rate within 0.11 percentage points. Missing, suppressed or inconsistent counts are excluded. SAT residual rankings are available without sampling intervals because verified tested counts are unavailable. Statewide IAR history covers 2023–2024; SAT history covers 2019 and 2021–2024. Each year uses its own income data and regression. Earlier IAR school aggregates remain unavailable: grade percentages cannot be averaged without valid weights. The 2023 outcome is aggregated from ISBE grade-level proficiency with verified EDC tested counts; rounding differs slightly from the 2024 published school rate. The Chicago view continues to use its matched CPS sources and annual models.

Illinois Report Card Data Library · 2024 assessment and income definitions

What are we comparing?

Spring 2024 : grades 3–8 for grade schools; grade 11 state standards for high schools. (English Language Arts) uses IAR ELA or the SAT section. is the equally weighted mean of the two proficiency percentages, not the percentage proficient in both.

The history chart shows , fitted separately by year, assessment, level and subject. Chicago grade school assessments cover 2015–2019 and 2021–2024; high school assessments cover 2015–2016 and 2018–2019 / 2021–2024 SAT. All eligible schools in each annual source enter the model, including schools absent from today's directory. A school serving both levels can enter each separate assessment . Search filters do not refit the models.

In the statewide view, income is the same-year published Illinois Report Card Low Income percentage. In the Chicago view, income percentages come from 's annual demographic reports, matched by school ID and school-year ending year: spring 2024 assessments use 2023–24 income counts. We measure as the percentage of enrolled students in these low-income counts. Demographics describe the entire school, while assessments cover tested grades. Changing reporting, participation and cohort composition can affect trends.

How is the residual calculated?

For each level and subject, fits proficiency = α + β × low-income percentage + ε. Each eligible school has equal weight. A school’s raw residual is actual minus predicted proficiency, in .

The externally studentized residual is tᵢ = eᵢ / (s₍₋ᵢ₎ √(1 − hᵢᵢ)), using a estimate that excludes that school and adjusts for . Zero is the fitted prediction; positive values are above it. The straight-line model may predict outside 0–100%; predictions are not clipped.

Name and school-type filters change what you see, not the regression. Models use all eligible schools of the chosen level within the selected comparison population. Grade and high school residuals are never ranked together. Program labels follow CPS’s school-level classification; a school can offer multiple admissions programs.

How do school size and uncertainty enter?

Tested-student counts drive approximate , propagated through the fitted regression and expressed on the studentized scale. Smaller tested groups generally have wider intervals. Rates of 0% and 100% use to avoid zero estimated uncertainty.

Intervals hold the studentizing denominator fixed. They are , not full confidence intervals for school effectiveness; they omit cohort, demographic, model-choice and student-dependence uncertainty. Combined uses the conservative maximum positive because student-level subject overlap is unavailable.

No is applied in this version. Studentization adjusts leverage; it does not itself adjust for enrollment. Avoid treating small differences or overlapping intervals as definitive rankings.

Sources, coverage and limitations

, missing or invalid rates, missing demographics, and known tested counts under 10 are excluded from fitting and ranking. Statewide SAT uses unsuppressed published rates when counts are unavailable; sampling intervals are then unavailable for the entire cohort. Schools without eligible data remain in the directory. Pre-K-only / other school levels are excluded. This is a historical snapshot, not a current admissions directory.

Historical source terminology: Some CPS reports label the income counts Free/Reduced Lunch (FRPL); others use Economically Disadvantaged. The model uses these published income counts.

Selection into schools, prior achievement, grade mix, disability, language, resources and other factors are not controlled. This exploratory model cannot identify why a school differs from its prediction. The 2024 snapshot avoids mixing the redefined 2025 performance standards with earlier rates.