Co-written by David Castillo and Peter McIntosh
Most math education analyses in urban high school classrooms focus on delivery of content: What content to deliver, when to deliver it, how to explain it, what textbooks to use, how much home work to assign, and more. As reform efforts have shifted to technology and online learning, we are still asking questions about content delivery in a different context: How to automate it, individualize it, manage it remotely, and deliver it without killing trees.
Improving content delivery helped, but not enough
Oakland Unity High School is a four-year (grades 9-12) public charter high school located in the tough urban neighborhood of East Oakland. Approximately 95 percent of students are Latino or African-American and 85 percent receive free or reduced lunch.
In the summer of 2010, we conducted a diagnostic test with all incoming freshman to evaluate basic algebra and arithmetic skills. The results were astounding; most students needed to retake an Algebra Readiness or Algebra 1 course. In doing so we saw an improvement in proficiency scores, but it wasn’t enough.
The number of students scoring below basic (approximately score of 40 percent) decreased from 77 percent to 28 percent. The number scoring above proficient (approximately score of 60 percent) increased from 9 percent to 32 percent. We decided to then dive further into what was causing low student performance.
By any reasonable criteria none of the answers to the old questions worked. At Oakland Unity High School in Oakland, Calif. we decided it was time to ask a new question: Are the academic and personal habits of students at the root of performance obstacles in math education?
Poor learning habits revealed the core problem
Through close observation and student interviews, we found that students failed to engage in the coursework and spent little to no time studying. Students were disengaged from their learning responsibilities and the derailing of their studying began as early as elementary school.
Early on, students struggled and faced constant frustration on a series of topics: long division, fractions, negative numbers, and word problems. This discouraged students and led to a decreased interest in engaging in the classroom or completing homework. Yet the bar of expectation and demonstration of competency was low. Students still continued on to the next grade in a one-size-fits-all educational approach despite their lack of knowledge and understanding around basic algebraic concepts.
We concluded that the real problem was making those poor habits an excuse for the wrong initiatives. Instead, we should make those bad habits the target of better initiatives. We then looked to Khan Academy as a popular solution worth testing.
Khan Academy offered solutions with real results
In September 2011, we implemented a rotation blended learning model with a Khan Academy learning lab for all students enrolled in an Algebra Readiness or Algebra 1 course to close a “learning and confidence” gap with the students.
When we stopped worrying about whether Khan Academy videos were better than our own lectures or whether the exercises had the appropriate mix of concept vs. drill, we recognized that we had found a powerful tool that reached students and changed their habits in ways we had never even considered possible.
As we studied student interaction with Khan Academy, we began to see important changes in how students reacted to mathematical challenges.
Early results proved encouraging
With the help of Khan Academy, we found early results very encouraging. This year’s Algebra Readiness and Algebra 1 students scored consistently higher on solving equations, absolute value and the first semester final exams. That margin grew substantially for the most rigorous test on systems of equations (from 37 percent to 74 percent). This suggested that improved habits through the Khan Academy approach were creating real improvements among students. This evidence of superior performance was reinforced by the increased portion of scores above 80 percent on all of the tests.
Adapting study habits made the difference
Many Khan Academy features increase the quality and quantity of practice work among our students:
- Most exercises are not multiple-choice, which eliminates guessing
- Questions are randomly generated, which eliminates copying
- The short video clips engaged students and allowed them to replay the material until they understood it; and
- The online environment and Khan Academy’s overall design appeals to the students, resulting in significant engagement time.
Students completed the Khan Academy exercises, finished written homework, paid attention in class and gained confidence to approach challenging problems. We truly believe that the Khan Academy approach met student’s learning needs in order to deliver real learning in math proficiency.
Snapshot of Unity High School
By most measures we have had great success. Our API (Academic Performance Index) has grown steadily since 2007, from 595 to 735 this past year. Nearly 90 percent of students regularly pass the CAHSEE (Mathematics) in sophomore year, with 70 percent of students scoring at or above the proficient level of 380.
By these traditional measures we are the highest performing four-year public high school in Oakland. Several other schools perform higher, but have the advantage of starting with students in middle school or even elementary school. Nearly 85 percent of our incoming freshmen attended Oakland public schools.
More than 90 percent of students go on to college: 70 percent to a four-year college and 90 percent will be the first in their families to attend college.
David Castillo is the Principal at Oakland Unity High School where he researches, promotes and leads the implementation of technological tools that provide real-time data and individualized learning programs.
Peter McIntosh, a math teacher at Oakland Unity High School, has worked at the Oakland pubic schools for four years. Prior to teaching, he was a consulting partner for PriceWaterhous and later an Executive Vice-President of Operations and Call Centers for Charles Schwab.
Follow David and Peter on Twitter at @OaklandUnityHS.