Stop Worrying About Shanghai, What PISA Test Really Tells Us About American Students

Sputnik replica
Sputnik replica

The latest results from the Program for International Student Assessment (PISA) are public, and already some pundits are declaring it “a Sputnik wake-up.” Others shout back that international comparisons aren’t valid. Rather than wade into that debate, I’d rather look more closely at the questions in the PISA test and what student responses tell us about American education. You can put international comparisons aside for that analysis. 

Are American students able to analyze, reason and communicate their ideas effectively? [Think Common Core standards] Do they have the capacity to continue learning throughout life? Have schools been forced to sacrifice creative problem solving for “adequate yearly progress” on state tests? For more on that last question see my post “As NCLB Narrows the Curriculum, Creativity Declines.” 

PISA provides some answers to those questions and offers an insight into the type of problem solving that rarely turns up American state testing. FYI: PISA is an assessment (begun in 2000) that focuses on 15-year-olds’ capabilities in reading literacy, mathematics literacy, and science literacy. PISA assesses how well prepared students are for life beyond the classroom by focusing on the application of knowledge and skills to problems with a real-life context. For more examples of PISA questions and data click here. 

Do American students learn how to sequence or simply memorize sequences

Here’s one insight into what American students can (and cannot) do that can be gleaned from the 2003 PISA test results. We spend a lot of time in school getting students to learn sequential information – timelines, progressions, life cycle of a moth, steps for how to. Typically the teacher teaches the student the sequence and the student correctly identifies the sequence for teacher on the test. Thus we treat a sequence as a ordered collection of facts to be learned, not as a thinking process for students to use.  This memorization reduces the student’s “mastery” of the chronology to lower order thinking. I was guilty of this when I first started teaching history “Can someone give me two causes and three results of WWII?” 

Sample sequencing problem from PISA

The Hobson High School library has a simple system for lending books: for staff members the loan period is 28 days, and for students the loan period is 7 days. The following is a decision tree diagram showing this simple system:

Pisa-1

The Greenwood High School has a similar, but more complex library lending system:
All publications classified as “Reserved” have a loan period of 2 days.
For books (not including magazines) that are not on the reserved list, the loan period is 28 days for staff, and 14 days for students. For magazines that are not on the reserved list, the loan period is 7 days for everyone.
Persons with any overdue items are not allowed to borrow anything. 

Task

Develop a decision tree diagram for the Greenwood High School Library system so that an automated checking system can be designed to deal with book and magazine loans at the library.  Your checking system should be as efficient as possible (i.e. it should have the least number of checking steps). Note that each checking step should have only two outcomes and the outcomes should be labeled appropriately (e.g. “Yes” and “No”).

Student Results

Only 13.5% of US students were able correctly answered the question. Does it really matter if students in Shanghai did any better? (The student results were rated on a rubric scale.) 

When students are asked to observe a process and develop a sequence they have an opportunity to use a full spectrum of higher-order thinking skills – they must recognize patterns (analyze), determine causality (evaluate) and then decide how they would communicate what they’ve learned to others (create). Sequencing can be taught across the curriculum at a variety of grade levels – we simply have to ask the students to observe and do the thinking.

In case you’re wondering,  correct response should look like this.
Click image to enlarge.

pisa answer
pisa answer 
 

Image credit/ NASA
 

How Does A School Foster Hope?

One of the best aspects of my work is that I get to meet many talented educators. I’m on the road this week, and I invited two of them to do guest posts. This second post is by James Steckart, Director of Northwest Passage High School. I met Jamie this past summer at the Project Foundry unConference.

~~~~~~

“Hope… which whispered from Pandora’s box after all the other plagues and sorrows had escaped, is the best and last of all things.”
~
 Ian Cadwell (The Rule of Four)

Portage We can disagree whether hope is the best of all things, but let us suppose for a moment that Cadwell speaks the truth. What does hope give the student, the teacher, the parent, the community? Most parents wake up and hope that the lives of their children are better than theirs, whether they live in poverty or in opulence. The community hopes that its members contribute in some positive way to the better of the whole. Most children when they grow have real meaningful dreams of hope. Finally, most teachers hope that their work contributes to the healthy development of the students in their charge.

This concept of hope is common sense, yet most schools do not understand how they can produce hopeful students. In fact for a majority of students working their way through the a conventional school system, I would argue and data we have would suggest that their overall hope disposition decreases with the more time spent in school. Why would anyone stay in a place where their dreams, questions, and hope are called into question and disparaged?

Let’s look at a school where the concept of hope is front and center. At Northwest Passage High School (NWPHS) the mission of the school is simple: Rekindling our hope, exploring our world, seeking our path, while building our community. Embedding hope into our mission statement, we sought a way to measure this concept to see if we were fulfilling our mission.

NWPHS is a small progressive charter school where half of the day students work with their advisor designing projects that meet state standards, and the other half of the day they are in small seminar classes focused on an interdisciplinary topic involving field research and working with community experts. In addition, the school schedules between 30-45 extended field expeditions to further enhance learning. In a typical year the students travel and conduct research in a variety of urban and wilderness areas throughout the United States and 2-3 select international sites.

Each fall new students to our school complete the Hope Survey for new students, and each spring every student completes the ongoing Hope Survey. The survey measures student engagement, academic press, goal orientation, belongingness, and autonomy and is administered through an internet browser.

This allows us to get a sense of how much and whether hope is being grown. For us the longitudinal data confirmed what we knew in our hearts about our philosophy and methodology of working with high school students. Our ongoing students last year had a high hope score of 50.74 out of 64 possible. What lessons has this given us to share with others?

  • First, hope is built when you give students choice and autonomy. At NWPHS, project based learning gives students real choice while they meet Minnesota graduation standards. We track their learning with a sophisticated project management tool called Project Foundry.  
  • Second, we focus on building positive relationships with youth. We do this through intensive field studies, advisories, and service learning.
  • Third, we have faith that students will learn when you help them develop short and long-range goals through the use of continual learning plans and student run conferences which include the student, their advisor and at least one parent. These conferences last 30-45 minutes, and the student leads the discussion on their progress using their continual learning plan as the guide.
  • A student devoid of hope is a shell of a human being. They walk around listlessly living each day by the seat of their pants. Our job as educators, parents and community members it to instill a respect of these students and provide opportunities for hope to flourish.

Image: James Steckart

Need an Election Lesson? Let Student Gerrymander Like a Politician

The_GerryMander Most history and government students learn about Gerrymandering – the re-drawing to legislative districts to favor a specific political party. Gerrymandering at Wikipedia.

The 2010 elections will have a major impact on the shape of congressional and state legislative district across the country. Instead of simply telling your students about the impact of the elections – why not give them the chance to gerrymander their own district. 

Link to Gerrymandering lesson

I used this lesson for years with my students and they came up with some remarkable legislative districts that varied greatly based on which party they   were trying to promote. And of course they developed their own understanding of the process, political implications and meaning of gerrymandering.

For more of my history and social studies lessons click here. Let your students be the historian with document based questions

Image from Wikipedia  -  First printed in March 1812, this political cartoon was drawn in reaction to the state senate electoral districts drawn by the Massachusetts legislature to favor the Democratic-Republican Party candidates of Governor Elbridge Gerry over the Federalists. 

Watch Problem Based Learning in Action: Apollo 13

This fall I’ve had the opportunity to lead many teachers on classroom walkthroughs in schools across the country. My approach is a “roving Socratic seminar” that uses brief glimpses of learning as a discussion starter for educators to reflect on their craft. For more on my walk through technique see my blog post  ”Teacher-Led Professional Development: Using Classroom Walk Throughs

apollo

One topic that always comes up on walkthroughs is something to the effect “… but don’t you have to teach the basics first,  before you can expect students to be able to think at higher levels?” There’s a persistent assumption that Bloom’s taxonomy is a one-way street. Analysis, evaluation and creation can only take place after a solid foundation of basics have been “installed” into the student’s knowledge base.

While our students have been conditioned to “learn the basics – then solve the problem,” that’s not how life always works. Most often we are confronted with problems that force us to go back and discover underlying foundational elements. Car won’t start… now what? 

Watch an infant getting into everything in the kitchen and you’ll realize that  kids are flexible learners, capable of moving fluidly between the basics and the problem. Every time our students play a new video game they confront a new environment with a unique set of interactions constrained by rules. Most often they have to discover how the game is played in a manner that mimics the scientific method – developing and testing hypothesis against their growing understanding of rules, functions, obstacles, rewards that underly the process of the game. Problem first, then basics.

When designing a lesson, teachers need remember that Bloom’s taxonomy is not a one-way street. It has multiple pathways and entry points – knowledge can be put into practice in a problem and a problem can be used to generate a body of knowledge. 

Need a good example of problem-based learning in action? Use this scene from “Apollo 13” as your walkthrough discussion starter. As you watch the clip think about the interaction of the problem and the basics.

  • Situation: An explosion forced the crew to shut down the command module and use the lunar module as a “lifeboat.” 
  • Problem: They needed to jury-rig a carbon dioxide filtering system for the lunar module.
  • Understanding the basics: What’s available aboard the space craft and how can it be used to modify the filtering system? 

 

Curriculum for Excellence – Educational Policy That Values Students and Trusts Teachers

Curriculum for Excellence
Curriculum for Excellence

American education has been hijacked by policy makers who don’t trust teachers, unions that are over-protective of job security, a private sector eager to privatize, and a standardized testing regime that rewards test prep over genuine learning. In the middle of it all, bored students disconnect from school as they realize that their main function is to be trivialized into a source of data for adults looking for someone to blame.

While America educational leadership offers hollow sound bites about life-long learning, Scotland’s Curriculum for Excellenceoffers us insight into what American kids are missing. This video produced by the Scottish program offer a quick introduction to three project-based approaches. Here’s two quotes from the video that say it all:

~ A student,  ”When you’re just copying a text book … you’re looking at results which people have already achieved and proved their work…  but when you doing it yourself you get an idea of how things work … and what you actually need to make things successful.”

~ A teacher,  ”In this approach … your not teaching the subject in isolation – your teaching in a much more natural way … with greater depth and more enrichment… there’s an accessible point for every child in the class and they can build on that and take it in directions of their own personal interests.”