Category: Commentary

Posted on

Stop Worrying About Shanghai, What PISA Test Really Tells Us About American Students

Sputnik replica
Sputnik replica

The latest results from the Program for International Student Assessment (PISA) are public, and already some pundits are declaring it “a Sputnik wake-up.” Others shout back that international comparisons aren’t valid. Rather than wade into that debate, I’d rather look more closely at the questions in the PISA test and what student responses tell us about American education. You can put international comparisons aside for that analysis. 

Are American students able to analyze, reason and communicate their ideas effectively? [Think Common Core standards] Do they have the capacity to continue learning throughout life? Have schools been forced to sacrifice creative problem solving for “adequate yearly progress” on state tests? For more on that last question see my post “As NCLB Narrows the Curriculum, Creativity Declines.” 

PISA provides some answers to those questions and offers an insight into the type of problem solving that rarely turns up American state testing. FYI: PISA is an assessment (begun in 2000) that focuses on 15-year-olds’ capabilities in reading literacy, mathematics literacy, and science literacy. PISA assesses how well prepared students are for life beyond the classroom by focusing on the application of knowledge and skills to problems with a real-life context. For more examples of PISA questions and data click here. 

Do American students learn how to sequence or simply memorize sequences

Here’s one insight into what American students can (and cannot) do that can be gleaned from the 2003 PISA test results. We spend a lot of time in school getting students to learn sequential information – timelines, progressions, life cycle of a moth, steps for how to. Typically the teacher teaches the student the sequence and the student correctly identifies the sequence for teacher on the test. Thus we treat a sequence as a ordered collection of facts to be learned, not as a thinking process for students to use.  This memorization reduces the student’s “mastery” of the chronology to lower order thinking. I was guilty of this when I first started teaching history “Can someone give me two causes and three results of WWII?” 

Sample sequencing problem from PISA

The Hobson High School library has a simple system for lending books: for staff members the loan period is 28 days, and for students the loan period is 7 days. The following is a decision tree diagram showing this simple system:

Pisa-1

The Greenwood High School has a similar, but more complex library lending system:
All publications classified as “Reserved” have a loan period of 2 days.
For books (not including magazines) that are not on the reserved list, the loan period is 28 days for staff, and 14 days for students. For magazines that are not on the reserved list, the loan period is 7 days for everyone.
Persons with any overdue items are not allowed to borrow anything. 

Task

Develop a decision tree diagram for the Greenwood High School Library system so that an automated checking system can be designed to deal with book and magazine loans at the library.  Your checking system should be as efficient as possible (i.e. it should have the least number of checking steps). Note that each checking step should have only two outcomes and the outcomes should be labeled appropriately (e.g. “Yes” and “No”).

Student Results

Only 13.5% of US students were able correctly answered the question. Does it really matter if students in Shanghai did any better? (The student results were rated on a rubric scale.) 

When students are asked to observe a process and develop a sequence they have an opportunity to use a full spectrum of higher-order thinking skills – they must recognize patterns (analyze), determine causality (evaluate) and then decide how they would communicate what they’ve learned to others (create). Sequencing can be taught across the curriculum at a variety of grade levels – we simply have to ask the students to observe and do the thinking.

In case you’re wondering,  correct response should look like this.
Click image to enlarge.

pisa answer
pisa answer 
 

Image credit/ NASA
 

Posted on

The Classroom is a Factory, But What’s the Product?

This morning I read Bob Barsanti's powerful commentary "The Classroom Is Not a Factory" Education Week (12/1/10). 

"Everything I needed to know about modern teaching, I learned in a factory. In the summer of my 18th year, I made plastic drink stirrers on the night shift at Spir-It Inc…. Many of the current reforms in education aim to turn the schoolhouse into that plastic-products factory. .. The machinery heats and molds our children, then stamps, bags, and packages them to a professional uniformity."

Lewis Hine

 So What's the Real Product?

I agree with Barsanti that schools have been turned into factories. But they don't produce students, they just work there. The demands of testing have turned schools into factories that harness the labor of students to toil at a "bubble-test" assembly line producing "achievement" data. 

Schools mask the child labor with noble mission statements that claim they are producing "life-long learners." But that's just a cover. If it were true, you would expect to see schools where students explored their interests and reflected on their progress as learners. 

The actual product of schools is data, and its production is pursued with relentless focus. Distracting subjects that aren't tested,  are cut. No time is wasted on "creative" student projects – they don't produce data. And when there's no test to take, students can always get ready with more "test-prep."

Of course, a test data factory is a not pleasant place to work, absenteeism runs high and every year many students quit. But there's a steady supply of new students to take their place. It should be noted that teachers work at the same factories. Conditions are better for them. They have a union.

Photo Title: One of the small boys in J. S. Farrand Packing Co. 
by Lewis Hine, July 1909
Library of Congress

Posted on

7 Lessons Students Learn in School

Student-jumping Stop and think about the most significant lessons you’ve learned in life – times when you’ve gained insights or skills of lasting importance. Now reflect for a moment – did this take place in a classroom? were you taught these lessons by a teacher? did the teacher evaluate how well you learned them?

Most likely the answer to all three questions is no. Yet every day our students “learn” to relinquish responsibility for learning to their teachers. By the time they get to high school, their natural curiosity has been trampled into submission – their questioning reduced to the level of “will this be on the test?” or “does spelling count?”  

Recently my Twitter network (thanks @L_Hilt ) pointed me to an insightful observation on the traditional classroom. Next time you lament that students aren’t motivated, think about the distance between what we learn in school and what we learn in life. 

7 Tacit Lessons Schools Teach Children

  1. Knowledge is scarce.
  2. Learning needs a specific place and specific time (lessons in classrooms).
  3. Knowledge is best learned in disconnected little pieces (lessons).
  4. To learn you need the help of an approved expert (a teacher).
  5. To learn you need to follow a path determined by a learning expert (a course of study).
  6. You need an expert to assess your progress (a teacher).
  7. You can attribute a meaningful numerical value to the value of learning (marks, grades, degrees).

~ From Don Ledingham’s blog post “Utopia” – a summary of a talk by Alan McCluskey on the seven tacit lessons which schools teach children. 

If you had trouble reflecting on life’s lessons or are interested in how to foster more reflective schools, see my post “A Taxonomy of Reflection: Critical Thinking For Students, Teachers, and Principals“ 

Image credit Flickr/Peaches&Cream

Posted on

9 Questions for Reflective School Reform Leaders

Blueprint1 In response to the November 22: Day of National Blogging for Real Education Reform, I have posed nine questions for school leaders to consider. They’re organized around three themes and a concluding recommendation. (Note: each theme also resonates in the new Common Core standards).

Readers might also want to review my post “A Taxonomy of Reflection: Critical Thinking For Students, Teachers, and Principals“

Theme 1. Learning must engage student in rigorous thinking at higher levels of Bloom – analyzing, evaluating and creating. School leaders should ask:

1. Does our school community recognize the difference between higher and lower order thinking?
2. Are students expected to just consume information, or are they asked to create something original that demonstrates their learning?
3. Is our school a creative problem-solving organization? 
Answers: We cut music and art for remedial math. (Wrong!!!)
 We recognize music and art are vehicles to teach math. (That’s better!)

Theme 2. Learning is relevant when the student understands how the information or skill has some application to their life, has an opportunity to figure out their own process rather than just learn “the facts,” and is given opportunities to reflect on their work and their progress as learners. School leaders should ask …

4. Do our students get high grades for simply memorizing the review sheet for the test?
5. Do our students “follow the recipe” or are they increasingly asked to take responsibility for their learning products, process and results?
6. Is the audience for student work simply the teacher, or are students asked to share their learning with peers, family, community?

Theme 3. The digital age has redefined literacy. To paraphrase David Warlick, literacy now means the ability to: find information, decode it, critically evaluate it, organize it into digital libraries, be able to share it with others and stay focused on a task. School leaders should ask …

7. If we’re no longer the “information gatekeepers,” are we teaching our students to critically evaluate information and use it responsibly?
8. Does our technology get used mainly by the educators, or are students regularly employing it to create understanding and share their learning?
9. Is our credit system based on seat time or can it be expanded beyond the school walls to any place / time virtual learning?

I find it ironic that while schools chase NCLB “proficiency,” life has become an open book test. We need to unleash the power of assessment that targets and inspires. One-shot, high stakes tests are just autopsies. Students need regular check-ups where teachers can gauge student progress and target instruction. Ultimately the program must be designed to foster student self-assessment that gives them responsibility for monitoring their own progress. Students should be supported in on-going self-reflection that addresses questions such as:

  • How can I use this knowledge and these skills to make a difference in my life?
  • How am I progressing as a learner?
  • How can I communicate what I’m learning with others?
  • How can I work with teachers and other students to improve my learning?

Schools will need to become places that create engaging and relevant learning experiences, provoke student reflection, and help students apply the learning to life. Authentic  accountability is reciprocal …  leadership is responsible to provide resources for success, educators are responsible for results. Simply sorting students along the “bell curve” won’t do.

Posted on

Filtering – The New Literacy of Maintaining Focus

The New York Times recent story “Growing Up Digital, Wired for Distraction” and reinforces a point I made in a July blog post “Forget About Remembering, It’s Focus That’s the New Literacy.” I thought I’d revisit my original post and add the NY Times’ thought-provoking video. 

The cost of information is rapidly approaching zero. Normally as price of a commodity drops, we consume more of it. But unlike all the other cheap stuff we buy, and then later discard, cheap information demands our attention. Despite all the claims of multi-tasking, we are stuck with a finite attention span. Thus the ability to selectively filter out unwanted information and stay focussed on a task is emerging as a new literacy.

Students are adrift in a sea of text without context.  As the barriers to content creation have dropped, old media (for all its flaws) has been replaced by pointless mashups, self-promoting pundits, and manufactured celebrity. Educators must help students make more effective use of the information that fills their lives – how to better access it, critically evaluate it, store it, analyze, share it, and maintain their focus. (An essential goal of the Common Core standards).

For more on how we need to redefine the information flow in school see my post “What Happens in Schools When Life Has become an Open-book Test?“

focus
focus

Recently David Dalrymple, a researcher at the MIT Mind Machine Project, made an insightful contribution to the The Edge Annual Question — 2010 “How is the internet changing the way you think?” He wrote, 

“Filtering, not remembering, is the most important skill for those who use the Internet. … Before the Internet, most professional occupations required a large body of knowledge, accumulated over years or even decades of experience. But now, anyone with good critical thinking skills and the ability to focus on the important information can retrieve it on demand from the Internet, rather than her own memory. On the other hand, those with wandering minds, who might once have been able to focus by isolating themselves with their work, now often cannot work without the Internet, which simultaneously furnishes a panoply of unrelated information — whether about their friends’ doings, celebrity news, limericks, or millions of other sources of distraction. The bottom line is that how well an employee can focus might now be more important than how knowledgeable he is. Knowledge was once an internal property of a person, and focus on the task at hand could be imposed externally, but with the Internet, knowledge can be supplied externally, but focus must be forced internally.”

Image credit: Flickr/staxnet