Eight Look 4s When Observing a Classroom: What the Teacher Teaches – What the Students Learn

School desk I rarely quote at length from a blog or news article, but I think this time I’ll break my rule. I first met Mel Riddile a few years ago when we co-presented at a conference. Since then we stay in touch via Twitter and by following each others’ blogs. Mel blogs on policy and practice for NAASP at The Principal Difference and tweets at @PrincipalDiff

His recent blog post “Tests: Will they improve learning?” is a thoughtful response to the recent Science Journal study that concluded that “practicing retrieval produces greater gains in meaningful learning than elaborative studying.”

Mel does a good job of putting the research into the context of the classroom, but the segment I wanted to quote is his closing section –  ”Look 4s for School Leaders.” It’s a succinct guide for principals, instructional leaders and can be used as reflective prompts by teachers.  Put these in your toolkit and don’t forget they are all critical aspects to Common Core mastery.

(Note: They’re also a great companion to my post “Observing a Classroom? Watch the Students, Not the Teacher“) 

Look 4s for School Leaders

    • Closure and Learning – The focus of instruction is not what teacher teaches but what the students learn. The close of every lesson should focus on what the learner has learned not what the teacher has taught. The question is how does the teacher know that the students have learned and mastered the lesson unless there is some type of formative assessment–quiz, test, or activity.
    • Remembering – The only evidence of learning is remembering. When observing a lesson ask yourself how does the teacher know that students will remember what they just learned?
    • Checks for Understanding – Teachers should pause frequently during a lesson to check for understanding. How frequently? As a rule of thumb, teachers should check students understanding approximately every fifteen minutes, which approximates the attention span of the average adolescent. According to the Science study, one of the most effective checks for understanding is the quiz used as a formative assessment. Teachers can pause and ask students to write a summary or take a brief quiz on what they just learned. Immediately re-teaching a concept to a classmate may also be used to test practice retrieval.
    • Timing is critical - When it comes to recall, tomorrow is too late. Teachers need to check for student understanding before students leave the classroom each day.
    • Feedback – “Feedback is the breakfast of champions.” Unless students practice recall (retrieval) and get immediate feedback they will not remember.
    • Defined Instructional Practices – Some students absolutely need a highly structured classroom room environment characterized by identifiable instructional practices, smaller units of instruction, more frequent assessments, coupled with frequent and immediate feedback. However, students who can function equally as well in low or highly structured classrooms are not penalized in any way by the use of structure. In other words, when in doubt, use a more structured approach.
    • Formative Assessments – How often should students be assessed? How frequently students are assessed or asked to practice retrieval depends on their familiarity with the content and the student’s level of mastery. When students are introduced to new content or when they are struggling with a particular concept, they should be assessed more frequently. For example, the skills of proficient and advanced readers need only be assessed annually, while students reading at the basic level or below basic need to be assessed regularly. Frequent assessments mean more feedback. A quiz or summary essay at the close of a lesson will do more for student recall than extensive homework assignments.
    • Mapping – Instructional strategies like “concept mapping” are effective, but they work better if they are used as part of “practice retrieval.” The act of creating a “concept map” in and of itself does not improve learning unless the student makes use of the map as a part of the “practice retrieval” process. Teachers should show students how to use the concept maps to review for a test and not assume that the students know how to do so.

Image credit flickr/mecredis

How To Quantify Culture? Explore 500 Billion Published Words With Google’s Books Ngram Viewer

By now you must be aware that Google has been busy digitizing books – over 5 million are now available for free download and search. Recently Google Labs has made public a giant database of of names, words and phrases found in those books (along with the years they appeared). It consists of the 500 billion words contained in scanned books published between 1500 and 2008 in English, French, Spanish, German, Chinese and Russian. 

Google Labs has just posted the “Books Ngram Viewer” – a free online research tool that allows you to quickly analyze the frequency of names, words and phrases -and when they appeared in the digitized books. You type in words and / or phrases (separated by comma), set the date range, and click “Search lots of books” – instantly you get the results. Note: when “smoothing” is set to “0” the results will show raw data. Using a higher number produces an average – example “4” will give you four year running averages that will more readily display trends. 

In this graph I searched “horse, carriage, canal, train, steamship, bicycle, car, airplane” and set the date range to 1800 – 2000.  Link to this transport graph at Books Ngram Viewer The results offer some insights into when these new transportation terms found their way into print. 

Transport-1

I think Books Ngram Viewer has many interesting applications in the classroom. The first that comes to mind, is as tool to introduce the research method – form hypothesis, gather and analyze data, revise hypothesis (as needed), draw conclusions, assess research methods. Working in teams students can easily pose research questions, run the data, revise and assess their research strategy. Students can quickly make and test predictions. They can then present and defend their conclusions to other classroom groups. All skills called for by the new Common Core standards.

Using the Ngram viewer, will enable students to discover many insights which will require revisions to their research strategies – a great way to explore word usage, social context and statistics. Words have multiple meanings. In my transport example “car” appears in the graph long before the advent of the automobile. Was it used as railroad car? In contrast to newspapers, events and trends take time to find their way into books. “Pearl Harbor” does not reach a peak until 1945.

The frequency of occurrence scale is important (vertical Y-axis.) If you graph a high frequency word against a low frequency word(s), the low is reduced to a flat line at the base of the scale. (Abraham Lincoln and Marilyn Monroe) Remove the high frequency (Abraham Lincoln) and re-run the graph – the low frequency (Marilyn Monroe) will appear with more detail. 

Need inspiration for nGrams? For a collection of clever searches Click here.

Updates: 

NGram Viewer has added a * wildcard feature. More on how to use it here Hat tip to Jean-Baptiste Michel of the nGram team who emailed me “In English, the data is good in 1800-2000, but not really before or after. Past that date, it looks like the composition of the corpus is changing; trends would indicate a shift in the corpus, not a shift in the underlying culture. So really, one shouldn’t look at data past 2000 in English.”

Analyze societal values: “ex wife, ex husband”  
 Changing laws and social values?
Watch the change in the Y-axis scale – add “my ex” to the original graph.

Ex-1

Track trends: “latte, sushi, taco”
Link to graph 
Are these new food fads?

Latte-1
 

Stop Worrying About Shanghai, What PISA Test Really Tells Us About American Students

Sputnik replica
Sputnik replica

The latest results from the Program for International Student Assessment (PISA) are public, and already some pundits are declaring it “a Sputnik wake-up.” Others shout back that international comparisons aren’t valid. Rather than wade into that debate, I’d rather look more closely at the questions in the PISA test and what student responses tell us about American education. You can put international comparisons aside for that analysis. 

Are American students able to analyze, reason and communicate their ideas effectively? [Think Common Core standards] Do they have the capacity to continue learning throughout life? Have schools been forced to sacrifice creative problem solving for “adequate yearly progress” on state tests? For more on that last question see my post “As NCLB Narrows the Curriculum, Creativity Declines.” 

PISA provides some answers to those questions and offers an insight into the type of problem solving that rarely turns up American state testing. FYI: PISA is an assessment (begun in 2000) that focuses on 15-year-olds’ capabilities in reading literacy, mathematics literacy, and science literacy. PISA assesses how well prepared students are for life beyond the classroom by focusing on the application of knowledge and skills to problems with a real-life context. For more examples of PISA questions and data click here. 

Do American students learn how to sequence or simply memorize sequences

Here’s one insight into what American students can (and cannot) do that can be gleaned from the 2003 PISA test results. We spend a lot of time in school getting students to learn sequential information – timelines, progressions, life cycle of a moth, steps for how to. Typically the teacher teaches the student the sequence and the student correctly identifies the sequence for teacher on the test. Thus we treat a sequence as a ordered collection of facts to be learned, not as a thinking process for students to use.  This memorization reduces the student’s “mastery” of the chronology to lower order thinking. I was guilty of this when I first started teaching history “Can someone give me two causes and three results of WWII?” 

Sample sequencing problem from PISA

The Hobson High School library has a simple system for lending books: for staff members the loan period is 28 days, and for students the loan period is 7 days. The following is a decision tree diagram showing this simple system:

Pisa-1

The Greenwood High School has a similar, but more complex library lending system:
All publications classified as “Reserved” have a loan period of 2 days.
For books (not including magazines) that are not on the reserved list, the loan period is 28 days for staff, and 14 days for students. For magazines that are not on the reserved list, the loan period is 7 days for everyone.
Persons with any overdue items are not allowed to borrow anything. 

Task

Develop a decision tree diagram for the Greenwood High School Library system so that an automated checking system can be designed to deal with book and magazine loans at the library.  Your checking system should be as efficient as possible (i.e. it should have the least number of checking steps). Note that each checking step should have only two outcomes and the outcomes should be labeled appropriately (e.g. “Yes” and “No”).

Student Results

Only 13.5% of US students were able correctly answered the question. Does it really matter if students in Shanghai did any better? (The student results were rated on a rubric scale.) 

When students are asked to observe a process and develop a sequence they have an opportunity to use a full spectrum of higher-order thinking skills – they must recognize patterns (analyze), determine causality (evaluate) and then decide how they would communicate what they’ve learned to others (create). Sequencing can be taught across the curriculum at a variety of grade levels – we simply have to ask the students to observe and do the thinking.

In case you’re wondering,  correct response should look like this.
Click image to enlarge.

pisa answer
pisa answer 
 

Image credit/ NASA
 

9 Questions for Reflective School Reform Leaders

Blueprint1 In response to the November 22: Day of National Blogging for Real Education Reform, I have posed nine questions for school leaders to consider. They’re organized around three themes and a concluding recommendation. (Note: each theme also resonates in the new Common Core standards).

Readers might also want to review my post “A Taxonomy of Reflection: Critical Thinking For Students, Teachers, and Principals

Theme 1. Learning must engage student in rigorous thinking at higher levels of Bloom – analyzing, evaluating and creating. School leaders should ask:

1. Does our school community recognize the difference between higher and lower order thinking?
2. Are students expected to just consume information, or are they asked to create something original that demonstrates their learning?
3. Is our school a creative problem-solving organization? 
Answers: We cut music and art for remedial math. (Wrong!!!)
 We recognize music and art are vehicles to teach math. (That’s better!)

Theme 2. Learning is relevant when the student understands how the information or skill has some application to their life, has an opportunity to figure out their own process rather than just learn “the facts,” and is given opportunities to reflect on their work and their progress as learners. School leaders should ask …

4. Do our students get high grades for simply memorizing the review sheet for the test?
5. Do our students “follow the recipe” or are they increasingly asked to take responsibility for their learning products, process and results?
6. Is the audience for student work simply the teacher, or are students asked to share their learning with peers, family, community?

Theme 3. The digital age has redefined literacy. To paraphrase David Warlick, literacy now means the ability to: find information, decode it, critically evaluate it, organize it into digital libraries, be able to share it with others and stay focused on a task. School leaders should ask …

7. If we’re no longer the “information gatekeepers,” are we teaching our students to critically evaluate information and use it responsibly?
8. Does our technology get used mainly by the educators, or are students regularly employing it to create understanding and share their learning?
9. Is our credit system based on seat time or can it be expanded beyond the school walls to any place / time virtual learning?

I find it ironic that while schools chase NCLB “proficiency,” life has become an open book test. We need to unleash the power of assessment that targets and inspires. One-shot, high stakes tests are just autopsies. Students need regular check-ups where teachers can gauge student progress and target instruction. Ultimately the program must be designed to foster student self-assessment that gives them responsibility for monitoring their own progress. Students should be supported in on-going self-reflection that addresses questions such as:

  • How can I use this knowledge and these skills to make a difference in my life?
  • How am I progressing as a learner?
  • How can I communicate what I’m learning with others?
  • How can I work with teachers and other students to improve my learning?

Schools will need to become places that create engaging and relevant learning experiences, provoke student reflection, and help students apply the learning to life. Authentic  accountability is reciprocal …  leadership is responsible to provide resources for success, educators are responsible for results. Simply sorting students along the “bell curve” won’t do.

Filtering – The New Literacy of Maintaining Focus

The New York Times recent story “Growing Up Digital, Wired for Distraction” and reinforces a point I made in a July blog post “Forget About Remembering, It’s Focus That’s the New Literacy.” I thought I’d revisit my original post and add the NY Times’ thought-provoking video. 

The cost of information is rapidly approaching zero. Normally as price of a commodity drops, we consume more of it. But unlike all the other cheap stuff we buy, and then later discard, cheap information demands our attention. Despite all the claims of multi-tasking, we are stuck with a finite attention span. Thus the ability to selectively filter out unwanted information and stay focussed on a task is emerging as a new literacy.

Students are adrift in a sea of text without context.  As the barriers to content creation have dropped, old media (for all its flaws) has been replaced by pointless mashups, self-promoting pundits, and manufactured celebrity. Educators must help students make more effective use of the information that fills their lives – how to better access it, critically evaluate it, store it, analyze, share it, and maintain their focus. (An essential goal of the Common Core standards).

For more on how we need to redefine the information flow in school see my post “What Happens in Schools When Life Has become an Open-book Test?

focus
focus

Recently David Dalrymple, a researcher at the MIT Mind Machine Project, made an insightful contribution to the The Edge Annual Question — 2010 “How is the internet changing the way you think?” He wrote, 

“Filtering, not remembering, is the most important skill for those who use the Internet. … Before the Internet, most professional occupations required a large body of knowledge, accumulated over years or even decades of experience. But now, anyone with good critical thinking skills and the ability to focus on the important information can retrieve it on demand from the Internet, rather than her own memory. On the other hand, those with wandering minds, who might once have been able to focus by isolating themselves with their work, now often cannot work without the Internet, which simultaneously furnishes a panoply of unrelated information — whether about their friends’ doings, celebrity news, limericks, or millions of other sources of distraction. The bottom line is that how well an employee can focus might now be more important than how knowledgeable he is. Knowledge was once an internal property of a person, and focus on the task at hand could be imposed externally, but with the Internet, knowledge can be supplied externally, but focus must be forced internally.”

Image credit: Flickr/staxnet