How To Quantify Culture? Explore 500 Billion Published Words With Google’s Books Ngram Viewer

By now you must be aware that Google has been busy digitizing books – over 5 million are now available for free download and search. Recently Google Labs has made public a giant database of of names, words and phrases found in those books (along with the years they appeared). It consists of the 500 billion words contained in scanned books published between 1500 and 2008 in English, French, Spanish, German, Chinese and Russian. 

Google Labs has just posted the “Books Ngram Viewer” – a free online research tool that allows you to quickly analyze the frequency of names, words and phrases -and when they appeared in the digitized books. You type in words and / or phrases (separated by comma), set the date range, and click “Search lots of books” – instantly you get the results. Note: when “smoothing” is set to “0” the results will show raw data. Using a higher number produces an average – example “4” will give you four year running averages that will more readily display trends. 

In this graph I searched “horse, carriage, canal, train, steamship, bicycle, car, airplane” and set the date range to 1800 – 2000.  Link to this transport graph at Books Ngram Viewer The results offer some insights into when these new transportation terms found their way into print. 

Transport-1

I think Books Ngram Viewer has many interesting applications in the classroom. The first that comes to mind, is as tool to introduce the research method – form hypothesis, gather and analyze data, revise hypothesis (as needed), draw conclusions, assess research methods. Working in teams students can easily pose research questions, run the data, revise and assess their research strategy. Students can quickly make and test predictions. They can then present and defend their conclusions to other classroom groups. All skills called for by the new Common Core standards.

Using the Ngram viewer, will enable students to discover many insights which will require revisions to their research strategies – a great way to explore word usage, social context and statistics. Words have multiple meanings. In my transport example “car” appears in the graph long before the advent of the automobile. Was it used as railroad car? In contrast to newspapers, events and trends take time to find their way into books. “Pearl Harbor” does not reach a peak until 1945.

The frequency of occurrence scale is important (vertical Y-axis.) If you graph a high frequency word against a low frequency word(s), the low is reduced to a flat line at the base of the scale. (Abraham Lincoln and Marilyn Monroe) Remove the high frequency (Abraham Lincoln) and re-run the graph – the low frequency (Marilyn Monroe) will appear with more detail. 

Need inspiration for nGrams? For a collection of clever searches Click here.

Updates: 

NGram Viewer has added a * wildcard feature. More on how to use it here Hat tip to Jean-Baptiste Michel of the nGram team who emailed me “In English, the data is good in 1800-2000, but not really before or after. Past that date, it looks like the composition of the corpus is changing; trends would indicate a shift in the corpus, not a shift in the underlying culture. So really, one shouldn’t look at data past 2000 in English.”

Analyze societal values: “ex wife, ex husband”  
 Changing laws and social values?
Watch the change in the Y-axis scale – add “my ex” to the original graph.

Ex-1

Track trends: “latte, sushi, taco”
Link to graph 
Are these new food fads?

Latte-1
 

iOS 4 Update: Lost All Your Contacts on Your iPhone? Here’s How To Get Them Back

StatsNote: I haven’t bothered to try iCloud yet. Commenters below demonstrate this process works in iOS 5 and with iCloud.

I first posted on this process back in May of ’09. After the release of  iOS 4 on June 21st, I noticed a big jump in traffic to my blog post. So I thought it was time to update the post using screenshots from  iOS 4. 

I sync my iPhone, MacBook and iMac over MobileMe. I like that a change in an appointment or contact on one device shows up on the other two.  But on a few occasions I have opened my iPhone to find that all my Contacts were gone. This calamity mysteriously happened on its own. (I did not make any setting changes to lose my contacts.) But here’s how I got them back. 

Assumption: This process assumes that you are using MobileMe to store your contacts. Before you begin the steps below, I suggest you go to your MobileMe account and confirm that your contact are there. Assuming your contacts are on MobileMe, here’s the way to get them back to your iPhone.

1. On my iPhone I went to “Settings” and picked “Mail, Contacts, Calendar.” All the email accounts you have on your iPhone will be there as choices along with your MobileMe account. See below.
  1_iphone_contacts

2. Under accounts I selected my MobileMe account. You get a list of all the data that MobileMe is syncing. See below.

2_mobile_me

3. I turned Contacts “Off.” (It’s the only sync I turned off.) You get the dialogue box below asking you if you really want to do this. I chose “Delete from My iPhone” since I did not want to run the risk of duplicating contacts. (Remember, that I had already confirmed that all my contact are backed up on my MobileMe account.)

  3_cancel_contacts

4. As the process of deleting progressed, I got this confirmation.

4_cancel_contacts

4. Once the process was finished, I waited a few seconds then I went back to the screen in Step 2 above and turned Contacts back “On.”

Re-synching your contact to your iPhone takes a new minutes – don’t panic!

When I reopened my iPhone contacts,  initially they were all gone. But I could see the sync icon running and after about 5 minutes all my contacts were back. Your time will depend on how many contacts you have and whether your are running on a wifi network. Note on this last step you might have to open and close Contacts a few times to get your iPhone to force a MobileMe sync.

Will iPad Replace the Textbook?

In these dark times of slashed school budgets, program cuts, and teacher layoffs it seems extravagant to even consider finding funds for student iPads. Nonetheless, Brad Colbow’s video tour of new magazine apps shows the iPad’s potential for merging purposeful art direction with meaningful academic content. 

Since I first posted this today, I added a sample of what it might look like using material from my homefront series of document-based questions. Add the ability for teacher- and student-created content with in-class social networking and you have education’s killer app. Plus I bet students wouldn’t forget to bring their “book” to class!  Download IPad-educational-app-demo (7MB pdf)

Ipad-ed-app-demo 

87 Free Web 2.0 Projects For the K-12 Classroom

Web-2.0-projects Web 2.0 sites become more useful as the number of users grow. Fortunately for teachers, there's loads of free educational 2.0 applications that can be utilized in the classroom to help students research, collaborate and share what they've learned.

Hats off to British educator, Terry Freedman, who has solicited lessons from 94 teachers from around the world and edited them into a free downloadable book Download Amazing Web 2 Projects 2 online version  (2 MB pdf) Hint: If you're not following Terry on Twitter (as I do) here's his Twitter link. The book also includes Twitter links to all the creative contributors to the project.

The book is organized by grade level and has curated links to all the web resources utilized. Each project includes a teacher-friendly "how to" with benefits, challenges, management tips, sample screen shots / links and learning outcomes. Terry's project is a great example of how the internet can be harnessed to share and collaborate. Who knows, the projects might even inspire your students to collaborate with their peers on their own book!

BTW – If you are a big fan of Wordle, you might like to see another international teacher collaboration "Build Literacy Skills with Wordle".


How to Use Web 2.0 to Create On-line Professional Development

As a former assistant superintendent for instruction one of my responsibilities was organizing the district workshop days. It was valuable time – the entire faculty and staff was available – but also a challenge to develop programs that delivered meaningful PD that were also easy to manage and cost effective. Recently I received an email that introduced me to how one district is leveraging free technology to move their PD day to an online environment.

The email said … “I’m @steelepierce on Twitter, following you, and also following your Copy/Paste blog.  Would you be available and willing to have a telephone conversation, preferably Skype, with our Teaching & Learning Department?  Topics: 1) our using your ideas on summarizing and notetaking for a professional learning online “workshop” we’re creating for our staff (550 teachers!) and 2) your coming to work with our teachers in August 2010. Thanks for your consideration. Looking forward to hearing from you”

It sounded interesting, so I Skyped with the TLC at West Clermont Local Schools – M.E. Steele-Pierce, Cheryl Turner and Tanny McGregor. They developed a PD module based, in part, on my blog post, “How to Teach Summarizing Skills.” I shared my input via Skype and also by recording comments into the training module. They built the lesson using Voicethread and delivered it online to faculty across the district during their recent Professional Learning Day. In addition they used Wallwisher (at end of this post) to gather teacher reflections.

 Click to view the training module. Advance or return using arrows. Click thumbnails to see all slides. Use mouse to zoom in / out of slides.

These are challenging times for school districts – and relentless budget cuts add to the challenges. The team at West Clermont shows us how the innovative use of free tech tools can provide PD that is cost effective, builds local capacity, and models the instructional practice we want to see in the classroom.

For more ideas on how to develop quality PD, see my post “15 Essential Questions for the Successful Staff Developer.” For information on learning strategies for the classroom, see my post “18 Literacy Strategies for Struggling Readers – Defining, Summarizing and Comparing