Day 25: Wrapping Up Work on Projects

Raymond Yee

April 22, 2014 (


On Thursday, Lisa Green, Director of CommonCrawl and Former Chief of Staff at Creative Commons. She has also been a key participant in Open Data Bay Area (San Francisco, CA) - Meetup.

About CommonCrawl:

Common Crawl Foundation is a California 501(c)(3) registered non-profit founded by Gil Elbaz with the goal of democratizing access to web information by producing and maintaining an open repository of web crawl data that is universally accessible and analyzable.

In Class Presentations Next Week

Project Abstracts and Open House

I will be advertising the Open House for the course at the end of this week. Please provide me a title and a short blurb (minimally, 75 words and not more 150 words) describing your project that I can use to advertise your work by Friday, April 25, 2014 at noon PDT. Include a URL that points to where people will be able to find your completed IPython notebook. Please get your notebooks in (more or less) final presentable form by Monday May 5, 2014 noon. (You can start with a placeholder notebook with your abstract.)

Place your project abstract at Abstracts.

The Open House will be on Tuesday, May 6 2-3:30pm.

(For a model of how to write your abstract, look at what students did last year: Fernando Perez: Exploring Open Data with Pandas and IPython at the Berkeley I School.)

I'll be inviting people from the iSchool and the larger community. Feel free to invite your friends to attend. Light refreshments will be served.

BTW, you might get a kick out of a video of the Open House for Mixing and Remixing Information in 2008. and photos from 2006 MRI Open House. It should be a lot of fun!

Feedback on your IPython project notebooks

I'm looking for concrete code in IPython notebook. It's better to start with one specific data set with some analytical code from which you then expand than generalities about work you hope to accomplish. In other words, consolidate and present what you have and then work iteratively to improve that work. I love to see you accomplish big ambitious goal but I want you to work reach those goals as a series of concrete, probably modest steps.

Highlights from Projects

PLOS Cloud Explorer -- in response to questions from the team, I wrote