FreeBSD Summer of Code Students Highlighted on Google Blog

As in previous years, I've posted a summary of FreeBSD Project participation in Google Summer of Code on the Google Open Source Blog.

By my count we have now mentored at least 117 students on FreeBSD development through this program. As in previous years it was tough to identify a few student projects to highlight given how much cool work is going on here. My list is certainly not complete but at least a few other people mentioned that Efstratios Karatzas, Zheng Liu, and David Forsythe had done a lot of excellent work this summer. Hats off to them, all the students and mentors this summer, and Brooks and Robert for serving as administrators of this whole thing for us.

MeetBSD 2010 Videos in HD on YouTube

Thanks to Tomasz Dudzisz we now have 14 videos from MeetBSD 2010 in Poland. Tomasz has created a playlist for the BSD Conferences YouTube channel, or you can select a video directly from the list below. These videos are all in HD quality and most are in English and a few are in Polish. Thanks Tomasz and the MeetBSD organizers for being so organized with the video recordings again this year.

Dru Lavigne - Update on BSD Certification

Hans Peter Selasky - The new USB stack in FreeBSD

Jakub Klama - FreeBSD on DaVinci DMSoC (polish)

Jan Srzednicki - What ideas can FreeBSD borrow from AIX?

Attilio Rao - The VFS/vnode interface in the FreeBSD kernel

Marko Zec - Network emulation using the virtualized network stack in FreeBSD

Paweł Jakub Dawidek - HAST -- Highly Available storage for FreeBSD (polish)

Paweł Jakub Dawidek - HAST -- Highly Available storage for FreeBSD (questions, polish)

Nikolay Aleksandrov - FreeBSD-based solution for Internet traffic management
Sławek Żak - NoSQL

Ramon Tancinco - meetBSD 2010 Welcome Intro

Martin Matuska - mfsBSD

Dmitri Epshtein - Advances in Embedded ARM processors, for performance driven applications

Warner Losh - Using FreeBSD in a Commercial Setting

BSDCan on Google's Open Source Blog

A coworker of mine, Kirk Russell, just posted an excellent summary of BSDCan through the years on the Google Open Source Blog.

I wasn't able to make it to BSDCan this year due to family commitments, but I did make it to another open source conference later this summer that I also wrote about on Google's open source blog.

Kirk and I haven't worked closely together but we both do our best at evangelizing BSD and open source inside our respective corners of the company. It's great to see his post about all the excellent work happening in the BSD community on a corporate blog.

Kirk McKusick on Journaling Soft Updates in FreeBSD

Dr. Kirk McKusick has produced a high quality recording of his talk on Journaled Soft-Updates at BSDCan 2010. This is the 92nd BSD conference video in the BSD Conferences YouTube channel.

AsiaBSDCon 2010 Videos

The videos from AsiaBSDCon 2010 are now available on the BSD Conferences YouTube channel. The full list of 17 AsiaBSDCon videos includes:

• George Neville-Neil: Hardware Performance Monitoring Counters on non-X86 Architectures
  
• Massimiliano Stucchi: BSD in the routing industry
  
• Marco Peereboom: Softraid: OpenBSD's virtual HBA, with benefits
  
• Brooks Davis: Porting HPC Tools to FreeBSD
  
• Marco Peereboom: Epitome2: dedup for the masses
  
• Rui Paulo: Wireless Mesh Networks under FreeBSD
  
• Constantine A. Murenin: Quiet Computing with BSD
  
• Ryan McBride: What's wrong with PF
  
• Takuya ASADA: SMP Implementation for OpenBSD/sgi
  
• Antti Kantee: Rump Device Drivers: Shine On You Kernel Diamond
  
• Simon Perreault: Ecdysis: Open-Source DNS64 and NAT64
  
• Paul Schenkeveld: Minimizing service windows on servers using NanoBSD + ZFS + jails
  
• Peter Losher: Closing the DNS Security Loop with DNSSEC
  
• Claudio Jeker: vscsi(4) and iscsid -- iSCSI initiator the OpenBSD way
  
• Ana Kukec: Native SeND kernel API for *BSD
  
• Alexandre Ratchov: OpenBSD audio & MIDI framework for music and desktop applications
  
• Kris Moore: PC-SYSINSTALL - A new system installer backend for PC-BSD and FreeBSD
  

Thanks Hiroki Sato and the other organizers of AsiaBSDCon for running a successful conference and uploading these videos. Some of these videos were previously available on ustream but are not currently accessible there. The YouTube channel provides automatic machine generated captions in ~50 languages, fast streaming, and a total of over 90 videos from conferences over the past ~3 years.

FreeBSD Tech Talk @ Google

Long time FreeBSD developer Luigi Rizzo from the University of Pisa came to Google last week to visit with Sam Leffler and me, and he agreed to give a talk about some of his work on link emulation and packet scheduling.



This marks the second FreeBSD video in the Google Tech Talks channel in addition to the 70+ videos in the BSD Conferences channel. Enjoy.

Improved Conference Captions from Amazon Mechanical Turk (2)

After my initial experiments last month, I applied to the FreeBSD Foundation for funds to pay for additional human editing of the YouTube machine generated transcripts. The screenshot on the left shows an example HIT (Human Intelligence Task) available on Amazon Mechanical Turk.

The task description on the left is based on a template I created with three variables: $VIDEO_URL, $VIDEO_TITLE, and $CAPTIONS_URL. New HITs are then created by uploading a CSV file with three columns for each of those variables, e.g.

VIDEO_URL,VIDEO_TITLE,CAPTIONS_URL
http://www.youtube.com/watch?v=mMmbjJI5su0,"BSD v. GPL, Jason Dixon, NYCBSDCon 2008",http://people.FreeBSD.org/~murray/improved-captions-bsdvsgpl.sbv
http://www.youtube.com/watch?v=Pe8LdJpBGJ4,"Isolating Cluster Jobs for Performance and Predictability, Brooks Davis (DCBSDCon 2009",http://people.FreeBSD.org/~murray/improved-captions-isolatingcluster.sbv

Using this method I created 12 HITs for the first pass of editing for which I offered between $9 and $14 per video. A slightly modified template with the same three variables was used to pay ~$7 per video for a second pass to further improve the transcripts improved in the first pass.

The template has gotten more detailed over the past month in response to all of the minor ways that workers submitted less than perfect transcripts. The actual SBV file format used by YouTube captions is not formally specified anywhere as far as I can tell, but the 60 character maximum width and simple format can be verified in submitted transcripts with a few emacs macros.

The transcript files have been checked into the FreeBSD Doc CVS Repository. The full list of videos with human-edited English language transcripts is:

• "M. Warner Losh, An Overview of FreeBSD/mips, AsiaBSDCon2009" (captions)
  
• "AsiaBSDCon 2009: Internet Mail — Past, Present, and (a bit of) the Future" (captions)
  
• "A. Rao: The Locking Infrastructure in the FreeBSD kernel #1" (captions)
  
• "A. Rao: The Locking Infrastructure in the FreeBSD kernel #2" (captions)
  
• "PC-BSD, Matt Olander, AsiaBSDCon 2008" (captions)
  
• "FreeBSD, Protecting Privacy with Tor" (captions)
  
• "Isolating Cluster Jobs for Performance and Predictability, Brooks Davis (DCBSDCon 2009" (captions)
  
• "Richard Bejtlich, Network Security Monitoring Using FreeBSD" (captions)
  
• "Jason Dixon Closing Remarks of DCBSDCon - BSD is Still Dying" (captions)
  
• "A Narrative History of BSD, Dr. Kirk McKusick" (captions)
  
• "BSD is Dying, Jason Dixon, NYCBSDCon 2007" (captions)
  
• "BSD v. GPL, Jason Dixon, NYCBSDCon 2008" (captions)
  
• "FreeBSD Kernel Internals, Dr. Marshall Kirk McKusick" (captions)