Map/Reduce and Queues for MySQL Using Gearman

Eric Day (craigslist), Brian Aker (HP)
Average rating: ****.
(4.67, 3 ratings)

Gearman was originally designed to help balance load at LiveJournal.com, but is also now used by other organizations such as Yahoo! and Digg. Development is now active again with an optimized rewrite in C, along with features such as persistent message queues, queue replication, improved statistics, and advanced job monitoring. For MySQL, there is also a new user defined function to run Gearman jobs, as well as the possibility to write your own aggregate UDFs using Gearman. This gives you the ability to run functions in separate processes, separate servers, and in other languages. The Gearman framework gives you a robust interface to also run these functions reliably in the “cloud”. This session will introduce these concepts and give examples of sample applications.

Photo of Eric Day

Eric Day

craigslist

Eric Day has been writing high-performance, multi-threaded servers for most of his career at Concentric, including complete HTTP/SSL, DNS, and IMAP implementations. He has also designed and implemented custom storage and database systems, from the protocol up through the application front-end. Most of his work has been done in clustered and distributed environments. When not hacking on code, he can be found running, biking, or enjoying a good vegan meal. You can read his blog and more at http://www.oddments.org/

Photo of Brian Aker

Brian Aker

HP

Brian Aker is the Director of Technology for MySQL. At MySQL he helps set direction for technology and looks for opportunies to harness and shape the MySQL database for efforts in Web, OEM, and Telephony. In his copious amounts of free time he works on Apache and Perl modules, and hacks on the Asterisk Telephony System (hence never has a working home phone number). In the past, he has been involved with projects for the Army Engineer Corps, The Virtual Hospital, Splunk, and Slashdot. He lives in Seattle with his dog Rosalynd.

Comments on this page are now closed.

Comments

Picture of Sheeri K. Cabral
Sheeri K. Cabral
07/29/2009 1:34pm PDT

The video is now on YouTube for much easier viewing…. www.youtube.com/watch?v=xDR...

Picture of Sheeri K. Cabral
Sheeri K. Cabral
07/06/2009 5:08pm PDT

My apologies, here’s the correct link:

Download the 155 Mb .mov file at technocation.org/node/753/download or, if you are more patient, wait (15-20 min) for the streaming to occur at technocation.org/node/753/play

Co-presented By:

O'Reilly Media MySQL/Sun Microsystems
  • Kickfire
  • Virident
  • Infobright, Inc
  • JasperSoft
  • Intel
  • Advanced Micro Devices
  • BIRT Exchange by Actuate
  • Calpont
  • Canonical
  • Continuent
  • Dolphin Interconnect Solutions
  • Facebook
  • HiT Software, Inc.
  • IBM
  • iDashboards
  • Oracle
  • Pentaho
  • R1Soft
  • Schooner Information Technology
  • SQLstream
  • Ticketmaster
  • Zmanda, Inc.
  • Linux Journal

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Sharon Cordesse at scordesse@oreilly.com

Download the MySQL Sponsor/Exhibitor Prospectus

Media Partner Opportunities

Download the Media & Promotional Partner Brochure (PDF) for information on trade opportunities with O'Reilly conferences or contact mediapartners@ oreilly.com

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

MySQL Conference Newsletter

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the MySQL Conference newsletter.

Contact Us

View a complete list of MySQL contacts.