Gizzard: A Pragmatic Distributed Storage Framework

Matt Freels (Twitter)
Average rating: *....
(1.67, 3 ratings)

At Twitter, we have gone through many iterations of storage systems as
we have coped with tremendous growth. In the process of building
these, we have been able to solve some of the core problems related to
distributed storage in a general fashion with a framework we wrote
named Gizzard. This has allowed us to quickly and safely develop
specialized components for the parts of Twitter that can no longer
handle the scale at which they are required to operate.

In this talk, I will go over how we got to where we are now, the core
principles we have followed to make writing and reasoning about these
systems as simple as possible, and how we have benefited from using
MySQL as a solid base.

Topics covered:

A set of general distributed systems design principles
Application of said principles to a few concrete problems
Building off of established technology
Coordination among multiple readers/writers
Resilient error handling

At the end of this talk, whether or not they use Gizzard, participants
will be better equipped to develop their own scalable systems, having
seen how certain not necessarily intuitive solutions can help solve
many different distributed storage problems.

Photo of Matt Freels

Matt Freels

Twitter

Matt is a software engineer on the Storage team at Twitter. The team is responsible for designing and building the fundamental storage services at the heart of Twitter’s platform. Before Twitter, Matt worked as full-stack developer at social gaming startup Serious Business. He lives in Berkeley, CA.

  • EnterpriseDB
  • Amazon Web Services
  • Clustrix
  • Continuent
  • Facebook
  • HTI Consultoria e Tecnologia
  • Monty Program
  • Percona
  • Rackspace Hosting
  • Schooner Information Technology
  • SkySQL
  • Xeround

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Yvonne Romaine at yromaine@oreilly.com

Media Partners Opportunities

For media partnerships, contact mediapartners@ oreilly.com

Press & Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

O'Reilly MySQL Conference Bulletin

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the O'Reilly MySQL Conference Bulletin (login required).

Contact Us

View a complete list of O'Reilly MySQL Conference Contacts