Using MySQL As NoSQL - Introduction to HandlerSocket Plugin

Average rating: ****.
(4.33, 3 ratings)

Most of high scale web applications use MySQL + memcached. Many of them use also NoSQL like TokyoCabinet/Tyrant. In some cases people have dropped MySQL and have shifted to NoSQL. One of the biggest reasons for such a movement is that it is said that NoSQL performs better than MySQL for simple access patterns such as primary key lookups. Most of queries from web applications are simple so this seems like a reasonable decision. Like many other high scale web sites, we at DeNA had similar issues for years. But we reached a different conclusion. We developed HandlerSocket Plugin – a MySQL plugin that speaks NoSQL network protocols. HandlerSocket has the following features/advantages.

  • Supporting lots of query patterns
  • Can handle lots of concurrent connections
  • Extremely high performance
  • No duplicate cache
  • No data inconsistency
  • Crash-safe
  • SQL can be used from mysql clients
  • All operational benefits from MySQL
  • No need to modify/rebuild MySQL
  • Independent from storage engines

In our benchmarks, we could get 750,000+ read qps on a commodity MySQL/InnoDB 5.1 server from remote web clients. We also have got excellent performance on production environments. In this session, we’d like to share our experiences. We’ll talk about what HandlerSocket can do, how it performs with reads and writes, where and how we use in production, etc.

Photo of Yoshinori Matsunobu

Yoshinori Matsunobu

DeNA

Yoshinori Matsunobu is a database and infrastructure architect at DeNA (http://www.dena.jp/en/index.html), living in Tokyo. Yoshinori’s primary responsibility at DeNA is to make our database infrastructure more reliable, faster and more scalable. Before joining DeNA, Yoshinori worked at MySQL/Sun/Oracle as a lead consultant in APAC for four years. Yoshinori has written eight MySQL related technical books so far and has published technical articles about MySQL, Linux, and Java for a monthly database magazine since 2004.

Kazuho Oku

DeNA

Kazuho Oku is a software engineer living in Japan. He is the original developer of:

  • Palmscape (a.k.a. Xiino, the oldest web browser for Palm OS)
  • Japanize (consumer-based web localization service)
  • Pathtraq (one of the largest web stats service in Japan)
  • Q4M (a pluggable Message Queue for MySQL)

He is currently working for Cybozu (Japan’s largest groupware vendor) as a researcher of platform software and services. Awarded as TR100 by Technology Review in 2002, “Super Creator” by IPA, Japan in 2005.

Biography in detail

Comments on this page are now closed.

Comments

Picture of Yoshinori Matsunobu
Yoshinori Matsunobu
04/11/2011 12:51am PDT

The slides can be downloaded here a few days after the conference (we’re still working on the slides:)).

Renato da Silveira
04/11/2011 12:41am PDT

Are there any places where one could download the content for this session?

Regards

(Senior Developer)

  • EnterpriseDB
  • Amazon Web Services
  • Clustrix
  • Continuent
  • Facebook
  • HTI Consultoria e Tecnologia
  • Monty Program
  • Percona
  • Rackspace Hosting
  • Schooner Information Technology
  • SkySQL
  • Xeround

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Yvonne Romaine at yromaine@oreilly.com

Media Partners Opportunities

For media partnerships, contact mediapartners@ oreilly.com

Press & Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

O'Reilly MySQL Conference Bulletin

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the O'Reilly MySQL Conference Bulletin (login required).

Contact Us

View a complete list of O'Reilly MySQL Conference Contacts