The ScaleDB Storage Engine: Enabling High Performance and Scalability Using Materialized Views and a Shared-Disk Clustering Architecture

Moshe Shadmon (ScaleDB)

ScaleDB is a general-purpose transactional storage engine for MySQL providing High Performance and Scalability for large disk based data sets.

The ScaleDB architecture is based on a shared disk approach. It allows multiple MySQL servers to share the same physical database while guaranteeing the consistency of concurrent updates and reads operations. This approach supports growth in the data size and the number of users by adding additional servers to the cluster with no disruption to existing processes. It eliminates the need for sharding to balance data distribution and workloads.

ScaleDB indexes are unique and based on innovative Multi-Table Indexing. These indexes are highly compressed, independent of the key size, and minimize the number of IOs to update and search data. In addition, the indexes provide views over the data by retrieving data dynamically from multiple tables, in a highly efficient manner, and without the need to build the views in advance.

This session will demonstrate and explain the technology behind the Multi-Table Indexing, the architecture of the shared disk clustering, some of the challenges in integrating these technologies to MySQL and the impact on partitioning, load balancing, data consistency, high-availability, scalability and adaptability to evolving usage patterns.

Moshe Shadmon

ScaleDB

Moshe Shadmon is the founder and CTO of ScaleDB. Moshe is the creator of the ScaleDB indexing technology and has more than 20 years of experience in both technical and management roles. Moshe’s technical experience has been in the areas of high performance indexing solutions as well as the development of a unified solution for structured and semi-structured data. Since 2006, Moshe has become increasingly interested in the opportunity presented by the open source databases and founded ScaleDB to develop a database engine for MySQL targeting performance, efficiency and scalability with the largest data sets.

Comments on this page are now closed.

Comments

Picture of Sheeri K. Cabral
Sheeri K. Cabral
07/29/2009 12:22pm PDT

Actually, the video can now be seen on YouTube at www.youtube.com/watch?v=_5Q...

Picture of Sheeri K. Cabral
Sheeri K. Cabral
07/06/2009 4:35pm PDT

People have reported that the “play” link loads for 15-20 minutes before actually streaming the content; however, the download link works just fine. I apologize for any inconvenience.

Picture of Sheeri K. Cabral
Sheeri K. Cabral
06/25/2009 7:46am PDT

Play the video directly in your browser at technocation.org/node/747/play or download it at technocation.org/node/747/d...

Co-presented By:

O'Reilly Media MySQL/Sun Microsystems
  • Kickfire
  • Virident
  • Infobright, Inc
  • JasperSoft
  • Intel
  • Advanced Micro Devices
  • BIRT Exchange by Actuate
  • Calpont
  • Canonical
  • Continuent
  • Dolphin Interconnect Solutions
  • Facebook
  • HiT Software, Inc.
  • IBM
  • iDashboards
  • Oracle
  • Pentaho
  • R1Soft
  • Schooner Information Technology
  • SQLstream
  • Ticketmaster
  • Zmanda, Inc.
  • Linux Journal

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Sharon Cordesse at scordesse@oreilly.com

Download the MySQL Sponsor/Exhibitor Prospectus

Media Partner Opportunities

Download the Media & Promotional Partner Brochure (PDF) for information on trade opportunities with O'Reilly conferences or contact mediapartners@ oreilly.com

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

MySQL Conference Newsletter

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the MySQL Conference newsletter.

Contact Us

View a complete list of MySQL contacts.