MySQL Binary Log Analysis With Pentaho BI

Roger Booth (WebAssign)
Average rating: **...
(2.00, 4 ratings)

This session explains how you can use open source tools: MySQL Proxy, Maatkit’s mk-query-digest, and Pentaho Data Integration (PDI) to get your binary log information into the Pentaho BI Server. Some previous exposure to BI concepts like dimension tables, fact tables, and MDX queries will be helpful. The session will demonstrate playing back binary logs through MySQL Proxy to gather statistics without actually executing queries. Drag and drop construction of a PDI transformation to build a fact table will be shown. We will briefly look at a Mondrian schema in the Pentaho Schema Workbench. Finally we will show some queries using Pentaho BI Server’s Analysis Views. Open source resources for the project will be available on Launchpad in a project called “Laminator”. This will include Lua scripts for MySQL Proxy, a Perl script to manage parsing of a collection of binary logs, PDI transformations, a Mondrian schema, and several MDX queries.

Photo of Roger Booth

Roger Booth

WebAssign

I am the DBA at WebAssign.net, an online homework and grading service. I was previously the DBA for McClatchy Interactive, supporting the online presence of 30 newspapers.

  • Oracle
  • Monty Program
  • Calpont
  • Facebook
  • Gear6
  • Infobright, Inc
  • JasperSoft
  • Joyent
  • Kickfire
  • NorthScale, Inc.
  • Percona
  • Schooner Information Technology
  • Solid Quality Mentors (SolidQ)
  • Intel
  • Pentaho
  • Linux Pro Magazine

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Yvonne Romaine at yromaine@oreilly.com

Download the O'Reilly MySQL Conference & Expo Sponsor/ Exhibitor Prospectus

Media Partner Opportunities

Download the Media & Promotional Partner Brochure (PDF) for information on trade opportunities with O'Reilly conferences or contact mediapartners@ oreilly.com

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

O'Reilly MySQL Conference Newsletter

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the O'Reilly MySQL Conference newsletter (login required).

Contact Us

View a complete list of O'Reilly MySQL Conference contacts.