MySQL Binary Log Analysis With Pentaho BI

This session explains how you can use open source tools: MySQL Proxy, Maatkit’s mk-query-digest, and Pentaho Data Integration (PDI) to get your binary log information into the Pentaho BI Server. Some previous exposure to BI concepts like dimension tables, fact tables, and MDX queries will be helpful. The session will demonstrate playing back binary logs through MySQL Proxy to gather statistics without actually executing queries. Drag and drop construction of a PDI transformation to build a fact table will be shown. We will briefly look at a Mondrian schema in the Pentaho Schema Workbench. Finally we will show some queries using Pentaho BI Server’s Analysis Views. Open source resources for the project will be available on Launchpad in a project called “Laminator”. This will include Lua scripts for MySQL Proxy, a Perl script to manage parsing of a collection of binary logs, PDI transformations, a Mondrian schema, and several MDX queries.