%w(map reduce).first - A Tale About Rabbits, Latency, and Slim Crontabs

Paolo Negri (wooga.com)
General
Location: Ballroom A
Average rating: ***..
(3.56, 57 ratings)

the talk will present some situations and then the solutions (with code and possible real time demo)

  • distribute a big batch of local atomic operation across different ruby processes using queues RabbitMQ and the amqp gem, subtitle make some use of your cpu cores
  • effects of the previous approach applied to systems with high latency as an example it will be shown how to load data in parallel streams in Amazon SimpleDB (the dead_simple_db gem will be shown in the example)
  • how to convert the time discrete execution dictated by period driven tasks (i.e. *nix crontabs) in a fluid process that consumes entities as soon as they queue and handle smoothly the variance of load this kind of task migt be subject to

Paolo Negri

wooga.com

Opensource enthusiast kind of geek, interested in linux, programming languages. I did make of my passion my job and I succeeded in keeping the passion during the process.

Comments on this page are now closed.

Comments

Steve Newell
05/07/2009 9:24am PDT

Great presentation. It helped me solve a couple of problems!

Picture of Shirley  Bailes
Shirley Bailes
05/07/2009 8:39am PDT

thanks Paolo… slides are now attached to your session.

Paolo Negri
05/07/2009 8:02am PDT

slides are now on slideshare:http://www.slideshare.net/hungryblank/wmap-reducefirst-a-tale-about-rabbits-latency-and-slim-crontabs however they should also appear on the conference speaker presentation files section soon.

Jonathan Thomas
05/07/2009 6:35am PDT

One of my favorite presentations; great content; dovetailed nicely w/ Ezra’s talk on using Nanite (which requires RabbitMQ). Would like to get a copy of your slides. Thx, again!

Paolo Negri
05/06/2009 5:56pm PDT

Thanks everyone for coming at the presentation, it was great to have so many questions and seeing people so interested.

Picture of Itamar Hassin
Itamar Hassin
05/06/2009 5:16pm PDT

Excellent presentation!

Picture of Marc Love
Marc Love
05/06/2009 5:11pm PDT

Excellent presentation. Paolo gave a great introduction to RabbitMQ/Eventmachine and how to use messaging to build as he put it, “the nervous system of your application”. He also gave us resources so we can continue to expand our knowledge on the topic post-presentation and was very capable in answering the audience questions.

News and Coverage
co-presented by Ruby Central, Inc. O'Reilly
  • Engine Yard
  • Heroku
  • Sun Microsystems
  • Blue Box Group
  • New Relic

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at RailsConf, contact Yvonne Romaine at yromaine@oreilly.com.

Download the RailsConf Sponsor/Exhibitor Prospectus

Media Partner Opportunities

Download the Media & Promotional Partner Brochure (PDF) for information on trade opportunities with O'Reilly conferences or contact mediapartners@ oreilly.com

Program Ideas

Post your suggestions for speakers, topics, and activities on the RailsConf wiki or send an email to rails-idea@oreilly.com.

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com.

Contact Us

View a complete list of RailsConf 2009 contacts.