Scaling to Hundreds of Millions of Requests: What Worked and What Didn't

James Golick (Protose Inc.)
General
Location: Room 307 - 308
Average rating: ****.
(4.24, 45 ratings)

All over the web, people are constantly discussing the latest scalable database, the newest testing strategy, or even cloud computing. Claims are made about scalability, reliability, and performance. But by definition, most of this hype is simply conjecture. Its authors rarely have the experience to support their claims.

In the process of scaling our rails app to 150 million monthly pageviews, we’ve tested a lot of these technologies and ideas. We’ve put several popular and supposedly scalable NoSQL database solutions in to heavy production use. We’ve tried testing frameworks and ideas. We’ve deployed both cloud computing instances and physical hardware. Some things worked – others failed spectacularly.

In this talk, I’ll share our experiences, good and bad. These are some of the topics we’ll cover (time permitting):

  • Virtualization and Cloud Computing: Virtualized hardware is the default choice for new deployments. That makes sense – it’s easy to get started, and you only pay for what you need. But when (if ever) does it make sense to move to physical hardware? It might be sooner than you think.
  • NoSQL: NoSQL is all the rage. There are quite a few solutions, nearly all of them advertised as fast, scalable, reliable. But what is it really like to run and maintain them in production?
  • Rails Best-Practices: There are certain practices rails developers take for granted. Automated testing and fat models are a given on almost every rails project. But are these really optimal strategies? Are there ways we can write better-designed, more maintainable code?
  • Scaling Rails: Is it as simple as adding application servers? What’s the best system for offloading processing to the background? Does rails scale? We’ll answer the question once and for all.
Photo of James Golick

James Golick

Protose Inc.

James Golick’s software experience ranges from artificial intelligence to web front-end and JavaScript development. Most recently, James has fallen back in love with web development thanks to Ruby on Rails.

Since discovering Rails, James has become a prolific contributor to its open source ecosystem. He is the author of several popular plugins and gems, including friendly, resource_controller, and active_presenter. James has contributed to countless other projects, including rails itself.

James is an advocate for well-written, well-tested code and he blogs regularly about the practice of developing software. James is the CTO of Protose Inc.

Comments on this page are now closed.

Comments

Keith Norman
06/11/2010 4:51pm EDT

This talk was the ideal archetype for all talks. Content and information was clear, had practical implications, and was presented honestly with real world contexts. Thanks!

Steve Agalloco
06/10/2010 3:12pm EDT

I’ve played the role of lousy sysadmin before. Thanks for calling us out. Great talk.

Picture of Mike Subelsky
Mike Subelsky
06/10/2010 11:08am EDT

this was the best talk I attended by far; SUPER practical and interesting and really applicable to what I’m doing

Björn Sperber
06/09/2010 4:58pm EDT

Excellent talk! Real world observations presented in a brave and honest way. Thanks!

Picture of clay shentrup
clay shentrup
06/09/2010 4:29pm EDT

This guy was just awesome.

Picture of Carl Mercier
Carl Mercier
06/09/2010 4:23pm EDT

Awesome job James, very interesting, inspiring and informative.

co-presented by Ruby Central, Inc. O'Reilly
  • Engine Yard
  • Heroku
  • 8th Light
  • Blue Box Group
  • InfoEther
  • JetBrains
  • New Relic
  • Open Hosting
  • Rhomobile
  • WyeWorks
  • Linux Pro Magazine
  • Chargify

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at RailsConf, contact Yvonne Romaine at yromaine@oreilly.com.

Download the RailsConf Sponsor/Exhibitor Prospectus

Media Partner Opportunities

For information on trade opportunities with O'Reilly conferences or contact mediapartners@ oreilly.com

Program Ideas

Send us your suggestions for speakers, topics, and activities to rails-idea@oreilly.com.

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com.

RailsConf Newsletter

To stay abreast of conference news please sign up for the RailsConf newsletter (login required)

Contact Us

View a complete list of RailsConf 2010 contacts.