Craigslist Adopting MongoDB

May 16, 2011

This post is part of our ReadWriteCloud channel, which is dedicated to covering virtualization and cloud computing. The channel is sponsored by Intel and VMware. Read the white paper about how Intel Xeon processors help organizations get unprecedented levels of performance.

Craigslist logo In a big win for MongoDB and its sponsor company 10Gen, Craigslist is migrating its archives to MongoDB. In an interview on the MongoDB blog, Jeremy Zawodny of Craigslist explains that the company is moving around two billion documents into a MongoDB cluster.

Craigslist is just using MongoDB for its archive of deleted and expired posts, not for the posts that are live on the site. However, in a video presentation Zawodny made it clear that the archive is in use by the live site – it’s not just “cold storage” for old posts.

From the introduction to the interview, here’s a run down of the problems Craigslist needed a new database to solve:

Craiglist has kept every post anyone has ever made in a large MySQL cluster. A few months ago, they began looking for alternatives: schema changes were taking forever (Craigslist’s schema has changed a couple times since 1995) and it wasn’t really relational information. They wanted to be able to add new machines without downtime (which sharding provides) and route around dead machines without clients failing (which replica sets provide), so MongoDB was a very strong candidate. After looking into a few of the most popular non-relational database systems, they decided to go with MongoDB.

For those who want more, Zawodny talks about why the company decided to add a NoSQL database, why it chose MongoDB and the challenges he’s faced during the migration in this video.

Posted in

Architecture

and tagged with

  • Comment
  • Subscribe

  • Email This
  • Print This

  • Tweet This

  • ShareShare

Tell us about your road to the cloud and win a MacBook Air with an Intel® Core™ 2 Duo Processor. This month’s question:

What is IT-as-a-Service and how do you determine its value for the enterprise?

In a big win for MongoDB and its sponsor company 10Gen, Craigslist is migrating its archives to MongoDB. In an interview on the MongoDB blog, Jeremy Zawodny of Craigslist explains that the company is moving around two billion documents into a MongoDB cluster.nnCraigslist is just using MongoDB for its archive of deleted and expired posts, not for the posts that are live on the site. However, in a video presentation Zawodny made it clear that the archive is in use by the live site – it’s not just “cold storage” for old posts.
Please enable JavaScript to view the comments powered by Disqus.

Tags:

Leave a Reply

Your email address will not be published. Required fields are marked *

*

Like Box

- Facebook Members WordPress Plugin

Links

  • 4 Hour Workweek Blog
  • All Things Digital
  • Beyond The Pedway
  • Business Hackers
  • Entrepreneur.com
  • Fast Company
  • Gigaom
  • Hacker News
  • Jonathan Fields
  • Mashable
  • Mixergy.com
  • Read Write Web
  • Seth Godin's Blog
  • Startup Nation
  • TechCrunch
  • The Next Web
  • Venture Beat