RabbitMQ use cases: NYTimes

Michael Laing, a Systems Architect at NYTimes, gave a great decription of their use of RabbitMQ and their overall architecture on the RabbitMQ mailing list, which later also appeared on High Scalability –  NYTimes Architecture: No Head, No Master, No Single Point of Failure

We use Rabbit MQ as our message passing system. Right now, the messages we handle are things like Breaking News Alerts and Live Video alerts. Our internal clients send the fabrik these messages over AMQP. We then send them around our stack, ensuring they are delivered.

We have Rabbit in all layers of our stack, with shovels connecting them. Our own internal code helps route the messages based on there services level. Some messages, like Breaking News, must go out as quickly as possible. So we spread these out over out clusters AND shovel them to clusters in other regions for processing. From there the messages get send to the front end for delivery.

We also use Rabbit for individual messages. If you are a registered NYTimes users, we can send you personally a message. Things like credit card expiring.

 

Advertisements