[rabbitmq-discuss] Logging, searching, graphing and alerting on millions of log messages with RabbitMQ

Sun Jul 8 20:49:53 BST 2012

In this context let me to also advertise my project related to
distributed logging: http://code.google.com/p/greg/
It's an extremely efficient centralized logger with clock
synchronization (more precise than NTP). It's been used in a
production cluster environment with 10000 clients and handled up to
500,000 messages/sec throughput.
(more precisely, this is a from-scratch reimplementation of the
approach used in a closed-source tool I wrote for that cluster
computing project which had those performance characteristics, but
this one also got some testing in much smaller environments and showed
similar performance)

In comparison to your project, it doesn't have any advanced features
like alerts, but it has clock synchronization and is probably faster.

On Sat, Jul 7, 2012 at 3:09 AM, Russell Allen
<russell.homeserver at gmail.com> wrote:
> Hi all,
>
> Thought some of you might be interested in a project I'm working on that's
> using RabbitMQ, a custom AMQP Log4Net appender (Gelf4Net) and a couple of
> subscribers to handle logs from a distributed IT infrastructure. I work in a
> .Net team, so the plan is to use Log4Net with Gelf4Net to log to a RabbitMQ
> queue. I'll then have two consumers, GrayLog2 and NEsper, giving me the
> ability to dig into historic log data and alert on certain critical messages
> respectively.
>
> At the moment I've got two blog posts up:
>
> Enterprise Logging and Alerting with Graylog2, RabbitMq and NEsper
> Enterprise Logging Part 2 - Logging From .Net to RabbitMq via Log4Net
>
> If anyone's interested, I'll be tweeting about things (over at @RussPAll),
> if people want me to keep this discussion list up to date as well let me
> know.
>
> Thanks,
>
> Russ
>
> _______________________________________________
> rabbitmq-discuss mailing list
> rabbitmq-discuss at lists.rabbitmq.com
> https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
>

-- 
Eugene Kirpichov
http://www.linkedin.com/in/eugenekirpichov