<html><head></head><body bgcolor="#FFFFFF"><div>Hi Gavin,</div><div><br></div><div>On 21 Mar 2013, at 21:02, "Gavin M. Roy" <<a href="mailto:gmr@meetme.com">gmr@meetme.com</a>> wrote:<br></div><div></div><blockquote type="cite"><div>Fwiw in some advocacy discussions, the logging output was a reason some people have discounted or not moved forward with Rabbit.</div></blockquote><blockquote type="cite"><div><span style="">From conversations I have had recently with people, logging and config file syntax </span><span style=""></span><span style="">are the bigger </span><span style="">approachachability</span><span style=""> issues with Rabbit.</span><div>
<br></div></div></blockquote><div><br></div><div>That's a pity - the logging is something we could change. The config file syntax, not so much. I suppose we could bootstrap the prelaunch phase to parse and XML file (or whatever) and spew out the native format...</div><br><blockquote type="cite"><div><div>My goal is to be able to do log aggregation for our largish count of RabbitMQ nodes, which afaik is not possible with Rabbit out of the box. This makes it nearly impossible to stay on top of logs for anything but troubleshooting individual nodes when problems occur.</div></div></blockquote><div><br></div><div>Yeah with the current implementation you'd need to install your own log handler to make that work. In terms of changing the output format though, allowe to play devil's advocate for a moment...</div><div><br></div><div>The info/progress/error reports have a lot of data in them, process stats, stack traces, etc. are you wanting to see all that plonked on one single long line? Because I can see how that'd make parsing/aggregating easier, but not reading them. Does the lager output fit exactly with what you want (I've not looks at it or a couple of years)?</div><br><blockquote type="cite"><div><div><span></span></div>
<div><br>On Thursday, March 21, 2013, Ben Hood <<a href="mailto:0x6e6562@gmail.com">0x6e6562@gmail.com</a>> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
Hey Tim,
</div><div><br></div><div>Thanks for the heads up.</div><div><br></div><div>Cheers,</div><div><br></div><div>Ben</div>
<div></div>
<p style="color:#a0a0a8">On Thursday, 21 March 2013 at 12:36, Tim Watson wrote:</p>
<blockquote type="cite" style="border-left-style:solid;border-width:1px;margin-left:0px;padding-left:10px">
<span><div><div><div>Hi Ben,</div><div><br></div><div>On 21 Mar 2013, at 12:13, Ben Hood wrote:</div><blockquote type="cite"><div>I think a good start would be to implement Gavin's suggestion about having a more UNIXy output, since you could do this without having to change the transport.</div>
</blockquote><div><br></div><div>That's an understand-able requirement, however...</div><div><br></div><blockquote type="cite"><div><div>If you are aggregating lots of Rabbit logs, this results in lots of double entries such as</div>
<div><br></div><div>Mar 21 12:05:30 a logger: : =INFO REPORT==== 21-Mar-2013::12:05:29 === </div><div>Mar 21 12:05:30 a logger: : started TCP Listener on [::]:5672</div></div></blockquote><div><br></div><div>Sure - that multi-line output is what Erlang's built in error_logger generates. </div>
<div><br></div><blockquote type="cite"><div>If I understand Gavin correctly, you could improve the SNR by putting this on one line.</div></blockquote><div><br></div><div>To do that, we'd have to change from the built-in error_logger to something else, such as lager. That idea's been up for discussion before and as I said, I'll raise it again.</div>
<div><br></div><div>Cheers,</div><div>Tim</div><div><br></div><blockquote type="cite"><div><div>Cheers,</div><div><br></div><div>Ben</div><div><br></div><div>On Thursday, 21 March 2013 at 12:03, Tim Watson wrote:</div><div>
<br></div><blockquote type="cite"><div><div>Hi all,</div><div><br></div><div>We've discussed moving to a different (non-standard) logging provider before, and I'll raise the issue again. Afaik we've not run into the issues with error_logger very often (i.e., the reasons why lager was invented, viz massive memory consumption due to serialisation of large terms in logging output). The 'filtering possibilities' with lager don't necessarily require the parse_transforms to be used iirc - you can submit a logging request direct to lager and specify the log level at the call site. Again, I'll raise the discussion with the rest of the team and let's see what comes of that.</div>
<div><br></div><div>Cheers,</div><div>Tim</div><div><br></div><div>On 19 Mar 2013, at 08:48, Gotthard, Petr wrote:</div><div><br></div><blockquote type="cite"><div><div>Correct me if I’m wrong, but I don’t think that moving to lager requires any changes inside rabbitmq. Since rabbitmq (as far as I know) uses standard Erlang’s logging and since standard logs are redirected to lager, all rabbitmq related logs are processed by lager. Wihout many filtering possibilities though.</div>
<div>Petr</div><div>From: <a>rabbitmq-discuss-bounces@lists.rabbitmq.com</a> [<a>mailto:rabbitmq-discuss-bounces@lists.rabbitmq.com</a>] On Behalf Of Gavin M. Roy</div><div>Sent: 18. března 2013 17:36</div><div>To: Discussions about RabbitMQ</div>
<div>Subject: [rabbitmq-discuss] lager vs sasl error log</div><div>Any plans to move rabbitmq.log to lager (and allow for lager-syslog) while keeping rabbit-sasl.log for crash dumps?</div><div>Would be nice to be able to get the plugable loggers and improvements to logging performance lager purports to provide, as well as a more modern, *NIXy logging output.</div>
<div>Cheers,</div><div><br></div><div>Gavin</div><div>_______________________________________________</div><div>rabbitmq-discuss mailing list</div><div><a>rabbitmq-discuss@lists.rabbitmq.com</a></div><div><a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank">https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss</a></div>
</div></blockquote><div><br></div><div>_______________________________________________</div><div>rabbitmq-discuss mailing list</div><div><a>rabbitmq-discuss@lists.rabbitmq.com</a></div><div><a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank">https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss</a></div>
</div></blockquote><div><br></div><div>_______________________________________________</div><div>rabbitmq-discuss mailing list</div><div><a>rabbitmq-discuss@lists.rabbitmq.com</a></div><div><a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss" target="_blank"></a></div>
</div></blockquote></div></div></span></blockquote></blockquote></div><br><br>-- <br>
<p><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">Gavin M. Roy</span><br style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
<span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">Chief Technology Officer</span><br style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
</p><blockquote style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255);padding-left:1ex;border-left-color:rgb(204,204,204);border-left-style:solid;margin:0px 0px 0px 0.8ex;border-left-width:1px">
</blockquote><a href="http://www.meetme.com/" style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)" target="_blank"><img src="http://movies.myyearbook.com/emailsignatureimages/logo2.png"></a><br style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
<font color="#666666" style="font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">100 Union Square Drive<br>New Hope, PA 18938<br>p. +1.215.862.1162 x263<br>f. +1.215.862.0465</font><p></p><p><a href="https://www.facebook.com/pages/MeetMe/21931227129" style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)" target="_blank"><img src="http://movies.myyearbook.com/emailsignatureimages/fb_mini.gif"></a><span style="font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255);color:rgb(136,136,136)"> </span><span style="font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255);color:rgb(136,136,136)"> </span><span style="font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255);color:rgb(136,136,136)"> </span><a href="https://twitter.com/meetme" style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)" target="_blank"><img src="http://movies.myyearbook.com/emailsignatureimages/tw_mini.gif"></a><span style="font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255);color:rgb(136,136,136)"> </span><span style="font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255);color:rgb(136,136,136)"> </span><span style="font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255);color:rgb(136,136,136)"> </span><a href="http://www.youtube.com/user/MeetMeVideos" style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)" target="_blank"><img src="http://movies.myyearbook.com/emailsignatureimages/yt_mini.gif"></a><br style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
<font color="#888888" style="font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)"><br></font><font color="#666666" style="font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)"><font>The public market leader in social discovery. </font><font>(NYSE MKT: MEET)</font> </font></p>
<br>
</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>rabbitmq-discuss mailing list</span><br><span><a href="mailto:rabbitmq-discuss@lists.rabbitmq.com">rabbitmq-discuss@lists.rabbitmq.com</a></span><br><span><a href="https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss">https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss</a></span><br></div></blockquote></body></html>