[rabbitmq-discuss] Queue disappears after basic reject operation from client?

Brian Jones bkjones at gmail.com
Fri Jul 6 15:52:22 BST 2012


Hi all,

We're running RabbitMQ/Erlang == 2.8.1 / R14A

We're (currently, don't get me started) using kombu to talk to RabbitMQ
from some Python code.

We've come across a strange issue where, best we can tell, a consumer
rejects a message, and that's followed by the complete disappearance of the
queue. I'm not even sure if these two events are actually correllated (more
testing is being done now to try and reliably reproduce the issue), but in
checking out the queue's configuration options, I don't see a reason in the
configuration that would point to something more obvious like, say, "queue
has a single consumer that crashes & it's configured w/ auto-delete=true"
or something.

Here's the only log information that seemed to be relevant. If anyone has
clues or pointers, they're much appreciated.

=ERROR REPORT==== 3-Jul-2012::18:34:28 ===
** Generic server <0.14335.436> terminating
** Last message in was {'$gen_cast',{gm,{fold,undefined,"\b"}}}

** When Server state == {state,
                         {amqqueue,
                          {resource,<<"/">>,queue,

                           <<"evo.workers.do_stuff.with_things">>},
                          true,false,none,
                          [{<<"x-ha-policy">>,longstr,<<"all">>}],
                          <7472.27433.653>,[],all},
                         <0.14337.436>,<7472.27433.653>,rabbit_variable_queue,

                         {vqstate,
                          {0,{[],[]}},
                          {0,{[],[]}},
                          {delta,undefined,0,undefined},
                          {0,{[],[]}},
                          {0,{[],[]}},
                          9,

                          {1,
                           {8,
                            {msg_status,8,
                             <<8,106,184,177,219,146,140,107,196,247,218,34,
                               138,15,137,90>>,
                             undefined,true,true,true,true,
                             {message_properties,undefined,false}},
                            nil,nil}},
                          undefined,
                          {0,nil},

                          {qistate,

"/var/lib/rabbitmq/mnesia/s-rabbit1/queues/6SK5DU9WSNS31F15H65PWTGEF",
                           {{dict,0,16,16,8,80,48,
                             {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},
                             {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
                               []}}},
                            [{segment,0,

"/var/lib/rabbitmq/mnesia/s-rabbit1/queues/6SK5DU9WSNS31F15H65PWTGEF/0.idx",
                              {array,16384,0,undefined,
                               {{{{{undefined,undefined,undefined,undefined,

                                    undefined,undefined,undefined,undefined,
                                    {{<<8,106,184,177,219,146,140,107,196,247,

                                        218,34,138,15,137,90>>,
                                      {message_properties,undefined,true},
                                      true},
                                     del,no_ack},
                                    undefined},
                                   10,10,10,10,10,10,10,10,10,10},
                                  100,100,100,100,100,100,100,100,100,100},
                                 1000,1000,1000,1000,1000,1000,1000,1000,1000,
                                 1000},
                                10000,10000,10000,10000,10000,10000,10000,
                                10000,10000,10000}},
                              1}]},
                           #Ref<0.0.113.112114>,2,262144,
                           #Fun<rabbit_variable_queue.2.91259159>,
                           {0,nil}},
                          {{client_msstate,msg_store_persistent,
                            <<45,226,10,206,192,135,238,119,205,177,43,46,24,
                              159,170,52>>,
                            {dict,0,16,16,8,80,48,
                             {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},
                             {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
                               []}}},
                            {state,311369,

"/var/lib/rabbitmq/mnesia/s-rabbit1/msg_store_persistent"},
                            rabbit_msg_store_ets_index,

"/var/lib/rabbitmq/mnesia/s-rabbit1/msg_store_persistent",
                            <0.246.0>,315466,307272,319563,323660},
                           {client_msstate,msg_store_transient,
                            <<172,50,239,59,161,4,42,98,116,42,171,120,108,181,

                              1,76>>,
                            {dict,0,16,16,8,80,48,
                             {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},
                             {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
                               []}}},
                            {state,290884,

"/var/lib/rabbitmq/mnesia/s-rabbit1/msg_store_transient"},
                            rabbit_msg_store_ets_index,


"/var/lib/rabbitmq/mnesia/s-rabbit1/msg_store_transient",
                            <0.241.0>,294981,286787,299078,303175}},

                          true,0,#Fun<rabbit_mirror_queue_slave.3.29941254>,0,
                          1,infinity,0,0,0,0,0,
                          {rates,
                           {{1341,329623,60054},2},
                           {{1341,329623,60054},2},
                           1.8427213725389851e-4,1.8427213725389851e-4,
                           {1341,340467,310020}},
                          {0,nil},
                          {0,nil},

                          {0,nil},
                          {0,nil},
                          0,0,
                          {rates,
                           {{1341,329623,60054},0},
                           {{1341,329623,60054},2},
                           0.0,1.8427213725389851e-4,
                           {1341,340467,310020}}},
                         undefined,undefined,
                         {dict,2,16,16,8,80,48,
                          {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},
                          {{[],[],
                            [[<7471.28937.766>|
                              {{[],[]},
                               {set,0,16,16,8,80,48,
                                {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
                                 []},
                                {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],
                                  [],[]}}}}]],
                            [],
                            [[<7471.28955.766>|
                              {{[],[]},
                               {set,0,16,16,8,80,48,
                                {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],

                                 []},
                                {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],
                                  [],[]}}}}]],
                            [],[],[],[],[],[],[],[],[],[],[]}}},
                         {dict,1,16,16,8,80,48,
                          {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},
                          {{[],[],
                            [[<<8,106,184,177,219,146,140,107,196,247,218,34,
                                138,15,137,90>>|
                              {9,8}]],
                            [],[],[],[],[],[],[],[],[],[],[],[],[]}}},
                         10,
                         {dict,0,16,16,8,80,48,
                          {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},

                          {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},
                         {dict,2,16,16,8,80,48,
                          {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},
                          {{[],[],
                            [[<7471.28937.766>|#Ref<0.0.149.86308>]],
                            [],
                            [[<7471.28955.766>|#Ref<0.0.149.81297>]],
                            [],[],[],[],[],[],[],[],[],[],[]}}},

                         true}
** Reason for termination ==
** {function_clause,
       [{rabbit_variable_queue,fold,
            ["\b",undefined,
             {vqstate,
                 {0,{[],[]}},

                 {0,{[],[]}},
                 {delta,undefined,0,undefined},
                 {0,{[],[]}},
                 {0,{[],[]}},
                 9,
                 {1,
                  {8,
                   {msg_status,8,
                       <<8,106,184,177,219,146,140,107,196,247,218,34,138,15,
                         137,90>>,

                       undefined,true,true,true,true,
                       {message_properties,undefined,false}},
                   nil,nil}},

                 undefined,
                 {0,nil},
                 {qistate,

"/var/lib/rabbitmq/mnesia/s-rabbit1/queues/6SK5DU9WSNS31F15H65PWTGEF",
                     {{dict,0,16,16,8,80,48,
                          {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},
                          {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},
                      [{segment,0,

"/var/lib/rabbitmq/mnesia/s-rabbit1/queues/6SK5DU9WSNS31F15H65PWTGEF/0.idx",

                           {array,16384,0,undefined,
                               {{{{{undefined,undefined,undefined,undefined,
                                       undefined,undefined,undefined,
                                       undefined,
                                       {{<<8,106,184,177,219,146,140,107,196,

                                           247,218,34,138,15,137,90>>,
                                         {message_properties,undefined,true},

                                         true},
                                        del,no_ack},
                                       undefined},
                                   10,10,10,10,10,10,10,10,10,10},
                                  100,100,100,100,100,100,100,100,100,100},

                                 1000,1000,1000,1000,1000,1000,1000,1000,1000,
                                 1000},
                                10000,10000,10000,10000,10000,10000,10000,
                                10000,10000,10000}},
                           1}]},
                     #Ref<0.0.113.112114>,2,262144,
                     #Fun<rabbit_variable_queue.2.91259159>,
                     {0,nil}},
                 {{client_msstate,msg_store_persistent,
                      <<45,226,10,206,192,135,238,119,205,177,43,46,24,159,170,
                        52>>,
                      {dict,0,16,16,8,80,48,
                          {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},
                          {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},
                      {state,311369,

"/var/lib/rabbitmq/mnesia/s-rabbit1/msg_store_persistent"},

                      rabbit_msg_store_ets_index,
                      "/var/lib/rabbitmq/mnesia/s-rabbit1/msg_store_persistent",
                      <0.246.0>,315466,307272,319563,323660},
                  {client_msstate,msg_store_transient,
                      <<172,50,239,59,161,4,42,98,116,42,171,120,108,181,1,76>>,

                      {dict,0,16,16,8,80,48,
                          {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},
                          {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},
                      {state,290884,

"/var/lib/rabbitmq/mnesia/s-rabbit1/msg_store_transient"},

                      rabbit_msg_store_ets_index,
                      "/var/lib/rabbitmq/mnesia/s-rabbit1/msg_store_transient",
                      <0.241.0>,294981,286787,299078,303175}},
                 true,0,#Fun<rabbit_mirror_queue_slave.3.29941254>,0,1,
                 infinity,0,0,0,0,0,
                 {rates,
                     {{1341,329623,60054},2},
                     {{1341,329623,60054},2},
                     1.8427213725389851e-4,1.8427213725389851e-4,
                     {1341,340467,310020}},
                 {0,nil},
                 {0,nil},

                 {0,nil},
                 {0,nil},
                 0,0,
                 {rates,

                     {{1341,329623,60054},0},
                     {{1341,329623,60054},2},
                     0.0,1.8427213725389851e-4,

                     {1341,340467,310020}}}]},
        {rabbit_mirror_queue_slave,process_instruction,2},
        {rabbit_mirror_queue_slave,handle_cast,2},
        {gen_server2,handle_msg,2},
        {proc_lib,wake_up,3}]}



-- 
Brian K. Jones
My Blog          http://www.protocolostomy.com
Follow me      http://twitter.com/bkjones
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rabbitmq.com/pipermail/rabbitmq-discuss/attachments/20120706/174e2b49/attachment.htm>


More information about the rabbitmq-discuss mailing list