Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-9323

client session locks up when mongos socket goes into state warning: waiting for writeback 5166929d0000000000000492 from connection

XMLWordPrintableJSON

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Critical - P2 Critical - P2
    • None
    • Affects Version/s: 2.2.3
    • Component/s: Networking, Sharding
    • Labels:
      None
    • ALL

      Periodically (once per day, or so), we see a user session lockup. The application is blocked in socket receive on the client side.

      On deeper investigation, we see in the mongos log, the following error associated with the clients connection:

      Thu Apr 11 09:40:05 [mongosMain] connection accepted from 127.0.0.1:53783 #4647 (5 connections now open)
Thu Apr 11 09:40:05 [conn4647]  authenticate db: admin { authenticate: 1, user: "user", nonce: "c2254607da35344c", key: "0bf3cc880910cfc46a8
Thu Apr 11 09:40:05 [conn4647]  authenticate db: mongoose_user { authenticate: 1, user: "user", nonce: "290a3569e8124a12", key: "8316ad
Thu Apr 11 10:33:34 [conn4647] ChunkManager: time to load chunks for mongoose.centaur: 3ms sequenceNumber: 300 version: 184|1||50fe9e767e7521213b
Thu Apr 11 11:30:21 [conn4647] ChunkManager: time to load chunks for mongoose.centaur: 3ms sequenceNumber: 301 version: 186|1||50fe9e767e7521213b
Thu Apr 11 11:34:03 [conn4647] ChunkManager: time to load chunks for mongoose.centaur: 2ms sequenceNumber: 302 version: 187|3||50fe9e767e7521213b
Thu Apr 11 11:38:21 [conn4647] ChunkManager: time to load chunks for mongoose_user.centaur: 1ms sequenceNumber: 303 version: 40|1||514b1b95b
Thu Apr 11 11:38:33 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:427
Thu Apr 11 11:38:44 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:427
Thu Apr 11 11:38:55 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:427
...
Thu Apr 11 13:31:27 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3179 secs, currently at id 000000000000000000000000
Thu Apr 11 13:31:38 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3190 secs, currently at id 000000000000000000000000
Thu Apr 11 13:31:49 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3201 secs, currently at id 000000000000000000000000
Thu Apr 11 13:32:00 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3212 secs, currently at id 000000000000000000000000
Thu Apr 11 13:32:11 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3223 secs, currently at id 000000000000000000000000
Thu Apr 11 13:32:22 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3234 secs, currently at id 000000000000000000000000
Thu Apr 11 13:32:33 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3245 secs, currently at id 000000000000000000000000

            Assignee:
            spencer@mongodb.com Spencer Brody (Inactive)
            Reporter:
            jblackburn James Blackburn
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

              Created:
              Updated:
              Resolved: