Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-9323

client session locks up when mongos socket goes into state warning: waiting for writeback 5166929d0000000000000492 from connection

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical - P2
    • Resolution: Fixed
    • Affects Version/s: 2.2.3
    • Fix Version/s: None
    • Component/s: Networking, Sharding
    • Labels:
      None
    • Operating System:
      ALL

      Description

      Periodically (once per day, or so), we see a user session lockup. The application is blocked in socket receive on the client side.

      On deeper investigation, we see in the mongos log, the following error associated with the clients connection:

      Thu Apr 11 09:40:05 [mongosMain] connection accepted from 127.0.0.1:53783 #4647 (5 connections now open)
      Thu Apr 11 09:40:05 [conn4647]  authenticate db: admin { authenticate: 1, user: "user", nonce: "c2254607da35344c", key: "0bf3cc880910cfc46a8
      Thu Apr 11 09:40:05 [conn4647]  authenticate db: mongoose_user { authenticate: 1, user: "user", nonce: "290a3569e8124a12", key: "8316ad
      Thu Apr 11 10:33:34 [conn4647] ChunkManager: time to load chunks for mongoose.centaur: 3ms sequenceNumber: 300 version: 184|1||50fe9e767e7521213b
      Thu Apr 11 11:30:21 [conn4647] ChunkManager: time to load chunks for mongoose.centaur: 3ms sequenceNumber: 301 version: 186|1||50fe9e767e7521213b
      Thu Apr 11 11:34:03 [conn4647] ChunkManager: time to load chunks for mongoose.centaur: 2ms sequenceNumber: 302 version: 187|3||50fe9e767e7521213b
      Thu Apr 11 11:38:21 [conn4647] ChunkManager: time to load chunks for mongoose_user.centaur: 1ms sequenceNumber: 303 version: 40|1||514b1b95b
      Thu Apr 11 11:38:33 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:427
      Thu Apr 11 11:38:44 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:427
      Thu Apr 11 11:38:55 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:427
      ...
      Thu Apr 11 13:31:27 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3179 secs, currently at id 000000000000000000000000
      Thu Apr 11 13:31:38 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3190 secs, currently at id 000000000000000000000000
      Thu Apr 11 13:31:49 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3201 secs, currently at id 000000000000000000000000
      Thu Apr 11 13:32:00 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3212 secs, currently at id 000000000000000000000000
      Thu Apr 11 13:32:11 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3223 secs, currently at id 000000000000000000000000
      Thu Apr 11 13:32:22 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3234 secs, currently at id 000000000000000000000000
      Thu Apr 11 13:32:33 [conn4647] warning: waiting for writeback 5166929d0000000000000492 from connection dlonapahls210.maninvestments.com:27118:42718 for 3245 secs, currently at id 000000000000000000000000

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              spencer Spencer Brody (Inactive)
              Reporter:
              jblackburn James Blackburn
              Participants:
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: