Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-10189

Server crash under load

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major - P3 Major - P3
    • None
    • None
    • None
    • None
    • ALL

    Description

      Looks like a lack of memory. Either way I would expect it to slow down and not crash.

      Fri Jul 12 05:21:59.717 [conn843] authenticate db: local

      { authenticate: 1, nonce: "237b181d39d143ae", user: "__system", key: "3597fb4d02ab28d832f8d 993" }

      Fri Jul 12 05:22:07.589 [conn782] serverStatus was very slow:

      { after basic: 0, after asserts: 0, after backgroundFlushing: 0, after connections: 0, rsors: 0, after dur: 0, after extra_info: 0, after globalLock: 0, after indexCounters: 0, after locks: 0, after network: 0, after opcounters: 0, afte tersRepl: 0, after recordStats: 4010, after repl: 4020, at end: 4020 }

      Fri Jul 12 05:22:07.591 [conn782] command admin.$cmd command:

      { serverStatus: 1 }

      ntoreturn:1 keyUpdates:0 locks(micros) r:30 reslen:4014 5037ms
      Fri Jul 12 05:22:07.652 [conn782] command denied:

      { writeBacksQueued: 1 }

      Fri Jul 12 05:22:11.901 [journal] Assertion: 13524:out of memory AlignedBuilder
      0xdc7f71 0xd8963b 0xd8760c 0xd87639 0x91f55e 0x91f922 0x914b11 0x916759 0x916b1b 0xe10879 0x7fc0107fb851 0x7fc00fb9e11d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdc7f71]
      /usr/bin/mongod(_ZN5mongo11msgassertedEiPKc+0x9b) [0xd8963b]
      /usr/bin/mongod() [0xd8760c]
      /usr/bin/mongod(_ZN5mongo14AlignedBuilder8_reallocEjj+0x29) [0xd87639]
      /usr/bin/mongod(_ZN5mongo3dur7Journal7journalERKNS0_11JSectHeaderERKNS_14AlignedBuilderE+0x4e) [0x91f55e]
      /usr/bin/mongod(_ZN5mongo3dur14WRITETOJOURNALENS0_11JSectHeaderERNS_14AlignedBuilderE+0x32) [0x91f922]
      /usr/bin/mongod(_ZN5mongo3dur27groupCommitWithLimitedLocksEv+0x141) [0x914b11]
      /usr/bin/mongod() [0x916759]
      /usr/bin/mongod(_ZN5mongo3dur9durThreadEv+0x2eb) [0x916b1b]
      /usr/bin/mongod() [0xe10879]
      /lib64/libpthread.so.0(+0x7851) [0x7fc0107fb851]
      /lib64/libc.so.6(clone+0x6d) [0x7fc00fb9e11d]
      Fri Jul 12 05:22:12.045 [journal] dbexception in groupCommitLL causing immediate shutdown: 13524 out of memory AlignedBuilder
      Fri Jul 12 05:22:12.045 dur1
      Fri Jul 12 05:22:12.049 Got signal: 6 (Aborted).

      Fri Jul 12 05:22:12.059 Backtrace:
      0xdc7f71 0x6ce459 0x7fc00fae8920 0x7fc00fae88a5 0x7fc00faea085 0x9e3ee7 0x914f3f 0x916759 0x916b1b 0xe10879 0x7fc0107fb851 0x7fc00fb9e11d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdc7f71]
      /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x6ce459]
      /lib64/libc.so.6(+0x32920) [0x7fc00fae8920]
      /lib64/libc.so.6(gsignal+0x35) [0x7fc00fae88a5]
      /lib64/libc.so.6(abort+0x175) [0x7fc00faea085]
      /usr/bin/mongod(_ZN5mongo10mongoAbortEPKc+0x47) [0x9e3ee7]
      /usr/bin/mongod(_ZN5mongo3dur27groupCommitWithLimitedLocksEv+0x56f) [0x914f3f]
      /usr/bin/mongod() [0x916759]
      /usr/bin/mongod(_ZN5mongo3dur9durThreadEv+0x2eb) [0x916b1b]
      /usr/bin/mongod() [0xe10879]
      /lib64/libpthread.so.0(+0x7851) [0x7fc0107fb851]
      /lib64/libc.so.6(clone+0x6d) [0x7fc00fb9e11d]

      Attachments

        Activity

          People

            schwerin@mongodb.com Andy Schwerin
            dharshanr@scalegrid.net Dharshan Rangegowda
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: