|
Seeing similar crashes that appear to be related. Looks like a mutex assertion failure, followed by a segfault on free(). Not sure if those two issues are related or not. After the crash, it hung for a bit and then I sent a sigkill. Didn't seem to be any problems bringing the server back up or with any of the data since, so I'm not sure if this issue is benign or not. Seen this a couple times now during shutdown.
Another issue suggested it could be a script sending 2 sigterms. Double-checked my upstart script, and it looks like the timeout is set to 5mins and there's only a few seconds from the initial sigterm to the crash, so that's probably not it.
Logs are:
Thu Mar 29 01:45:59 got kill or ctrl c or hup signal 15 (Terminated), will terminate after current cmd ends
Thu Mar 29 01:45:59 [interruptThread] now exiting
Thu Mar 29 01:45:59 dbexit:
Thu Mar 29 01:45:59 [interruptThread] shutdown: going to close listening sockets...
Thu Mar 29 01:45:59 [interruptThread] closing listening socket: 6
Thu Mar 29 01:45:59 [interruptThread] closing listening socket: 7
Thu Mar 29 01:45:59 [interruptThread] closing listening socket: 8
Thu Mar 29 01:45:59 [interruptThread] removing socket file: /tmp/mongodb-27017.sock
Thu Mar 29 01:45:59 [interruptThread] shutdown: going to flush diaglog...
Thu Mar 29 01:45:59 [interruptThread] shutdown: going to close sockets...
Thu Mar 29 01:45:59 [interruptThread] shutdown: waiting for fs preallocator...
Thu Mar 29 01:45:59 [interruptThread] shutdown: lock for final commit...
Thu Mar 29 01:45:59 [interruptThread] shutdown: final commit...
Thu Mar 29 01:45:59 [conn7135] end connection 10.171.39.121:34578
Thu Mar 29 01:45:59 [interruptThread] shutdown: closing all files...
Thu Mar 29 01:45:59 [rsSync] Socket recv() errno:9 Bad file descriptor 10.171.39.121:27017
Thu Mar 29 01:45:59 [rsSync] SocketException: remote: 10.171.39.121:27017 error: 9001 socket exception [1] server [10.171.39.121:27017]
Thu Mar 29 01:45:59 [rsSync] replSet syncThread: 10278 dbclient error communicating with server: ec2-184-169-142-7.us-west-1.compute.amazonaws.com:27017
Thu Mar 29 01:45:59 ERROR: Client::shutdown not called: slaveTracking
Thu Mar 29 01:45:59 [conn3] end connection 10.160.187.150:36648
Thu Mar 29 01:45:59 [conn6854] end connection 10.176.73.6:42003
Thu Mar 29 01:46:00 [conn6849] end connection 10.160.182.97:34476
31/72 43%
Thu Mar 29 01:46:02 [conn6827] end connection 10.170.13.195:37402
Thu Mar 29 01:46:02 [conn6851] end connection 10.161.75.110:59138
44/72 61%
Thu Mar 29 01:46:03 [conn6864] end connection 10.166.209.196:37667
Thu Mar 29 01:46:03 [conn6859] end connection 10.176.85.130:40171
Thu Mar 29 01:46:03 [conn6850] end connection 10.160.83.215:50883
Thu Mar 29 01:46:04 [conn6869] end connection 10.170.14.115:42129
52/72 72%
Thu Mar 29 01:46:05 [conn6857] end connection 10.170.31.150:36104
Thu Mar 29 01:46:06 [interruptThread] closeAllFiles() finished
Thu Mar 29 01:46:06 [interruptThread] journalCleanup...
Thu Mar 29 01:46:06 [interruptThread] removeJournalFiles
Thu Mar 29 01:46:06 [interruptThread] shutdown: removing fs lock...
Thu Mar 29 01:46:06 dbexit: really exiting now
Thu Mar 29 01:46:06 [conn6832] end connection 10.160.177.161:52709
Logstream::get called in uninitialized state
Thu Mar 29 01:46:06 [conn6855] end connection 10.160.50.124:49433
mongod: /opt/extra/include/boost/thread/pthread/pthread_mutex_scoped_lock.hpp:25: boost::pthread::pthread_mutex_scoped_lock::pthread_mutex_scoped_lock(pthread_mutex_t*): Assertion `!pthread_mutex_lock(m)' failed.
Thu Mar 29 01:46:06 Got signal: 6 (Aborted).
Thu Mar 29 01:46:06 Backtrace:
0xa90999 0x7f1d49408420 0x7f1d494083a5 0x7f1d4940bb0b 0x7f1d49400d4d 0x637bc4 0x7f1d49f19efc 0x7f1d494b389d
/usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa90999]
/lib/x86_64-linux-gnu/libc.so.6(+0x36420) [0x7f1d49408420]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f1d494083a5]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x17b) [0x7f1d4940bb0b]
/lib/x86_64-linux-gnu/libc.so.6(__assert_fail+0xdd) [0x7f1d49400d4d]
/usr/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0xa44) [0x637bc4]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7efc) [0x7f1d49f19efc]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f1d494b389d]
Thu Mar 29 01:46:06 *** glibc detected *** /usr/bin/mongod: free(): corrupted unsorted chunks: 0x00000000030cef80 ***
Invalid access at address: 0
Thu Mar 29 01:46:06 Got signal: 11 (Segmentation fault).
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(+0x78a96)[0x7f1d4944aa96]
/lib/x86_64-linux-gnu/libc.so.6(cfree+0x6c)[0x7f1d4944ed7c]
/lib/x86_64-linux-gnu/libc.so.6(+0x3b821)[0x7f1d4940d821]
/lib/x86_64-linux-gnu/libc.so.6(+0x3b8a5)[0x7f1d4940d8a5]
/usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x5ee)[0xa90bee]
Thu Mar 29 01:46:06 Backtrace:
0xa90999 0xa90f70 0x7f1d49f22060 0x7f1d4940d7d3 0x7f1d4940d8a5 0x88a708 0x88ae6b 0xa8fce1 0xaab3e0 0x7f1d49f19efc 0x7f1d494b389d
/usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa90999]
/usr/bin/mongod(_ZN5mongo24abruptQuitWithAddrSignalEiP7siginfoPv+0x220) [0xa90f70]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x10060) [0x7f1d49f22060]
/lib/x86_64-linux-gnu/libc.so.6(+0x3b7d3) [0x7f1d4940d7d3]
/lib/x86_64-linux-gnu/libc.so.6(+0x3b8a5) [0x7f1d4940d8a5]
/usr/bin/mongod(_ZN5mongo6dbexitENS_8ExitCodeEPKcb+0x1e8) [0x88a708]
/usr/bin/mongod(_ZN5mongo11exitCleanlyENS_8ExitCodeE+0x10b) [0x88ae6b]
/usr/bin/mongod(_ZN5mongo15interruptThreadEv+0xa1) [0xa8fce1]
/usr/bin/mongod(thread_proxy+0x80) [0xaab3e0]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7efc) [0x7f1d49f19efc]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f1d494b389d]
/lib/x86_64-linux-gnu/libc.so.6(+0x36420)[0x7f1d49408420]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35)[0x7f1d494083a5]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x17b)[0x7f1d4940bb0b]
/lib/x86_64-linux-gnu/libc.so.6(__assert_fail+0xdd)[0x7f1d49400d4d]
/usr/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0xa44)[0x637bc4]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7efc)[0x7f1d49f19efc]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f1d494b389d]
======= Memory map: ========
00400000-00c26000 r-xp 00000000 ca:01 14339 /usr/bin/mongod
00e25000-00e45000 rw-p 00825000 ca:01 14339 /usr/bin/mongod
00e45000-0184c000 rw-p 00000000 00:00 0
03084000-0924f000 rw-p 00000000 00:00 0 [heap]
7ee504000000-7ee50563e000 rw-p 00000000 00:00 0
7ee50563e000-7ee508000000 ---p 00000000 00:00 0
7ee50c000000-7ee50faab000 rw-p 00000000 00:00 0
7ee50faab000-7ee510000000 ---p 00000000 00:00 0
7ee610000000-7ee611819000 rw-p 00000000 00:00 0
7ee611819000-7ee614000000 ---p 00000000 00:00 0
7ee614000000-7ee6156e1000 rw-p 00000000 00:00 0
7ee6156e1000-7ee618000000 ---p 00000000 00:00 0
7ee61c000000-7ee620000000 rw-p 00000000 00:00 0
7ee627ddb000-7ee627ddc000 ---p 00000000 00:00 0
7ee627ddc000-7ee627edc000 rw-p 00000000 00:00 0
7ee627edc000-7ee627edd000 ---p 00000000 00:00 0
7ee627edd000-7ee627fdd000 rw-p 00000000 00:00 0
7ee6280de000-7ee6280df000 ---p 00000000 00:00 0
7ee6280df000-7ee6281df000 rw-p 00000000 00:00 0
7ee6281df000-7ee6281e0000 ---p 00000000 00:00 0
7ee6281e0000-7ee6282e0000 rw-p 00000000 00:00 0
7ee6282e0000-7ee6282e1000 ---p 00000000 00:00 0
7ee6282e1000-7ee6283e1000 rw-p 00000000 00:00 0
7ee6288e6000-7ee6288e7000 ---p 00000000 00:00 0
7ee6288e7000-7ee6289e7000 rw-p 00000000 00:00 0
7ee62cbe5000-7ee62cbe6000 ---p 00000000 00:00 0
7ee62cbe6000-7ee62cce6000 rw-p 00000000 00:00 0
7ee62d1eb000-7ee62d1ec000 ---p 00000000 00:00 0
7ee62d1ec000-7ee62d2ec000 rw-p 00000000 00:00 0
7ee62d3ed000-7ee62d3ee000 ---p 00000000 00:00 0
7ee62d3ee000-7ee62d4ee000 rw-p 00000000 00:00 0
7ee62d4ee000-7ee62d4ef000 ---p 00000000 00:00 0
7ee62d4ef000-7ee62d5ef000 rw-p 00000000 00:00 0
7ee62d5ef000-7ee62d5f0000 ---p 00000000 00:00 0
7ee62d5f0000-7ee62d6f0000 rw-p 00000000 00:00 0
7ee62d9d8000-7ee62d9d9000 ---p 00000000 00:00 0
7ee62d9d9000-7ee62dad9000 rw-p 00000000 00:00 0
7ee62dbda000-7ee62dbdb000 ---p 00000000 00:00 0
7ee62dbdb000-7ee62dcdb000 rw-p 00000000 00:00 0
7ee62dddc000-7ee62dddd000 ---p 00000000 00:00 0
7ee62dddd000-7ee62dedd000 rw-p 00000000 00:00 0
7ee62dfde000-7ee62dfdf000 ---p 00000000 00:00 0
7ee62dfdf000-7ee62e0df000 rw-p 00000000 00:00 0
7ee62e0df000-7ee62e0e0000 ---p 00000000 00:00 0
7ee62e0e0000-7ee62e1e0000 rw-p 00000000 00:00 0
7ee62e3e2000-7ee62e3e3000 ---p 00000000 00:00 0
7ee62e3e3000-7ee62e4e3000 rw-p 00000000 00:00 0
7ee62e5e4000-7ee62e5e5000 ---p 00000000 00:00 0
7ee62e5e5000-7ee62e6e5000 rw-p 00000000 00:00 0
7ee62e8e7000-7ee62e8e8000 ---p 00000000 00:00 0
7ee62e8e8000-7ee62e9e8000 rw-p 00000000 00:00 0
7ee62ebea000-7ee62ebeb000 ---p 00000000 00:00 0
7ee62ebeb000-7ee62eceb000 rw-p 00000000 00:00 0
7ee62f1f0000-7ee62f1f1000 ---p 00000000 00:00 0
7ee62f1f1000-7ee62f2f1000 rw-p 00000000 00:00 0
7ee62f3f2000-7ee62f3f3000 ---p 00000000 00:00 0
7ee62f3f3000-7ee62f4f3000 rw-p 00000000 00:00 0
7ee62f4f3000-7ee62f4f4000 ---p 00000000 00:00 0
7ee62f4f4000-7ee62f5f4000 rw-p 00000000 00:00 0
7ee62f5f4000-7ee62f5f5000 ---p 00000000 00:00 0
7ee62f5f5000-7ee62f6f5000 rw-p 00000000 00:00 0
7ee62f7f6000-7ee62f7f7000 ---p 00000000 00:00 0
7ee62f7f7000-7ee62f8f7000 rw-p 00000000 00:00 0
7f0e24cf9000-7f0e24cfa000 ---p 00000000 00:00 0
7f0e24cfa000-7f0e24dfa000 rw-p 00000000 00:00 0
7f0e24dfa000-7f0e24dfb000 ---p 00000000 00:00 0
7f0e24dfb000-7f0e255fb000 rw-p 00000000 00:00 0
7f0e255fb000-7f0e255fc000 ---p 00000000 00:00 0
7f0e255fc000-7f0e25dfc000 rw-p 00000000 00:00 0
7f0e25dfc000-7f0e25dfd000 ---p 00000000 00:00 0
7f0e25dfd000-7f0e265fd000 rw-p 00000000 00:00 0
7f0e265fd000-7f0e265fe000 ---p 00000000 00:00 0
7f0e265fe000-7f0e26dfe000 rw-p 00000000 00:00 0
7f1d3f7ff000-7f1d3f800000 ---p 00000000 00:00 0
7f1d3f800000-7f1d40000000 rw-p 00000000 00:00 0
7f1d40000000-7f1d44000000 rw-p 00000000 00:00 0
7f1d44095000-7f1d44096000 ---p 00000000 00:00 0
7f1d44096000-7f1d44196000 rw-p 00000000 00:00 0
7f1d44196000-7f1d441ad000 r-xp 00000000 ca:01 134627 /lib/x86_64-linux-gnu/libresolv-2.13.so
7f1d441ad000-7f1d443ad000 ---p 00017000 ca:01 134627 /lib/x86_64-linux-gnu/libresolv-2.13.so
7f1d443ad000-7f1d443ae000 r--p 00017000 ca:01 134627 /lib/x86_64-linux-gnu/libresolv-2.13.so
7f1d443ae000-7f1d443af000 rw-p 00018000 ca:01 134627 /lib/x86_64-linux-gnu/libresolv-2.13.so
7f1d443af000-7f1d443b1000 rw-p 00000000 00:00 0
7f1d443b1000-7f1d443b7000 r-xp 00000000 ca:01 134615 /lib/x86_64-linux-gnu/libnss_dns-2.13.so
7f1d443b7000-7f1d445b6000 ---p 00006000 ca:01 134615 /lib/x86_64-linux-gnu/libnss_dns-2.13.so
7f1d445b6000-7f1d445b7000 r--p 00005000 ca:01 134615 /lib/x86_64-linux-gnu/libnss_dns-2.13.so
7f1d445b7000-7f1d445b8000 rw-p 00006000 ca:01 134615 /lib/x86_64-linux-gnu/libnss_dns-2.13.so
7f1d445b8000-7f1d445c4000 r-xp 00000000 ca:01 134616 /lib/x86_64-linux-gnu/libnss_files-2.13.so
7f1d445c4000-7f1d447c3000 ---p 0000c000 ca:01 134616 /lib/x86_64-linux-gnu/libnss_files-2.13.so
7f1d447c3000-7f1d447c4000 r--p 0000b000 ca:01 134616 /lib/x86_64-linux-gnu/libnss_files-2.13.so
7f1d447c4000-7f1d447c5000 rw-p 0000c000 ca:01 134616 /lib/x86_64-linux-gnu/libnss_files-2.13.so
7f1d457c7000-7f1d457c8000 ---p 00000000 00:00 0
7f1d457c8000-7f1d45fc8000 rw-p 00000000 00:00 0
7f1d45fc8000-7f1d45fc9000 ---p 00000000 00:00 0
7f1d45fc9000-7f1d467c9000 rw-p 00000000 00:00 0
7f1d46fca000-7f1d46fcb000 ---p 00000000 00:00 0
7f1d46fcb000-7f1d477cb000 rw-p 00000000 00:00 0
7f1d477cb000-7f1d477cc000 ---p 00000000 00:00 0
7f1d477cc000-7f1d47fcc000 rw-p 00000000 00:00 0
7f1d47fcc000-7f1d47fcd000 ---p 00000000 00:00 0
7f1d47fcd000-7f1d487ce000 rw-p 00000000 00:00 0
7f1d487ce000-7f1d487cf000 ---p 00000000 00:00 0
7f1d487cf000-7f1d48fcf000 rw-p 00000000 00:00 0
7f1d492d1000-7f1d492d2000 ---p 00000000 00:00 0
7f1d492d2000-7f1d493d2000 rw-p 00000000 00:00 0
7f1d493d2000-7f1d49567000 r-xp 00000000 ca:01 134594 /lib/x86_64-linux-gnu/libc-2.13.so
7f1d49567000-7f1d49766000 ---p 00195000 ca:01 134594 /lib/x86_64-linux-gnu/libc-2.13.so
7f1d49766000-7f1d4976a000 r--p 00194000 ca:01 134594 /lib/x86_64-linux-gnu/libc-2.13.so
7f1d4976a000-7f1d4976b000 rw-p 00198000 ca:01 134594 /lib/x86_64-linux-gnu/libc-2.13.so
7f1d4976b000-7f1d49771000 rw-p 00000000 00:00 0
7f1d49771000-7f1d49786000 r-xp 00000000 ca:01 134605 /lib/x86_64-linux-gnu/libgcc_s.so.1
7f1d49786000-7f1d49985000 ---p 00015000 ca:01 134605 /lib/x86_64-linux-gnu/libgcc_s.so.1
7f1d49985000-7f1d49986000 r--p 00014000 ca:01 134605 /lib/x86_64-linux-gnu/libgcc_s.so.1
7f1d49986000-7f1d49987000 rw-p 00015000 ca:01 134605 /lib/x86_64-linux-gnu/libgcc_s.so.1
7f1d49987000-7f1d49a0a000 r-xp 00000000 ca:01 134610 /lib/x86_64-linux-gnu/libm-2.13.so
7f1d49a0a000-7f1d49c09000 ---p 00083000 ca:01 134610 /lib/x86_64-linux-gnu/libm-2.13.so
7f1d49c09000-7f1d49c0a000 r--p 00082000 ca:01 134610 /lib/x86_64-linux-gnu/libm-2.13.so
7f1d49c0a000-7f1d49c0b000 rw-p 00083000 ca:01 134610 /lib/x86_64-linux-gnu/libm-2.13.so
7f1d49c0b000-7f1d49cf3000 r-xp 00000000 ca:01 9706 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.16
7f1d49cf3000-7f1d49ef3000 ---p 000e8000 ca:01 9706 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.16
7f1d49ef3000-7f1d49efb000 r--p 000e8000 ca:01 9706 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.16
7f1d49efb000-7f1d49efd000 rw-p 000f0000 ca:01 9706 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.16
7f1d49efd000-7f1d49f12000 rw-p 00000000 00:00 0
7f1d49f12000-7f1d49f2a000 r-xp 00000000 ca:01 134626 /lib/x86_64-linux-gnu/libpthread-2.13.so
7f1d49f2a000-7f1d4a129000 ---p 00018000 ca:01 134626 /lib/x86_64-linux-gnu/libpthread-2.13.so
7f1d4a129000-7f1d4a12a000 r--p 00017000 ca:01 134626 /lib/x86_64-linux-gnu/libpthread-2.13.so
7f1d4a12a000-7f1d4a12b000 rw-p 00018000 ca:01 134626 /lib/x86_64-linux-gnu/libpthread-2.13.so
7f1d4a12b000-7f1d4a12f000 rw-p 00000000 00:00 0
7f1d4a12f000-7f1d4a150000 r-xp 00000000 ca:01 134587 /lib/x86_64-linux-gnu/ld-2.13.so
7f1d4a342000-7f1d4a347000 rw-p 00000000 00:00 0
7f1d4a34d000-7f1d4a34f000 rw-p 00000000 00:00 0
7f1d4a34f000-7f1d4a350000 r--p 00020000 ca:01 134587 /lib/x86_64-linux-gnu/ld-2.13.so
7f1d4a350000-7f1d4a352000 rw-p 00021000 ca:01 134587 /lib/x86_64-linux-gnu/ld-2.13.so
7fff1e137000-7fff1e158000 rw-p 00000000 00:00 0 [stack]
7fff1e1ff000-7fff1e200000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
Thu Mar 29 01:46:06 Got signal: 6 (Aborted).
Thu Mar 29 01:46:06 Backtrace:
0xa90999 0x7f1d49408420 0x7f1d494083a5 0x7f1d4940bb0b 0x7f1d49440113 0x7f1d4944aa96 0x7f1d4944ed7c 0x7f1d4940d821 0x7f1d4940d8a5 0xa90bee 0x7f1d49408420 0x7f1d494083a5 0x7f1d4940bb0b 0x7f1d49400d4d 0x637bc4 0x7f1d49f19efc 0x7f1d494b389d
/usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0xa90999]
/lib/x86_64-linux-gnu/libc.so.6(+0x36420) [0x7f1d49408420]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f1d494083a5]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x17b) [0x7f1d4940bb0b]
/lib/x86_64-linux-gnu/libc.so.6(+0x6e113) [0x7f1d49440113]
/lib/x86_64-linux-gnu/libc.so.6(+0x78a96) [0x7f1d4944aa96]
/lib/x86_64-linux-gnu/libc.so.6(cfree+0x6c) [0x7f1d4944ed7c]
/lib/x86_64-linux-gnu/libc.so.6(+0x3b821) [0x7f1d4940d821]
/lib/x86_64-linux-gnu/libc.so.6(+0x3b8a5) [0x7f1d4940d8a5]
/usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x5ee) [0xa90bee]
/lib/x86_64-linux-gnu/libc.so.6(+0x36420) [0x7f1d49408420]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f1d494083a5]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x17b) [0x7f1d4940bb0b]
/lib/x86_64-linux-gnu/libc.so.6(__assert_fail+0xdd) [0x7f1d49400d4d]
/usr/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0xa44) [0x637bc4]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7efc) [0x7f1d49f19efc]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f1d494b389d]
Logstream::get called in uninitialized state
Thu Mar 29 01:46:10 [rsSync] replSet syncing to: ec2-184-169-142-7.us-west-1.compute.amazonaws.com:27017
Logstream::get called in uninitialized state
Thu Mar 29 01:47:01 [conn6837] end connection 10.171.81.53:33103
Logstream::get called in uninitialized state
Thu Mar 29 01:47:03 [conn6828] end connection 10.170.22.150:46602
Logstream::get called in uninitialized state
Thu Mar 29 01:47:04 [conn6874] end connection 10.176.82.19:53666
Logstream::get called in uninitialized state
Thu Mar 29 01:47:08 [conn6870] end connection 10.160.233.43:55945
Logstream::get called in uninitialized state
Thu Mar 29 01:47:14 [conn6873] end connection 10.160.178.126:56030
Logstream::get called in uninitialized state
Thu Mar 29 01:47:23 [conn6848] end connection 10.160.134.170:55234
Logstream::get called in uninitialized state
Thu Mar 29 01:48:30 [conn6845] end connection 10.160.27.249:51702
|