Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-2870

DBException in process: socket exception Received signal 11 crashed mongos

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 1.8.0-rc0
    • Component/s: Replication, Stability
    • Labels:
      None
    • Environment:
    • Linux

      Originally reported in SERVER-2539 but still seeing this. May be related to SERVER-2868.

      Wed Mar 30 08:52:48 /home/david/mongodb/latest/bin/mongos db version v1.8.0-rc0, pdfile version 4.5 starting (--help for usage)
      Wed Mar 30 08:52:48 git version: 65a7e81df0747b6bc9380b78e0182192bacdb4d0
      Wed Mar 30 08:52:48 build sys info: Linux ip-10-110-9-236 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41
      Wed Mar 30 08:52:48 [mongosMain] waiting for connections on port 27017
      Wed Mar 30 08:52:48 [websvr] web admin interface listening on port 28017
      Wed Mar 30 08:52:48 [Balancer] about to contact config servers and shards
      Wed Mar 30 08:52:48 [Balancer] updated set (set1) to: set1/rs1a:27018,rs1b:27018
      Wed Mar 30 08:52:48 [Balancer] updated set (set2) to: set2/rs2a:27018,rs2b:27018
      Wed Mar 30 08:52:48 [Balancer] updated set (set3) to: set3/rs3a:27018,rs3b:27018
      Wed Mar 30 08:52:48 [Balancer] config servers and shards contacted successfully
      Wed Mar 30 08:52:48 [Balancer] balancer id: web3:27017 started at Mar 30 08:52:48
      Wed Mar 30 08:52:48 [LockPinger] creating dist lock ping thread for: config1:27019
      Wed Mar 30 08:52:48 [conn1] creating WriteBackListener for: rs1a:27018
      Wed Mar 30 08:52:48 [conn1] creating WriteBackListener for: rs1b:27018
      Wed Mar 30 08:52:48 [conn1] creating WriteBackListener for: rs2a:27018
      Wed Mar 30 08:52:48 [conn1] creating WriteBackListener for: rs2b:27018
      Wed Mar 30 08:52:48 [conn1] creating WriteBackListener for: rs3a:27018
      Wed Mar 30 08:52:48 [conn1] creating WriteBackListener for: rs3b:27018
      Wed Mar 30 08:57:18 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:02:18 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:07:18 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:12:18 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:15:29 [conn230] DBException in process: socket exception
      Wed Mar 30 09:15:29 [conn231] DBException in process: socket exception
      Wed Mar 30 09:15:29 [conn232] DBException in process: socket exception
      Wed Mar 30 09:15:29 [conn233] DBException in process: socket exception
      Wed Mar 30 09:15:29 [conn234] DBException in process: socket exception
      Wed Mar 30 09:15:29 [conn235] DBException in process: socket exception
      Wed Mar 30 09:15:29 [conn236] DBException in process: socket exception
      Wed Mar 30 09:15:29 [conn237] DBException in process: socket exception
      Wed Mar 30 09:15:29 [conn239] DBException in process: socket exception
      Wed Mar 30 09:15:29 [conn238] DBException in process: socket exception
      Wed Mar 30 09:15:29 [conn240] DBException in process: socket exception
      Wed Mar 30 09:15:29 [conn241] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn242] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn243] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn244] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn245] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn246] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn247] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn248] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn249] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn250] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn252] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn251] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn253] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn254] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn255] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn256] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn257] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn258] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn259] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn260] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn261] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn263] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn262] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn264] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn265] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn266] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn267] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn268] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn269] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn270] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn271] DBException in process: socket exception
      Wed Mar 30 09:15:30 [conn272] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn273] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn274] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn276] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn275] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn278] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn277] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn279] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn280] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn281] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn283] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn282] DBException in process: socket exception
      Wed Mar 30 09:15:31 [conn284] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn285] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn286] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn287] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn288] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn290] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn289] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn292] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn291] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn293] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn294] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn296] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn295] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn297] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn299] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn298] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn300] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn304] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn301] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn302] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn303] DBException in process: socket exception
      Wed Mar 30 09:15:32 [conn305] DBException in process: socket exception
      Wed Mar 30 09:15:36 [conn261] ns: sd.servers ClusteredCursor::query ShardConnection had to change attempt: 0
      Wed Mar 30 09:17:18 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:22:18 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:27:18 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:32:18 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:37:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:42:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:47:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:52:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 09:57:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:02:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:07:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:12:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:17:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:22:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:27:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:32:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:37:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:42:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:47:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:48:18 [conn713] DBException in process: socket exception
      Wed Mar 30 10:48:18 [conn714] DBException in process: socket exception
      Wed Mar 30 10:48:18 [conn715] DBException in process: socket exception
      Wed Mar 30 10:48:18 [conn716] DBException in process: socket exception
      Wed Mar 30 10:48:18 [conn717] DBException in process: socket exception
      Wed Mar 30 10:48:18 [conn721] DBException in process: socket exception
      Wed Mar 30 10:48:18 [conn723] DBException in process: socket exception
      Wed Mar 30 10:48:18 [conn722] DBException in process: socket exception
      Wed Mar 30 10:48:18 [conn724] DBException in process: socket exception
      Wed Mar 30 10:48:18 [conn725] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn726] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn728] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn729] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn730] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn731] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn733] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn732] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn734] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn735] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn736] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn738] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn739] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn740] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn741] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn742] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn743] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn744] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn745] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn746] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn747] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn748] DBException in process: socket exception
      Wed Mar 30 10:48:19 [conn749] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn750] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn752] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn753] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn754] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn756] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn757] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn759] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn760] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn764] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn765] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn766] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn767] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn768] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn770] DBException in process: socket exception
      Wed Mar 30 10:48:20 [conn771] DBException in process: socket exception
      Wed Mar 30 10:48:21 [conn774] DBException in process: socket exception
      Wed Mar 30 10:48:28 [conn742] ns: sd.servers ClusteredCursor::query ShardConnection had to change attempt: 0
      Wed Mar 30 10:48:28 [conn740] ns: sd.servers ClusteredCursor::query ShardConnection had to change attempt: 0
      Wed Mar 30 10:52:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 10:57:19 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:02:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:07:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:12:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:17:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:22:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:27:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:32:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:37:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:42:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:47:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:52:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 11:57:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:02:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:07:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:12:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:17:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:22:20 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:27:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:32:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:37:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:42:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:45:46 [conn1155] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1154] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1153] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1157] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1158] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1159] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1160] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1163] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1161] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1164] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1166] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1171] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1169] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1162] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1165] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1170] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1174] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1167] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1168] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1173] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1156] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1175] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1152] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1172] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1176] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1177] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1178] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1179] DBException in process: socket exception
      Wed Mar 30 12:45:46 [conn1180] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1181] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1182] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1183] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1184] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1185] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1186] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1188] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1187] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1189] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1190] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1191] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1192] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1193] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1194] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1195] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1196] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1197] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1198] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1199] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1200] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1201] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1202] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1203] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1204] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1206] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1205] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1207] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1208] DBException in process: socket exception
      Wed Mar 30 12:45:47 [conn1209] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1210] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1211] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1212] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1213] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1214] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1215] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1216] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1218] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1217] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1219] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1221] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1220] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1222] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1223] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1224] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1225] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1226] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1227] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1228] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1229] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1230] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1231] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1232] DBException in process: socket exception
      Wed Mar 30 12:45:48 [conn1233] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1234] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1235] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1236] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1237] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1238] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1239] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1240] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1241] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1243] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1242] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1244] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1245] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1246] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1248] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1247] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1249] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1250] DBException in process: socket exception
      Wed Mar 30 12:45:49 [conn1251] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1253] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1254] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1255] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1256] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1257] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1258] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1259] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1260] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1261] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1263] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1262] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1264] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1265] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1266] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1267] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1268] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1269] DBException in process: socket exception
      Wed Mar 30 12:45:50 [conn1270] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1271] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1272] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1273] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1274] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1275] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1276] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1277] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1278] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1279] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1280] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1281] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1282] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1283] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1284] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1285] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1286] DBException in process: socket exception
      Wed Mar 30 12:45:51 [conn1287] DBException in process: socket exception
      Wed Mar 30 12:45:53 [conn1152] ns: sd.servers ClusteredCursor::query ShardConnection had to change attempt: 0
      Wed Mar 30 12:47:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:52:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 12:57:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:02:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:07:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:12:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:17:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:22:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:27:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:32:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:37:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:42:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:47:21 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:52:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 13:57:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:02:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:07:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:12:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:17:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:22:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:27:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:32:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:37:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:42:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:47:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:52:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 14:57:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 15:02:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 15:07:22 [LockPinger] dist_lock pinged successfully for: web3:1301475168:1804289383
      Wed Mar 30 15:08:56 [conn1764] DBException in process: socket exception
      Wed Mar 30 15:08:56 [conn1768] DBException in process: socket exception
      Wed Mar 30 15:08:56 [conn1769] DBException in process: socket exception
      Wed Mar 30 15:08:56 [conn1770] DBException in process: socket exception
      Wed Mar 30 15:08:56 [conn1771] DBException in process: socket exception
      Wed Mar 30 15:08:56 [conn1772] DBException in process: socket exception
      Wed Mar 30 15:08:56 [conn1773] DBException in process: socket exception
      Wed Mar 30 15:08:56 [conn1774] DBException in process: socket exception
      Wed Mar 30 15:08:56 [conn1775] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1776] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1777] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1778] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1779] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1780] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1781] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1782] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1783] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1784] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1785] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1786] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1787] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1789] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1788] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1790] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1791] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1792] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1793] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1794] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1795] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1796] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1797] DBException in process: socket exception
      Wed Mar 30 15:08:57 [conn1798] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1799] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1800] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1801] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1802] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1803] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1804] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1805] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1806] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1807] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1808] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1809] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1810] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1811] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1812] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1813] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1814] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1815] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1816] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1817] DBException in process: socket exception
      Wed Mar 30 15:08:58 [conn1818] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1819] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1820] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1821] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1822] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1823] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1824] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1825] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1826] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1827] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1828] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1829] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1830] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1831] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1832] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1833] DBException in process: socket exception
      Wed Mar 30 15:08:59 [conn1834] DBException in process: socket exception
      Received signal 11
      Backtrace: 0x531975 0x30bd8302d0 0x30c489c8c8 0x554765 0x554a24 0x556326 0x547d23 0x5378f2 0x5786e5 0x578bb1 0x630aee 0x634773 0x66808c 0x67b131 0x5819e2 0x6a1d90 0x30be40673d 0x30bd8d3f6d
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo17printStackAndExitEi+0x75)[0x531975]
      /lib64/libc.so.6[0x30bd8302d0]
      /usr/lib64/libstdc++.so.6(_ZNSsC1ERKSs+0x18)[0x30c489c8c8]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo17ReplicaSetMonitor9getMasterEv+0xb5)[0x554765]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo18DBClientReplicaSet11checkMasterEv+0xa4)[0x554a24]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo18DBClientReplicaSet7connectEv+0x16)[0x556326]
      /home/david/mongodb/latest/bin/mongos(_ZNK5mongo16ConnectionString7connectERSs+0x1c3)[0x547d23]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo16DBConnectionPool3getERKSs+0xd2)[0x5378f2]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo15ShardConnection5_initEv+0x305)[0x5786e5]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo15ShardConnectionC1ERKNS_5ShardERKSs+0xa1)[0x578bb1]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo8Strategy7doQueryERNS_7RequestERKNS_5ShardE+0x4e)[0x630aee]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo14SingleStrategy7queryOpERNS_7RequestE+0x4a3)[0x634773]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo7Request7processEi+0x29c)[0x66808c]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortE+0x141)[0x67b131]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x272)[0x5819e2]
      /home/david/mongodb/latest/bin/mongos(thread_proxy+0x80)[0x6a1d90]
      /lib64/libpthread.so.0[0x30be40673d]
      /lib64/libc.so.6(clone+0x6d)[0x30bd8d3f6d]
      ===
      Received signal 11
      Backtrace: 0x531975 0x30bd8302d0 0x5fb654 0x66738d 0x67b11b 0x5819e2 0x6a1d90 0x30be40673d 0x30bd8d3f6d
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo17printStackAndExitEi+0x75)[0x531975]
      /lib64/libc.so.6[0x30bd8302d0]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo4Grid11getDBConfigESsbRKSs+0x254)[0x5fb654]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo7Request5resetEb+0xbd)[0x66738d]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortE+0x12b)[0x67b11b]
      /home/david/mongodb/latest/bin/mongos(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x272)[0x5819e2]
      /home/david/mongodb/latest/bin/mongos(thread_proxy+0x80)[0x6a1d90]
      /lib64/libpthread.so.0[0x30be40673d]
      /lib64/libc.so.6(clone+0x6d)[0x30bd8d3f6d]
      ===

            Assignee:
            Unassigned Unassigned
            Reporter:
            boxedice David Mytton
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: