Details
Description
CSRS with 1 config server and 3 real shards (standalone), 1 mongos
Added 1000 fake shards in config metadata and assigned chunks to some of them for the sharded collection "test.test". Restarted the cluster.
When doing db.test.find({}), mongos crashes with
2017-03-15T10:27:04.575-0400 I - [conn1] Invariant failure remote.status.isOK() src/mongo/s/query/async_results_merger.cpp 345"
|
Doesn't reproduce without fake shards or with a single fake shard. The latter leads me to believe that it's not a problem with the way I introduce the fake shards.
Logs and config metadata attached.
The call stack of the crash is:
2017-03-15T10:04:47.448-0400 I - [conn1] Invariant failure remote.status.isOK() src/mongo/s/query/async_results_merger.cpp 345
|
...
|
0x1017b4a0a 0x1017b4230 0x7fff814d1f1a 0x102df9e00 0x7fff85e4c9b3 0x10174869e 0x1016e9670 0x1016f7b5b 0x1016edc52 0x1016f45ce 0x10168af8a 0x101705b1b 0x1016d89ae 0x1016d7907 0x101191b18 0x10174268d 0x101742d41 0x7fff8162405a 0x7fff81623fd7 0x7fff816213ed
|
----- BEGIN BACKTRACE -----
|
mongos(mongo::printStackTrace(std::__1::basic_ostream<char, std::__1::char_traits<char> >&) 0x3A) [0x1017b4a0a]
|
mongos(mongo::(anonymous namespace)::abruptQuit(int) 0xC0) [0x1017b4230]
|
libsystem_platform.dylib(_sigtramp 0x1A) [0x7fff814d1f1a]
|
??? [0x102df9e00]
|
libsystem_c.dylib(abort 0x81) [0x7fff85e4c9b3]
|
mongos(mongo::invariantFailed(char const*, char const*, unsigned int) 0x2FE) [0x10174869e]
|
mongos(mongo::AsyncResultsMerger::nextEvent() 0x2F0) [0x1016e9670]
|
mongos(mongo::RouterStageMerge::next() 0x5B) [0x1016f7b5b]
|
mongos(mongo::ClusterClientCursorImpl::next() 0xA2) [0x1016edc52]
|
mongos(mongo::ClusterFind::runQuery(mongo::OperationContext*, mongo::CanonicalQuery const&, mongo::ReadPreferenceSetting const&, std::__1::vector<mongo::BSONObj, std::__1::allocator<mongo::BSONObj> >*, mongo::BSONObj*) 0x1A9E) [0x1016f45ce]
|
mongos(mongo::(anonymous namespace)::ClusterFindCmd::run(mongo::OperationContext*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, mongo::BSONObj&, int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&, mongo::BSONObjBuilder&) 0x4DA) [0x10168af8a]
|
mongos(mongo::Command::execCommandClient(mongo::OperationContext*, mongo::Command*, int, char const*, mongo::BSONObj&, mongo::BSONObjBuilder&) 0x6FB) [0x101705b1b]
|
mongos(mongo::(anonymous namespace)::runAgainstRegistered(mongo::OperationContext*, char const*, mongo::BSONObj&, mongo::BSONObjBuilder&, int) 0x12E) [0x1016d89ae]
|
mongos(mongo::Strategy::clientCommandOp(mongo::OperationContext*, mongo::NamespaceString const&, mongo::DbMessage*) 0xC47) [0x1016d7907]
|
mongos(mongo::ServiceEntryPointMongos::_sessionLoop(std::__1::shared_ptr<mongo::transport::Session> const&) 0x9F8) [0x101191b18]
|
mongos(mongo::(anonymous namespace)::runFunc(void*) 0x2AD) [0x10174268d]
|
mongos(void* std::__1::__thread_proxy<std::__1::tuple<std::__1::__bind<void* (&)(void*), mongo::(anonymous namespace)::Context*> > >(void*) 0x61) [0x101742d41]
|
libsystem_pthread.dylib(_pthread_body 0x83) [0x7fff8162405a]
|
libsystem_pthread.dylib(_pthread_body 0x0) [0x7fff81623fd7]
|
libsystem_pthread.dylib(thread_start 0xD) [0x7fff816213ed]
|
----- END BACKTRACE -----
|
Attachments
Issue Links
- duplicates
-
SERVER-27701 Race in AsyncResultsMerger error handling may trigger mongos invariant
-
- Closed
-