Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-27500

Race condition in WiredTiger Btree split causes seg fault

    • Type: Icon: Bug Bug
    • Resolution: Gone away
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 3.0.0
    • Component/s: WiredTiger
    • Labels:
      None
    • ALL

      Issue Summary as of Dec 22, 2016

      ISSUE SUMMARY
      A rare race condition exists in MongoDB 3.0.x with WiredTiger that may cause segmentation faults like the one shown in the stack trace below:

      2016-12-22T14:26:23.258+0000 F - Invalid access at address: 0x8
      2016-12-22T14:26:23.283+0000 F - Got signal: 11 (Segmentation fault).
      
      0xfc5aa2 0xfc5353 0xfc56b4 0x7f870dc92100 0x139a030 0x13cf24e 0x7f870dc8adc5 0x7f870ca41bdd
      ----- BEGIN BACKTRACE -----
      {"backtrace":[{"b":"400000","o":"BC5AA2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"BC5353"},{"b":"400000","o":"BC56B4"},{"b":"7F870DC83000","o":"F100"},{"b":"400000","o":"F9A030","s":"__wt_tree_walk"},{"b":"400000","o":"FCF24E"},{"b":"7F870DC83000","o":"7DC5"},{"b":"7F870C94B000","o":"F6BDD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.12", "gitVersion" : "33934938e0e95d534cebbaff656cde916b9c3573", "uname" : { "sysname" : "Linux", "release" : "4.1.17-22.30.amzn1.x86_64", "version" : "#1 SMP Fri Feb 5 23:44:22 UTC 2016", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E5C98047C025512B028EAA6CEAFECCEF7ECFDC36" }, { "b" : "7FFE93B94000", "elfType" : 3, "buildId" : "6F6149E301A1F6868043BCCC85AC10D130217628" }, { "b" : "7F870DC83000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "E5E575776DAD20ADE8FD0CAF17897C9D89020A87" }, { "b" : "7F870DA16000", "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "B949A1349FF0E93409055F00BFD60F758EE8FA02" }, { "b" : "7F870D631000", "path" : "/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "F444116328F54797379DAA3B0FD53CF6C829F22A" }, { "b" : "7F870D429000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "42833B65941483A611C40EA7D32F56EA83EA6E93" }, { "b" : "7F870D225000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "6335077ACD51527BE9F2F18451A88E2B7350C5B6" }, { "b" : "7F870CF23000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "BB312C4A65B8FD830C148612CBEACEACC8B08E4F" }, { "b" : "7F870CD0D000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "00FA2883FB47B1327397BBF167C52F51A723D013" }, { "b" : "7F870C94B000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F71AC3ADBB171592B9C9D9234786463F8C08411B" }, { "b" : "7F870DE9F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "7B7BF8FEEF1A9C627EF90CA5C9188EFD4DA2DDD2" }, { "b" : "7F870C6FF000", "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "E203354E7F907ACC8C3028FE465541B666DCFBA0" }, { "b" : "7F870C41A000", "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "D769C8FFAF8772FDA55031ABF2E167DF2207E378" }, { "b" : "7F870C217000", "path" : "/usr/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "5C01209C5AE1B1714F19B07EB58F2A1274B69DC8" }, { "b" : "7F870BFE5000", "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "6C2243D37143F7FD1E16ED1F6CE4D7F16C2D7EF1" }, { "b" : "7F870BDCF000", "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "89C6AF118B6B4FB6A73AE1813E2C8BDD722956D1" }, { "b" : "7F870BBC0000", "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "744272FEAAABCE629AB9E11FAA4A96AEBE8BC2B4" }, { "b" : "7F870B9BD000", "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "37A58210FA50C91E09387765408A92909468D25B" }, { "b" : "7F870B7A3000", "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "6CDD88083543D90EBE00725A438EEA2479C6D156" }, { "b" : "7F870B582000", "path" : "/usr/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "F5054DC94443326819FBF3065CFDF5E4726F57EE" } ] }}
      mongod(_ZN5mongo15printStackTraceERSo+0x32) [0xfc5aa2]
      mongod(+0xBC5353) [0xfc5353]
      mongod(+0xBC56B4) [0xfc56b4]
      libpthread.so.0(+0xF100) [0x7f870dc92100]
      mongod(__wt_tree_walk+0x190) [0x139a030]
      mongod(+0xFCF24E) [0x13cf24e]
      libpthread.so.0(+0x7DC5) [0x7f870dc8adc5]
      libc.so.6(clone+0x6D) [0x7f870ca41bdd]
      ----- END BACKTRACE -----
      

      USER IMPACT
      This race condition exists in MongoDB 3.0 with WiredTiger and may crash MongoDB. If you are observing this issue, we strongly recommend upgrading to MongoDB 3.2 or later.

      FIXED VERSIONS
      This issue has been corrected by a number of improvements to the WiredTiger storage engine. To resolve this issue, please upgrade to MongoDB 3.2 or later.

            Assignee:
            kelsey.schubert@mongodb.com Kelsey Schubert
            Reporter:
            kelsey.schubert@mongodb.com Kelsey Schubert
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: