Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-16702

Mongod fails during journal replay with mmapv1 after power cycle

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Cannot Reproduce
    • Affects Version/s: 2.8.0-rc4, 3.1.6
    • Fix Version/s: None
    • Component/s: Storage
    • Backwards Compatibility:
      Fully Compatible
    • Operating System:
      ALL
    • Steps To Reproduce:
      Hide

      Repetitive power cycle test (over 10 minutes) , where the mongod host is power cycled (non-clean shutdown) randomly (every 30 to 120 seconds) , while clients are sending various CRUD operations.

      The operations which produce a mongod crashes of
      Invariant failure false src/mongo/db/storage/mmap_v1/mmap_v1_extent_manager.cpp 179
      and
      Invariant failure false src/mongo/db/storage/mmap_v1/btree/btree_logic.cpp 395

      db.foo.validate()
      bulk.insert()
      db.foo.remove()
      

      Use the attached powertest.sh, which relies on FSM & CRUD clients to generate various DB operations to reproduce the issue (in 3.1.6).

      ./powertest.sh -s <ssh server>  -e mmapv1 -F $HOME/mongo
      

      <ssh server> ssh server connection, i.e., "-i ident.pem user@host"

      Show
      Repetitive power cycle test (over 10 minutes) , where the mongod host is power cycled (non-clean shutdown) randomly (every 30 to 120 seconds) , while clients are sending various CRUD operations. The operations which produce a mongod crashes of Invariant failure false src/mongo/db/storage/mmap_v1/mmap_v1_extent_manager.cpp 179 and Invariant failure false src/mongo/db/storage/mmap_v1/btree/btree_logic.cpp 395 db.foo.validate() bulk.insert() db.foo.remove() Use the attached powertest.sh, which relies on FSM & CRUD clients to generate various DB operations to reproduce the issue (in 3.1.6). ./powertest.sh -s <ssh server> -e mmapv1 -F $HOME/mongo <ssh server> ssh server connection, i.e., "-i ident.pem user@host"
    • Sprint:
      Quint Iteration 3.1.1, QuInt A (10/12/15), QuInt B (11/02/15), TIG C (11/20/15)

      Description

      Mongod mmapv1 storage files are corrupted from power cycle testing. mongod will crash on certain commands with Invariant failure.

        Attachments

        1. mmapv1.tar.gz
          11.99 MB
        2. mongod.log.gz
          5.03 MB
        3. powertest.sh
          34 kB

          Activity

            People

            Assignee:
            jonathan.abrahams Jonathan Abrahams
            Reporter:
            jonathan.abrahams Jonathan Abrahams
            Participants:
            Votes:
            1 Vote for this issue
            Watchers:
            14 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: