Mongod fails during journal replay with mmapv1 after power cycle

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Cannot Reproduce
    • Priority: Major - P3
    • None
    • Affects Version/s: 2.8.0-rc4, 3.1.6
    • Component/s: Storage
    • Fully Compatible
    • ALL
    • Hide

      Repetitive power cycle test (over 10 minutes) , where the mongod host is power cycled (non-clean shutdown) randomly (every 30 to 120 seconds) , while clients are sending various CRUD operations.

      The operations which produce a mongod crashes of
      Invariant failure false src/mongo/db/storage/mmap_v1/mmap_v1_extent_manager.cpp 179
      and
      Invariant failure false src/mongo/db/storage/mmap_v1/btree/btree_logic.cpp 395

      db.foo.validate()
bulk.insert()
db.foo.remove()

      Use the attached powertest.sh, which relies on FSM & CRUD clients to generate various DB operations to reproduce the issue (in 3.1.6).

      ./powertest.sh -s <ssh server>  -e mmapv1 -F $HOME/mongo

      <ssh server> ssh server connection, i.e., "-i ident.pem user@host"

      Show
      Repetitive power cycle test (over 10 minutes) , where the mongod host is power cycled (non-clean shutdown) randomly (every 30 to 120 seconds) , while clients are sending various CRUD operations. The operations which produce a mongod crashes of Invariant failure false src/mongo/db/storage/mmap_v1/mmap_v1_extent_manager.cpp 179 and Invariant failure false src/mongo/db/storage/mmap_v1/btree/btree_logic.cpp 395 db.foo.validate() bulk.insert() db.foo.remove() Use the attached powertest.sh, which relies on FSM & CRUD clients to generate various DB operations to reproduce the issue (in 3.1.6). ./powertest.sh -s <ssh server> -e mmapv1 -F $HOME/mongo <ssh server> ssh server connection, i.e., "-i ident.pem user@host"
    • Quint Iteration 3.1.1, QuInt A (10/12/15), QuInt B (11/02/15), TIG C (11/20/15)
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Mongod mmapv1 storage files are corrupted from power cycle testing. mongod will crash on certain commands with Invariant failure.

        1. powertest.sh
          34 kB
        2. mongod.log.gz
          5.03 MB
        3. mmapv1.tar.gz
          11.99 MB

            Assignee:
            Jonathan Abrahams (Inactive)
            Reporter:
            Jonathan Abrahams (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            14 Start watching this issue

              Created:
              Updated:
              Resolved: