Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-57379

"WiredTiger error when building index.

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 4.2.8
    • Component/s: None
    • ALL

      We have a collection "A".

      Collection "A" stats.

      • count : 3852675627
      • size : 3.31TB
      • storageSize : 481.60 GB

      When we were building a compound index,
      we got "WiredTiger error ... read checksum error for 16384B block at offset 39527702528: calculated block checksum doesn't match expected checksum Raw:".

       

      We experienced similar error, at that time we changed the physical server to avoid error.(We already issued that situation here.)

       

      So when we faced this error again, we changed physical server.
      But in this time we could not make it.

       

      What we did.
      1. we prepared new physical server.
      => we got "WiredTiger error" again.
      2. we changed ssd.
      => we got "WiredTiger error" again.
      3. We considered disk problem where collection "A" was written, we renamed collection "A" to "A_old" and made collection "A" again newly.
      => we got "WiredTiger error" again.
      4. We tried build index with some options ( -sparse, -name, - split index key... )
      => we got "WiredTiger error" again.

      Environment.

      • Server
      • OS : Ubuntu 18.04.5 LTS
      • Memory : 64Gb
      • Disk : SSD 7.3T (4T + 4T with lvm)
      • Mongodb :
        db version v4.2.8
        git version: 43d25964249164d76d5e04dd6cf38f6111e21f5f
        OpenSSL version: OpenSSL 1.1.1 11 Sep 2018
        allocator: tcmalloc
        modules: none
        build environment:
        distmod: ubuntu1804
        distarch: x86_64
        target_arch: x86_64

       

      Do you have any advice?

       

        1. after_repair_operation_first_start.log
          2 kB
          jongsun moon
        2. mongod_build_index_error_2021_05_26.log
          773 kB
          jongsun moon
        3. mongod_config_server_not_work_2021_05_25.log
          53 kB
          jongsun moon
        4. mongod-log.log
          192 kB
          jongsun moon
        5. repair_20210611.log
          538 kB
          jongsun moon
        6. shard_2021_06_08_1.log
          1.69 MB
          jongsun moon
        7. shard_2021_06_08_2.log
          5.14 MB
          jongsun moon
        8. shard_2021_06_08_2-1.log
          5.14 MB
          jongsun moon
        9. shard_2021_06_08.log
          2.55 MB
          jongsun moon
        10. shard_cn_1.log.2021-05-25T05-38-59
          53 kB
          jongsun moon
        11. shard_cn_1.log.2021-05-26T05-23-19
          773 kB
          jongsun moon
        12. shard_cn_1.log.2021-06-11T01-21-58
          2 kB
          jongsun moon

            Assignee:
            edwin.zhou@mongodb.com Edwin Zhou
            Reporter:
            jjongei0@gmail.com jongsun moon
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: