Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-30709

mongo can't start in kubernetes when start from last clean shutdown

    • Type: Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:
    • ALL

      I use mongo:3.4 to start mongo in kubernetes with arguments
      mongod --replSet rs0 --smallfiles --noprealloc --storageEngine=wiredTiger --wiredTigerCacheSizeGB=0.5 -vvvvvv

      the volumes contains the old data, copy from other instance (which is clean shutdown), but still got following error:

      note: noprealloc may hurt performance in many applications
      2017-08-17T05:08:20.654+0000 I CONTROL  [initandlisten] MongoDB starting : pid=1 port=27017 dbpath=/data/db 64-bit host=mongo-0
      2017-08-17T05:08:20.654+0000 I CONTROL  [initandlisten] db version v3.4.7
      2017-08-17T05:08:20.654+0000 I CONTROL  [initandlisten] git version: cf38c1b8a0a8dca4a11737581beafef4fe120bcd
      2017-08-17T05:08:20.654+0000 I CONTROL  [initandlisten] OpenSSL version: OpenSSL 1.0.1t  3 May 2016
      2017-08-17T05:08:20.654+0000 I CONTROL  [initandlisten] allocator: tcmalloc
      2017-08-17T05:08:20.654+0000 I CONTROL  [initandlisten] modules: none
      2017-08-17T05:08:20.654+0000 I CONTROL  [initandlisten] build environment:
      2017-08-17T05:08:20.654+0000 I CONTROL  [initandlisten]     distmod: debian81
      2017-08-17T05:08:20.654+0000 I CONTROL  [initandlisten]     distarch: x86_64
      2017-08-17T05:08:20.654+0000 I CONTROL  [initandlisten]     target_arch: x86_64
      2017-08-17T05:08:20.654+0000 I CONTROL  [initandlisten] options: { replication: { replSet: "rs0" }, storage: { engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true }, wiredTiger: { engineConfig: { cacheSizeGB: 0.5 } } }, systemLog: { verbosity: 6 } }
      2017-08-17T05:08:20.657+0000 D NETWORK  [initandlisten] fd limit hard:65536 soft:65536 max conn: 52428
      2017-08-17T05:08:20.699+0000 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=512M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
      2017-08-17T05:08:20.700+0000 E STORAGE  [initandlisten] WiredTiger error (22) [1502946500:700558][1:0x7f8ec0c5bd00], wiredtiger_open: /data/db/WiredTiger.lock: handle-open: open: Invalid argument
      2017-08-17T05:08:20.700+0000 I -        [initandlisten] Fatal Assertion 28561 at src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp 266
      2017-08-17T05:08:20.700+0000 I -        [initandlisten]
      ***aborting after fassert() failure
      

      and the content of WiredTiger.turtle are:

      WiredTiger version string
      WiredTiger 2.9.2: (December 23, 2016)
      WiredTiger version
      major=2,minor=9,patch=2
      file:WiredTiger.wt
      access_pattern_hint=none,allocation_size=4KB,app_metadata=,block_allocation=best,block_compressor=,cache_resident=false,checkpoint=(WiredTigerCheckpoint.27=(addr="018081e4c9ed60ba8181e42c703ca38281e41ca436b0808080e3010fc0e23fc0",order=27,time=1502946391,size=28672,write_gen=54)),checkpoint_lsn=(1,103808),checksum=uncompressed,collator=,columns=,dictionary=0,encryption=(keyid=,name=),format=btree,huffman_key=,huffman_value=,id=0,ignore_in_memory_cache_size=false,internal_item_max=0,internal_key_max=0,internal_key_truncate=true,internal_page_max=4KB,key_format=S,key_gap=10,leaf_item_max=0,leaf_key_max=0,leaf_page_max=32KB,leaf_value_max=0,log=(enabled=true),memory_page_max=5MB,os_cache_dirty_max=0,os_cache_max=0,prefix_compression=false,prefix_compression_min=4,split_deepen_min_child=0,split_deepen_per_child=0,split_pct=90,value_format=S,version=(major=1,minor=1)
      

        1. mongod.SERVER-30709.strace
          56 kB
        2. repair-SERVER-30709.tar.gz
          3 kB
        3. WiredTiger.wt
          76 kB

            Assignee:
            mark.agarunov Mark Agarunov
            Reporter:
            jenningsloy318 Jennings
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: