Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2207

Hang in LSM when dropping a file

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: WT2.7.0
    • Labels:
      None

      Description

      A test/format job has hung in LSM, with the following stacks:

      Thread 4 (Thread 0x7f14869dc700 (LWP 13351)):
      #0  0x00007f1487769f97 in sched_yield () from /lib64/libc.so.6
      #1  0x00000000004448a3 in __wt_yield () at ../src/os_posix/os_yield.c:18
      #2  0x000000000046d57f in __wt_session_lock_dhandle (session=0xad98e0, flags=24, is_deadp=0x7f14869dba3f) at ../src/session/session_dhandle.c:218
      #3  0x000000000046de9f in __wt_session_get_btree (session=0xad98e0, uri=0x7f13f0017620 "file:wt-000110.lsm", checkpoint=0x7f141827cd50 "WiredTigerCheckpoint.2", cfg=0x0,
          flags=24) at ../src/session/session_dhandle.c:465
      #4  0x000000000046e450 in __wt_session_lock_checkpoint (session=0xad98e0, checkpoint=0x7f141827cd50 "WiredTigerCheckpoint.2") at ../src/session/session_dhandle.c:547
      #5  0x000000000047de26 in __checkpoint_worker (session=0xad98e0, cfg=0x0, is_checkpoint=false, need_tracking=false) at ../src/txn/txn_ckpt.c:988
      #6  0x000000000047e6b2 in __wt_checkpoint_close (session=0xad98e0, final=false) at ../src/txn/txn_ckpt.c:1271
      #7  0x00000000004c418b in __wt_conn_btree_sync_and_close (session=0xad98e0, final=false, force=false) at ../src/conn/conn_dhandle.c:199
      #8  0x00000000004c4fc8 in __wt_conn_dhandle_close_all (session=0xad98e0, uri=0x7f13f00082d0 "file:wt-000110.lsm", force=false) at ../src/conn/conn_dhandle.c:570
      #9  0x000000000045dd5e in __drop_file (session=0xad98e0, uri=0x7f13f00082d0 "file:wt-000110.lsm", force=false, cfg=0x7f14869dbdd0) at ../src/schema/schema_drop.c:32
      #10 0x000000000045e3c1 in __wt_schema_drop (session=0xad98e0, uri=0x7f13f00082d0 "file:wt-000110.lsm", cfg=0x7f14869dbdd0) at ../src/schema/schema_drop.c:180
      #11 0x00000000004ee3c1 in __lsm_drop_file (session=0xad98e0, uri=0x7f13f00082d0 "file:wt-000110.lsm") at ../src/lsm/lsm_work_unit.c:517
      #12 0x00000000004ee644 in __wt_lsm_free_chunks (session=0xad98e0, lsm_tree=0xb58e10) at ../src/lsm/lsm_work_unit.c:608
      #13 0x000000000043c168 in __lsm_worker_general_op (session=0xad98e0, cookie=0xad3ba0, completed=0x7f14869dbee6) at ../src/lsm/lsm_worker.c:72
      ---Type <return> to continue, or q <return> to quit---
      #14 0x000000000043c285 in __lsm_worker (arg=0xad3ba0) at ../src/lsm/lsm_worker.c:122
      #15 0x00007f1488077555 in start_thread () from /lib64/libpthread.so.0
      #16 0x00007f1487785f3d in clone () from /lib64/libc.so.6
       
      Thread 2 (Thread 0x7f14851d9700 (LWP 13357)):
      #0  0x00007f148807f29d in __lll_lock_wait () from /lib64/libpthread.so.0
      #1  0x00007f148807988d in pthread_mutex_lock () from /lib64/libpthread.so.0
      #2  0x000000000046ce16 in __wt_spin_lock (session=0xad8fe0, t=0xac6600) at ../src/include/mutex.i:159
      #3  0x000000000046dd44 in __session_get_dhandle (session=0xad8fe0, uri=0x51e9c8 "file:WiredTiger.wt", checkpoint=0x0) at ../src/session/session_dhandle.c:431
      #4  0x000000000046de49 in __wt_session_get_btree (session=0xad8fe0, uri=0x51e9c8 "file:WiredTiger.wt", checkpoint=0x0, cfg=0x0, flags=0)
          at ../src/session/session_dhandle.c:454
      #5  0x000000000043c858 in __wt_metadata_open (session=0xad8fe0) at ../src/meta/meta_table.c:45
      #6  0x000000000046c016 in __wt_open_session (conn=0xac61c0, event_handler=0x0, config=0x518c42 "isolation=snapshot", open_metadata=true, sessionp=0x7f14851d8d80)
          at ../src/session/session_api.c:1305
      #7  0x00000000004107e2 in __conn_open_session (wt_conn=0xac61c0, event_handler=0x0, config=0x518c42 "isolation=snapshot", wt_sessionp=0x7f14851d8e90)
          at ../src/conn/conn_api.c:1091
      #8  0x0000000000406517 in ops (arg=0xad4a00) at ../../../test/format/ops.c:286
      #9  0x00007f1488077555 in start_thread () from /lib64/libpthread.so.0
      #10 0x00007f1487785f3d in clone () from /lib64/libc.so.6
      

      The configuration file was:

      ############################################
      #  RUN PARAMETERS
      ############################################
      abort=0
      auto_throttle=1
      firstfit=0
      bitcnt=2
      bloom=1
      bloom_bit_count=60
      bloom_hash_count=7
      bloom_oldest=0
      cache=180
      checkpoints=1
      checksum=uncompressed
      chunk_size=6
      compaction=0
      compression=none
      data_extend=0
      data_source=lsm
      delete_pct=29
      dictionary=0
      encryption=rotn-7
      evict_max=0
      file_type=row-store
      backups=0
      huffman_key=0
      huffman_value=0
      insert_pct=54
      internal_key_truncation=1
      internal_page_max=9
      isolation=snapshot
      key_gap=6
      key_max=50
      key_min=30
      leak_memory=0
      leaf_page_max=15
      logging=0
      logging_compression=none
      logging_archive=0
      logging_prealloc=0
      long_running_txn=0
      lsm_worker_threads=4
      merge_max=7
      mmap=1
      ops=716676
      prefix_compression=0
      prefix_compression_min=1
      repeat_data_pct=35
      reverse=0
      rows=771677
      runs=0
      salvage=1
      split_pct=62
      statistics=1
      statistics_server=0
      threads=1
      timer=20
      value_max=2592
      value_min=17
      verify=1
      wiredtiger_config=
      write_pct=39
      ############################################
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                michael.cahill Michael Cahill
                Reporter:
                alexander.gorrod Alexander Gorrod
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: