[WT-2064] Eviction hang - MongoDB

Details

Type: Bug
Status: Resolved
Priority: Major - P3
Resolution: Fixed
Affects Version/s: None
Fix Version/s: WT2.7.0
Labels:
None

Description

My pull-request-tester for the log-slot-revamp branch failed due to a hang in test/format from make check. Running the CONFIG resulted in a hang on the 2nd iteration. I have not (yet) been able to reproduce on the develop branch but I doubt my logging changes caused an eviction hang.

Issue Links

is depended on by

SERVER-20060 WiredTiger changes for MongoDB 3.1.8

Closed

SERVER-20408 WiredTiger changes for MongoDB 3.1.9

Closed

Activity

Comments

Ascending order - Click to sort in descending order

Hide

Permalink

Sue LoVerso added a comment - Aug 26 2015 07:33:35 PM +00:00

The pmp output from the hang:

      1 select,__wt_sleep,__wt_writelock,__wt_lsm_tree_writelock,__wt_lsm_merge,__lsm_worker,start_thread,clone

      1 select,__wt_sleep,__wt_readlock,__wt_lsm_tree_readlock,__wt_lsm_get_chunk_to_flush,__lsm_worker_general_op,__lsm_worker,start_thread,clone

      1 pthread_cond_timedwait@@GLIBC_2.3.2,__wt_cond_wait,__log_wrlsn_server,start_thread,clone

      1 pthread_cond_timedwait@@GLIBC_2.3.2,__wt_cond_wait,__log_server,start_thread,clone

      1 pthread_cond_timedwait@@GLIBC_2.3.2,__wt_cond_wait,__log_file_server,start_thread,clone

      1 pthread_cond_timedwait@@GLIBC_2.3.2,__wt_cond_wait,__evict_request_walk_clear,__wt_evict_file_exclusive_on,__wt_evict_file,__wt_cache_op,__wt_checkpoint_close,__wt_conn_btree_sync_and_close,__wt_conn_dhandle_close_all,__wt_schema_worker,__wt_lsm_tree_worker,__wt_schema_worker,__wt_schema_worker,__session_verify,wts_verify,main

      1 __lll_lock_wait,_L_lock_816,pthread_mutex_lock,__wt_spin_lock,__sweep_remove_handles,__sweep_server,start_thread,clone

      1 __lll_lock_wait,_L_lock_816,pthread_mutex_lock,__wt_spin_lock,__lsm_manager_run_server,__lsm_worker_manager,start_thread,clone

      1 __lll_lock_wait,_L_lock_816,pthread_mutex_lock,__wt_spin_lock,__evict_server,start_thread,clone

The CONFIG:

############################################

#  RUN PARAMETERS

############################################

abort=0

auto_throttle=1

firstfit=0

bitcnt=6

bloom=1

bloom_bit_count=36

bloom_hash_count=24

bloom_oldest=0

cache=60

checkpoints=1

checksum=uncompressed

chunk_size=2

compaction=0

compression=none

data_extend=0

data_source=lsm

delete_pct=14

dictionary=0

encryption=none

evict_max=0

file_type=row-store

backups=1

huffman_key=0

huffman_value=0

insert_pct=72

internal_key_truncation=1

internal_page_max=9

isolation=read-uncommitted

key_gap=11

key_max=106

key_min=22

leak_memory=0

leaf_page_max=11

logging=1

logging_compression=none

logging_archive=1

logging_prealloc=1

long_running_txn=0

lsm_worker_threads=3

merge_max=13

mmap=1

ops=100000

prefix_compression=1

prefix_compression_min=6

repeat_data_pct=46

reverse=0

rows=10000

runs=100

salvage=1

split_pct=78

statistics=0

statistics_server=0

threads=4

timer=20

value_max=418

value_min=9

verify=1

wiredtiger_config=

write_pct=30

############################################

Show

Sue LoVerso added a comment - Aug 26 2015 07:33:35 PM +00:00 The pmp output from the hang: 2 1 select,__wt_sleep,__wt_writelock,__wt_lsm_tree_writelock,__wt_lsm_merge,__lsm_worker,start_thread,clone 1 select,__wt_sleep,__wt_readlock,__wt_lsm_tree_readlock,__wt_lsm_get_chunk_to_flush,__lsm_worker_general_op,__lsm_worker,start_thread,clone 1 pthread_cond_timedwait@@GLIBC_2.3.2,__wt_cond_wait,__log_wrlsn_server,start_thread,clone 1 pthread_cond_timedwait@@GLIBC_2.3.2,__wt_cond_wait,__log_server,start_thread,clone 1 pthread_cond_timedwait@@GLIBC_2.3.2,__wt_cond_wait,__log_file_server,start_thread,clone 1 pthread_cond_timedwait@@GLIBC_2.3.2,__wt_cond_wait,__evict_request_walk_clear,__wt_evict_file_exclusive_on,__wt_evict_file,__wt_cache_op,__wt_checkpoint_close,__wt_conn_btree_sync_and_close,__wt_conn_dhandle_close_all,__wt_schema_worker,__wt_lsm_tree_worker,__wt_schema_worker,__wt_schema_worker,__session_verify,wts_verify,main 1 __lll_lock_wait,_L_lock_816,pthread_mutex_lock,__wt_spin_lock,__sweep_remove_handles,__sweep_server,start_thread,clone 1 __lll_lock_wait,_L_lock_816,pthread_mutex_lock,__wt_spin_lock,__lsm_manager_run_server,__lsm_worker_manager,start_thread,clone 1 __lll_lock_wait,_L_lock_816,pthread_mutex_lock,__wt_spin_lock,__evict_server,start_thread,clone The CONFIG: ############################################ # RUN PARAMETERS ############################################ abort=0 auto_throttle=1 firstfit=0 bitcnt=6 bloom=1 bloom_bit_count=36 bloom_hash_count=24 bloom_oldest=0 cache=60 checkpoints=1 checksum=uncompressed chunk_size=2 compaction=0 compression=none data_extend=0 data_source=lsm delete_pct=14 dictionary=0 encryption=none evict_max=0 file_type=row-store backups=1 huffman_key=0 huffman_value=0 insert_pct=72 internal_key_truncation=1 internal_page_max=9 isolation=read-uncommitted key_gap=11 key_max=106 key_min=22 leak_memory=0 leaf_page_max=11 logging=1 logging_compression=none logging_archive=1 logging_prealloc=1 long_running_txn=0 lsm_worker_threads=3 merge_max=13 mmap=1 ops=100000 prefix_compression=1 prefix_compression_min=6 repeat_data_pct=46 reverse=0 rows=10000 runs=100 salvage=1 split_pct=78 statistics=0 statistics_server=0 threads=4 timer=20 value_max=418 value_min=9 verify=1 wiredtiger_config= write_pct=30 ############################################

5 older comments

Hide

Permalink

Githook User added a comment - Aug 27 2015 02:03:17 PM +00:00

Author:

{u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'}

Message: Merge branch 'develop' into ~~WT-2064~~
Branch: develop
https://github.com/wiredtiger/wiredtiger/commit/3956aac5459d6955e155ff9a031fc912699510d7

Show

Githook User added a comment - Aug 27 2015 02:03:17 PM +00:00 Author: {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'} Message: Merge branch 'develop' into WT-2064 Branch: develop https://github.com/wiredtiger/wiredtiger/commit/3956aac5459d6955e155ff9a031fc912699510d7

Hide

Permalink

Githook User added a comment - Aug 27 2015 02:03:18 PM +00:00

Author:

{u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'}

Message: Merge pull request #2155 from wiredtiger/~~WT-2064~~

~~WT-2064~~ Don't spin indefinitely waiting for the handle list lock in eviction
Branch: develop
https://github.com/wiredtiger/wiredtiger/commit/66757f72471ced8edd858c4dd2742e6318ed446a

Show

Githook User added a comment - Aug 27 2015 02:03:18 PM +00:00 Author: {u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'} Message: Merge pull request #2155 from wiredtiger/ WT-2064 WT-2064 Don't spin indefinitely waiting for the handle list lock in eviction Branch: develop https://github.com/wiredtiger/wiredtiger/commit/66757f72471ced8edd858c4dd2742e6318ed446a

Hide

Permalink

Githook User added a comment - Aug 27 2015 02:03:19 PM +00:00

Author:

{u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'}

Message: Merge pull request #2155 from wiredtiger/~~WT-2064~~

~~WT-2064~~ Don't spin indefinitely waiting for the handle list lock in eviction
Branch: develop
https://github.com/wiredtiger/wiredtiger/commit/66757f72471ced8edd858c4dd2742e6318ed446a

Show

Githook User added a comment - Aug 27 2015 02:03:19 PM +00:00 Author: {u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'} Message: Merge pull request #2155 from wiredtiger/ WT-2064 WT-2064 Don't spin indefinitely waiting for the handle list lock in eviction Branch: develop https://github.com/wiredtiger/wiredtiger/commit/66757f72471ced8edd858c4dd2742e6318ed446a

Hide

Permalink

Githook User added a comment - Sep 18 2015 02:49:12 AM +00:00

Author:

{u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'}

Message: ~~WT-2064~~ Don't spin indefinitely waiting for the handle list lock in eviction

Merge pull request #2155 from wiredtiger/~~WT-2064~~

(cherry picked from commit 66757f72471ced8edd858c4dd2742e6318ed446a)
Branch: mongodb-3.0
https://github.com/wiredtiger/wiredtiger/commit/119038d87461bde02631f577721fbfc1ec961c82

Show

Githook User added a comment - Sep 18 2015 02:49:12 AM +00:00 Author: {u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'} Message: WT-2064 Don't spin indefinitely waiting for the handle list lock in eviction Merge pull request #2155 from wiredtiger/ WT-2064 (cherry picked from commit 66757f72471ced8edd858c4dd2742e6318ed446a) Branch: mongodb-3.0 https://github.com/wiredtiger/wiredtiger/commit/119038d87461bde02631f577721fbfc1ec961c82

Hide

Permalink

Githook User added a comment - Sep 18 2015 02:49:12 AM +00:00

Author:

{u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'}

Message: ~~WT-2064~~ Don't spin indefinitely waiting for the handle list lock in eviction

Merge pull request #2155 from wiredtiger/~~WT-2064~~

(cherry picked from commit 66757f72471ced8edd858c4dd2742e6318ed446a)
Branch: mongodb-3.0
https://github.com/wiredtiger/wiredtiger/commit/119038d87461bde02631f577721fbfc1ec961c82

Show

People

Assignee:

Unassigned

Reporter:

Sue LoVerso

Votes:

0 Vote for this issue

Watchers:

2 Start watching this issue

Dates

Created:

Aug 26 2015 07:31:56 PM +00:00

Updated:

Sep 30 2015 06:29:49 AM +00:00

Resolved:

Aug 27 2015 02:09:40 PM +00:00

Agile

View on Board

JIRA will be unavailable for scheduled maintenance from 2:00 pm - 06:00 pm UTC on July 29th, 2017

Details

Description

Issue Links

Activity

People

Dates

Agile