Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-1869

cache: maximum page size at eviction exceeds memory_page_max by a large factor

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: WT2.7.0
    • Labels:
      None

      Description

      Running wtperf with the following configuration will generate maximum page sizes that are aprx 7x larger than the given memory_page_max size.

      conn_config="cache_size=100MB,statistics=(all),statistics_log=(wait=10)"
      database_count=1
      table_config="leaf_page_max=4k,internal_page_max=16k,leaf_item_max=1433,internal_item_max=3100,type=file,memory_page_max=10m,split_pct=90,leaf_value_max=1MB"
      icount=50000000
      populate_threads=10
      random_range=10000000
      report_interval=5
      run_time=0
      threads=((count=1,reads=1),(count=1,inserts=1))
      value_sz=100
      warmup=10

      This run takes 30~ seconds to form the first very large page when running on my OSX Macbook Pro

      Relates to MongoDB ticket SERVER-16902

        Issue Links

          Activity

          Hide
          michael.cahill Michael Cahill added a comment -

          @daveh86, does the 7x figure scale? That is, if you change the config to memory_page_max=20MB, does the largest page size grow to 140MB?

          Also, how does this vary if the number of threads is increased?

          Show
          michael.cahill Michael Cahill added a comment - @daveh86, does the 7x figure scale? That is, if you change the config to memory_page_max=20MB , does the largest page size grow to 140MB? Also, how does this vary if the number of threads is increased?
          Hide
          michael.cahill Michael Cahill added a comment -

          Will this be resolved by the merge of https://github.com/wiredtiger/wiredtiger/pull/1910?

          Show
          michael.cahill Michael Cahill added a comment - Will this be resolved by the merge of https://github.com/wiredtiger/wiredtiger/pull/1910?
          Hide
          michael.cahill Michael Cahill added a comment -

          David Hows can you please re-test against WiredTiger develop?

          Show
          michael.cahill Michael Cahill added a comment - David Hows can you please re-test against WiredTiger develop?
          Hide
          david.hows David Hows added a comment -

          Just ran this against 4b771f25. I was unable to reproduce, looks like this can be resolved.

          Show
          david.hows David Hows added a comment - Just ran this against 4b771f25 . I was unable to reproduce, looks like this can be resolved.

            People

            • Assignee:
              david.hows David Hows
              Reporter:
              david.hows David Hows
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: