Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-59931

Improve defragmentation script for Adobe

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.1.0-rc0
    • Component/s: None
    • Labels:
      None
    • Backwards Compatibility:
      Fully Compatible

      Description

      Defragmentation script

      Adobe mentioned the following things we need to improve around the defragmentation script

      • Phase 1 is not idempotent thus executing the same phase twice will over merge chunks,┬ápossibly producing chunks with sizes that are double the target chunk size.
      • Phase 2 always splits chunks in half without taking into account the real chunk size.
      • There is no way of throttling the migrations performed in phase 2
      • The progression bar is not accurate because it always accounts for all the chunks in the collection even if they are not going to be migrated.

      Performance evaluation
      In order to evaluate the impact of migrations after the defragmentation process we decided to run a few migrations after phase 1 and measure the time taken by the catalog cache refreshes and possibly the impact on a synthetic read workload. In order to perform this evaluation we will provide a new version of the defragmentation script with the following improvements:

      • Allow to run each phase separately, so that it will be possible to assess the performance after each phase.
      • Expose a parameter to limit the number of migrations performed in phase 2. So that the script can be also used to easily trigger a specific amount of migrations.

        Attachments

          Activity

            People

            Assignee:
            simon.gratzer Simon Gratzer (Inactive)
            Reporter:
            simon.gratzer Simon Gratzer (Inactive)
            Participants:
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: