Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-39682

shard request to split a same chunk at the same time.

    • Type: Icon: Question Question
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Sharding, WiredTiger
    • Labels:
      None

      Hello, in the environment of my production server, there is occasional increase in machine load, the normal time is 0-1, the abnormal time is 5-10, the shard node cpu is very high when viewing, the machine always prints some information when viewing the log. When the log is not printed, the machine load drops and resumes. The "Finding the split vector for ctu.mobileToken" will always operate, how to avoid it, during this time, the request volume has not increased significantly, io utils 40%. I am looking forward to your reply, thank you!

       

      2019-02-20T04:58:26.922+0000 W SHARDING [conn68391] Finding the split vector for ctu.mobileToken over { token: 1.0 } keyCount: 12719 numSplits: 119 lookedAt: 7252 took 1994ms
      2019-02-20T04:58:26.922+0000 I COMMAND [conn68391] command admin.$cmd command: splitVector { splitVector: "ctu.mobileToken", keyPattern:

      { token: 1.0 }

      , min: { token: "5c6bc051xbpFF1evtQv1JhORbtFRiBkFeIl8Ws83" }, max: { token: MaxKey }, maxChunkSizeBytes: 67108864 } numYields:11889 reslen:7434 locks:{ Global: { acquireCount:

      { r: 23780 }

      }, Database: { acquireCount:

      { r: 11890 }

      }, Collection: { acquireCount:

      { r: 11890 }

      , acquireWaitCount: { r: 7 }, timeAcquiringMicros: { r: 9833 } } } protocol:op_command 2012ms

      2019-02-20T04:58:26.606+0000 W SHARDING [conn68397] Finding the split vector for ctu.mobileToken over { token: 1.0 } keyCount: 12719 numSplits: 119 lookedAt: 7242 took 2188ms
      2019-02-20T04:58:26.614+0000 I COMMAND [conn68397] command admin.$cmd command: splitVector { splitVector: "ctu.mobileToken", keyPattern:

      { token: 1.0 }

      , min: { token: "5c6bc051xbpFF1evtQv1JhORbtFRiBkFeIl8Ws83" }, max: { token: MaxKey }, maxChunkSizeBytes: 67108864 } numYields:11893 reslen:7434 locks:{ Global: { acquireCount:

      { r: 23788 }

      }, Database: { acquireCount:

      { r: 11894 }

      }, Collection: { acquireCount:

      { r: 11894 }

      , acquireWaitCount: { r: 8 }, timeAcquiringMicros: { r: 25394 } } } protocol:op_command 2196ms

      2019-02-20T04:58:26.108+0000 I SHARDING [conn68392] request split points lookup for chunk ctu.mobileToken { : "5c6bc051xbpFF1evtQv1JhORbtFRiBkFeIl8Ws83" } -->> { : MaxKey }
      2019-02-20T04:58:26.143+0000 W SHARDING [conn68389] Finding the split vector for ctu.mobileToken over { token: 1.0 } keyCount: 12719 numSplits: 119 lookedAt: 7221 took 1915ms
      2019-02-20T04:58:26.143+0000 I COMMAND [conn68389] command admin.$cmd command: splitVector { splitVector: "ctu.mobileToken", keyPattern:

      { token: 1.0 }

      , min: { token: "5c6bc051xbpFF1evtQv1JhORbtFRiBkFeIl8Ws83" }, max: { token: MaxKey }, maxChunkSizeBytes: 67108864 } numYields:11888 reslen:7434 locks:{ Global: { acquireCount:

      { r: 23778 }

      }, Database: { acquireCount:

      { r: 11889 }

      }, Collection: { acquireCount:

      { r: 11889 }

      , acquireWaitCount: { r: 7 }, timeAcquiringMicros: { r: 11752 } } } protocol:op_command 1915ms

       

      2019-02-20T04:58:26.144+0000 I SHARDING [conn68389] received splitChunk request: { splitChunk: "ctu.mobileToken", configdb: "crs/10.60.96.104:21001,10.60.96.81:21001,10.60.96.92:21001", from: "rs3", keyPattern:

      { token: 1.0 }

      , shardVersion: [ Timestamp 4419000|633, ObjectId('5bc858a5c9ebaf2f1aafd8db') ], min: { token: "5c6bc051xbpFF1evtQv1JhORbtFRiBkFeIl8Ws83" }, max: { token: MaxKey }, splitKeys: [ { token: "5c6bc2301lWzOdbLzOYXcibfkgMDHi7XKN4xkRW3" }, { token: "5c6bc40dU74I7yewg2ifmA2XCUEtrwvwlmzRP0m3" }, { token: "5c6bc5f0tTGE1yJKpZIkoISq99cmTTqeu74XKTe3" }, { token: "5c6bc7d8pm0SayzAzdIC8gYssmU6PjGhozzv0iF3" }, { token: "5c6bc9c3gRS7D56NkHv7UalFsAxz9dXkAWtI7tI3" }, { token: "5c6bcba5kTeFzefCUUKcVXI16C4LXYeuA8GtcAW3" }, { token: "5c6bcd8elMIjPAmVT2yJRO8cB80LItVVURDgErj3" }, { token: "5c6bcf853Zlt9Hhfl6zZualYooyCCpkdFQ6vere3" }, { token: "5c6bd180q3wyUljtRQ3dlyqSCJJO0R6itPWGyPg2" }, { token: "5c6bd382FCnxqHujlhcyfGWciqMXQCbhBGPND6u3" }, { token: "5c6bd53eaQdVIbd5NquKxr5Wx66DvRU6qaPYoIR3" }, { token: "5c6bd6e58Z5iBK9SnMhlPF5q1pQB5PaeZ2xjpoe3" }, { token: "5c6bd884CGMAajikF1JRksBiLsJWIfG2A9RLCD43" }, { token: "5c6bda2dYS0ccVBJuZ5d5LmFSljvXPsxENL8xL43" }, { token: "5c6bdbedFUq4zx2kuHxUfhFqk6Rjrzohsu6Jx3I3" }, { token: "5c6bddabUMYMsVXQQ6w9HibJI4fZDk7rttx9NQy2" }, { token: "5c6bdf69ve7X83v2E9rFZNZ9WL2LaTCnccEATcL3" }, { token: "5c6be11eB5ZywhbVM2fTOUjrz6OdTNpnc9ZQ0Jq3" }, { token: "5c6be2a5WPt9bMt9doFB2v7vA3uWKv1vapGwzYU3" }, { token: "5c6be42aHdlCe4Mg5Vylmj5Grv7iZIhq01Wn4wl3" }, { token: "5c6be5aejqvp9N6Ep2UN18Z95nljZKnZA9umD153" }, { token: "5c6be735f0RMucZh6BSbWQ0r62AXRGEQHxB8E0k3" }, { token: "5c6be8baBQmqG9Kme1MJEowNNM7KEBemATRSC6a3" }, { token: "5c6bea42Vq58mff3vYwq4DvJ3d1qT8p67MtYu1T2" }, { token: "5c6bebc0GJ6zszVTZeLRO8tH7zLiotBAHUMkVek3" }, { token: "5c6bed48thbSbfWazo72LsiIFd4SulYtXPdMU8m3" }, { token: "5c6beecc1fqXsdcK8VxwXFqZIoMHAyppn6LZnnX3" }, { token: "5c6bf04aKgObuSFhhCKmDtUkWGhEuI5kEh8vwNn3" }, { token: "5c6bf1c3vcQeCNFZ0wxMWj4TiUFVhlXyMeRYLAl3" }, { token: "5c6bf33elMtm5lbxCH3u5m6013XdKoR1elIyqXC3" }, { token: "5c6bf4b2xM6BTt8bBUvb2Ritsmp6B2isoYu8lf63" }, { token: "5c6bf629Sra7XhKyiyA7cqzRQ4qr5dInm6fx4v12" }, { token: "5c6bf795c2LaLIwcIgSDEED6nuGrcXLSkxyIXnk3" }, { token: "5c6bf906B2djS6LIxPUi5n7W3XQLEndmxLac4HK3" }, { token: "5c6bfa68jOLppJzZ25ItuFS3cKhP93T95TuVbCK3" }, { token: "5c6bfbc8bKpBqvUJP3Ab7WWbW5JtYahHTKOZpdA2" }, { token: "5c6bfd2aVtdUlT96ZtuV7vLX6mS4mRpGN92oiii2" }, { token: "5c6bfe7cUN0nDZoxVRP70iQBtp87yf4xCLfJcKB2" }, { token: "5c6bffd2jiTcr2GrZSSQo9Ks5W5oD0zkPZzOUFn3" }, { token: "5c6c0129VIk5lz1UoeZhi5h7hJlUEK0dBfm7XCA3" }, { token: "5c6c0279TRZRoB3LknwS1JZI41N0uJgbaLq00hp3" }, { token: "5c6c03c3uid5Ng54HxfY456mCGIY6U9FLtK0FL23" }, { token: "5c6c050fwB1LkbGprhV2eTM9wsn5Nbda6KESCgH3" }, { token: "5c6c06552Gib8GsoUxVGiR8NXhAmvWc39OO2nU23" }, { token: "5c6c07a3T8fpftwGK2E0HWoJmrJxDtKnwCSxA6x3" }, { token: "5c6c08ebXwEFKA9fqxKe8NWtDt0XZ9wRN48WOqe2" }, { token: "5c6c0a30CpUT9A8EvSSEkmvPzhfHEBAslbeJsg52" }, { token: "5c6c0b7cNVobHHdrQFGkWDyALv5vlRqY5iH82V42" }, { token: "5c6c0cc0BtHmxER6oWLfiTmIPWLuMgf7eUbwnSe3" }, { token: "5c6c0e05R8clkU0CvUWpfaNSdFilFnhOyUcdOhC2" }, { token: "5c6c0f4fyPDv5PzORWpKrZm5u0gHUKRFImoJ1Os3" }, { token: "5c6c10a17O3jL2zvbkldVPh2UlVeuNyRmDmsznm3" }, { token: "5c6c11f8WxSfvOn9xIuFxEfP6OqcgTQjAjBqqSo3" }, { token: "5c6c1351a2oMsAO9NLjlkrgs2np2YUvjOduEGze3" }, { token: "5c6c14ac89IP7uTQyhnNQcjkZ4aFo8xndlNQ3083" }, { token: "5c6c160bzt7MeaqNvovuFgOIxrE5yh5lgxFsCBt2" }, { token: "5c6c1772VTCyIPW39JCKVEqhSwKEpZIsDCg2e243" }, { token: "5c6c18e6ofcjDuA63LLI9WUbCoRPhPa1A6fjI6a2" }, { token: "5c6c1a62ToOX2qIi35TmcupyaVsYMKxN27jRgyP3" }, { token: "5c6c1bf0oDSIO4fZJbDBIDr3O4GYfHaxbLrqxwK3" }, { token: "5c6c1d96AmKBg2ohUrBHJiwwZ2exjRoHQEn3p5w2" }, { token: "5c6c1f4dIh6h15FzogJocK8keUsf0DNQIPIRy6g2" }, { token: "5c6c21204qrUjJyOV6XMhSTR2vXnoeMxNEm9oCm3" }, { token: "5c6c2312qVcnXxr3C1zQDFV7fxugw4EsYHc8BjN3" }, { token: "5c6c2533F8ayiQmw2AUA4dckyBiHUn2qG3umYna3" }, { token: "5c6c276eOQYFTvb8JMyPLML9WU0RXHy9jYOso2Q3" }, { token: "5c6c297eg75wFtZWDy3qUE03NoMLTOeqYM51laL3" }, { token: "5c6c2be6SGIixLpYVln6E4DxL43qYqmqg9Gc0KL3" }, { token: "5c6c2ed4bnkmG5YwqIY4EpeuuGvOlWnXON1qTZB2" }, { token: "5c6c3249mAqSFFOAL1xgWcP84OVprnft5y5q6eU3" }, { token: "5c6c3667Tv3A2s6S2ilpu3YMWfDnSigElvBUCGT2" }, { token: "5c6c3b81I6UNFvkI3WCe0fTjqOLT1kKrM2StZ7J3" }, { token: "5c6c423dy9M8FPGSUMMWXUHFW2pQKX1Eiz5kAW13" }, { token: "5c6c4b6aMdrhkBU1Ivfc7Sd6dP07VBSMTs8yPSQ3" }, { token: "5c6c57d0n4GaOwYvzkJYKLCHMoyq3LAAlXECKct3" }, { token: "5c6c67d327vbJjnNKqbpHNGi8ArxZv419VnN1Sd2" }, { token: "5c6c7908ubizbPIiBvxFYlPtdhIZTKSgHIh6oYU3" }, { token: "5c6c835daGjks1dycAXBZn7pO38g7sMiWaqD3F63" }, { token: "5c6c89639O9RLGlnLDqMqGDHYE0ODktKhnrxSJq3" }, { token: "5c6c8da1Megjlf2w5vw2b0IHYYYkKpoNBRSuxoK3" }, { token: "5c6c914b9qhq0R0fcy5iZCKwepnyW3pR6ADLk2m3" }, { token: "5c6c9472SYf8PmtRsb3JoHifbZNSSRg2c7bdhHf3" }, { token: "5c6c9766pvXJJp7YNqLyz7aJZOdxmdAa5CLsEpG3" }, { token: "5c6c9a37rnjarQR6l0WyrZKCWevU1mJSS4uiXce3" }, { token: "5c6c9cd5z9GkKmFgxpixPfeLYnELudHO5LBDL4T2" }, { token: "5c6c9f5fTvTpx7cOptZf7iTYSS6ZmNXKZ5YWniF3" }, { token: "5c6ca1c5enM36ga8wUyeZqTwwtlvq5jGd6welKH3" }, { token: "5c6ca413wvw9OtORfbwLBBBkuYNqoEzYl6EIyPQ3" }, { token: "5c6ca658RBm795DZ7YRJghX9cCJSejZDUQZhlk32" }, { token: "5c6ca848WatvEDrOqwaEfUNSD4QYSbYtBOmJlee2" }, { token: "5c6caa4azxtCnbVnsC3sGvjADfVDsg1rvoeqCDp3" }, { token: "5c6cac5aiivuItD7TX5SzF1V9hkq5i4O7ucCZ083" }, { token: "5c6cae5at8GYNXz5wdzWslHeLpgv24mvalSz9lN3" }, { token: "5c6cb05bSQW05ZRSGOPql3CwhG3HjPULSOqlPYF3" }, { token: "5c6cb253hi3zVmtohwdnc1dH1QoZYAdpWxb54Xy2" }, { token: "5c6cb44aCpKcPk9dbS54TUHMVf4uaZmTtYPnTc23" }, { token: "5c6cb631CpqBppPIXoiaCCaTigNtN5LVWzSupkT3" }, { token: "5c6cb80fwDStrxgGKlFT78H6yvao7wYahWJv7NS2" }, { token: "5c6cb9f3R2obvoiRKkQZQdm1mmkcpS79m9BVmDR3" }, { token: "5c6cbbd3ACnLYaCwBBs4qLuNnk5fz74p5uAVBZ62" }, { token: "5c6cbda3tH1uNBhOAHVjWb16seJR87csKJuxPd32" }, { token: "5c6cbf73oCE79n1x3OGFItOKU6em26nHn0aXOVb3" }, { token: "5c6cc1438ZeT2ZbjLTD7kxgVQrURMQnobBanl7X3" }, { token: "5c6cc313B2l2Vx9AJtZxh12Lu8yXEEbsaRkfz9W3" }, { token: "5c6cc4eaBzvvdyYPJQ7hqou95abbzpt0e4XuESG3" }, { token: "5c6cc6b4yrCafnMjDJkpJviuT40YjKfW6JtEGnP3" }, { token: "5c6cc87d0PTl9gcWXs8Fj43RzC9Ql8BiCT5WMR42" }, { token: "5c6cca4bmdnrQp3mM4Vb2GbqXx4sjCFmcXhO2Cp3" }, { token: "5c6ccc18rQZrHOIvBmR2qwVhqCZu5FtIc4tVcOG3" }, { token: "5c6ccde8aDRhEY4Em20CAA6qBkSdCbanfS5n4JC3" }, { token: "5c6ccfb64oGIVFZgb6k4Q4watJnshVk2fq4TFT83" }, { token: "5c6cd17f9cDMR2PgtuEklGCXBr0i411p8DErlPr3" }, { token: "5c6cd3338ftdwMbIFOyn4TFcJ1lOOSEjtukIJu03" }, { token: "5c6cd4f69ogP1QFrLVhFxDtJ4QwGB7cHIRy8RDk3" }, { token: "5c6cd6b6hFc0pD1LTPfymORS5WRhC3uv8nDmber2" }, { token: "5c6cd864hA3Rtmb5QUi0W6Y9BMBh8E6Lipc78tQ3" }, { token: "5c6cda15XJ4xiAsY2PAs7wx5nDiei9LfkImgdMj2" }, { token: "5c6cdbc4Plwak4CedPxxPRwndEe5kvFenGSzr7F3" }, { token: "5c6cde72cvQMouAe4SNgu0pYwu4tH3VaXK3L61D3" } ] }

            Assignee:
            Unassigned Unassigned
            Reporter:
            JackWang@180721 JackWang [X]
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: