-
Type: Question
-
Resolution: Duplicate
-
Priority: Major - P3
-
None
-
Affects Version/s: None
-
Component/s: Sharding, WiredTiger
-
None
Hello, in the environment of my production server, there is occasional increase in machine load, the normal time is 0-1, the abnormal time is 5-10, the shard node cpu is very high when viewing, the machine always prints some information when viewing the log. When the log is not printed, the machine load drops and resumes. The "Finding the split vector for ctu.mobileToken" will always operate, how to avoid it, during this time, the request volume has not increased significantly, io utils 40%. I am looking forward to your reply, thank you!
2019-02-20T04:58:26.922+0000 W SHARDING [conn68391] Finding the split vector for ctu.mobileToken over { token: 1.0 } keyCount: 12719 numSplits: 119 lookedAt: 7252 took 1994ms
2019-02-20T04:58:26.922+0000 I COMMAND [conn68391] command admin.$cmd command: splitVector { splitVector: "ctu.mobileToken", keyPattern:
, min: { token: "5c6bc051xbpFF1evtQv1JhORbtFRiBkFeIl8Ws83" }, max: { token: MaxKey }, maxChunkSizeBytes: 67108864 } numYields:11889 reslen:7434 locks:{ Global: { acquireCount:
{ r: 23780 }}, Database: { acquireCount:
{ r: 11890 }}, Collection: { acquireCount:
{ r: 11890 }, acquireWaitCount: { r: 7 }, timeAcquiringMicros: { r: 9833 } } } protocol:op_command 2012ms
2019-02-20T04:58:26.606+0000 W SHARDING [conn68397] Finding the split vector for ctu.mobileToken over { token: 1.0 } keyCount: 12719 numSplits: 119 lookedAt: 7242 took 2188ms
2019-02-20T04:58:26.614+0000 I COMMAND [conn68397] command admin.$cmd command: splitVector { splitVector: "ctu.mobileToken", keyPattern:
, min: { token: "5c6bc051xbpFF1evtQv1JhORbtFRiBkFeIl8Ws83" }, max: { token: MaxKey }, maxChunkSizeBytes: 67108864 } numYields:11893 reslen:7434 locks:{ Global: { acquireCount:
{ r: 23788 }}, Database: { acquireCount:
{ r: 11894 }}, Collection: { acquireCount:
{ r: 11894 }, acquireWaitCount: { r: 8 }, timeAcquiringMicros: { r: 25394 } } } protocol:op_command 2196ms
2019-02-20T04:58:26.108+0000 I SHARDING [conn68392] request split points lookup for chunk ctu.mobileToken { : "5c6bc051xbpFF1evtQv1JhORbtFRiBkFeIl8Ws83" } -->> { : MaxKey }
2019-02-20T04:58:26.143+0000 W SHARDING [conn68389] Finding the split vector for ctu.mobileToken over { token: 1.0 } keyCount: 12719 numSplits: 119 lookedAt: 7221 took 1915ms
2019-02-20T04:58:26.143+0000 I COMMAND [conn68389] command admin.$cmd command: splitVector { splitVector: "ctu.mobileToken", keyPattern:
, min: { token: "5c6bc051xbpFF1evtQv1JhORbtFRiBkFeIl8Ws83" }, max: { token: MaxKey }, maxChunkSizeBytes: 67108864 } numYields:11888 reslen:7434 locks:{ Global: { acquireCount:
{ r: 23778 }}, Database: { acquireCount:
{ r: 11889 }}, Collection: { acquireCount:
{ r: 11889 }, acquireWaitCount: { r: 7 }, timeAcquiringMicros: { r: 11752 } } } protocol:op_command 1915ms
2019-02-20T04:58:26.144+0000 I SHARDING [conn68389] received splitChunk request: { splitChunk: "ctu.mobileToken", configdb: "crs/10.60.96.104:21001,10.60.96.81:21001,10.60.96.92:21001", from: "rs3", keyPattern:
{ token: 1.0 }, shardVersion: [ Timestamp 4419000|633, ObjectId('5bc858a5c9ebaf2f1aafd8db') ], min: { token: "5c6bc051xbpFF1evtQv1JhORbtFRiBkFeIl8Ws83" }, max: { token: MaxKey }, splitKeys: [ { token: "5c6bc2301lWzOdbLzOYXcibfkgMDHi7XKN4xkRW3" }, { token: "5c6bc40dU74I7yewg2ifmA2XCUEtrwvwlmzRP0m3" }, { token: "5c6bc5f0tTGE1yJKpZIkoISq99cmTTqeu74XKTe3" }, { token: "5c6bc7d8pm0SayzAzdIC8gYssmU6PjGhozzv0iF3" }, { token: "5c6bc9c3gRS7D56NkHv7UalFsAxz9dXkAWtI7tI3" }, { token: "5c6bcba5kTeFzefCUUKcVXI16C4LXYeuA8GtcAW3" }, { token: "5c6bcd8elMIjPAmVT2yJRO8cB80LItVVURDgErj3" }, { token: "5c6bcf853Zlt9Hhfl6zZualYooyCCpkdFQ6vere3" }, { token: "5c6bd180q3wyUljtRQ3dlyqSCJJO0R6itPWGyPg2" }, { token: "5c6bd382FCnxqHujlhcyfGWciqMXQCbhBGPND6u3" }, { token: "5c6bd53eaQdVIbd5NquKxr5Wx66DvRU6qaPYoIR3" }, { token: "5c6bd6e58Z5iBK9SnMhlPF5q1pQB5PaeZ2xjpoe3" }, { token: "5c6bd884CGMAajikF1JRksBiLsJWIfG2A9RLCD43" }, { token: "5c6bda2dYS0ccVBJuZ5d5LmFSljvXPsxENL8xL43" }, { token: "5c6bdbedFUq4zx2kuHxUfhFqk6Rjrzohsu6Jx3I3" }, { token: "5c6bddabUMYMsVXQQ6w9HibJI4fZDk7rttx9NQy2" }, { token: "5c6bdf69ve7X83v2E9rFZNZ9WL2LaTCnccEATcL3" }, { token: "5c6be11eB5ZywhbVM2fTOUjrz6OdTNpnc9ZQ0Jq3" }, { token: "5c6be2a5WPt9bMt9doFB2v7vA3uWKv1vapGwzYU3" }, { token: "5c6be42aHdlCe4Mg5Vylmj5Grv7iZIhq01Wn4wl3" }, { token: "5c6be5aejqvp9N6Ep2UN18Z95nljZKnZA9umD153" }, { token: "5c6be735f0RMucZh6BSbWQ0r62AXRGEQHxB8E0k3" }, { token: "5c6be8baBQmqG9Kme1MJEowNNM7KEBemATRSC6a3" }, { token: "5c6bea42Vq58mff3vYwq4DvJ3d1qT8p67MtYu1T2" }, { token: "5c6bebc0GJ6zszVTZeLRO8tH7zLiotBAHUMkVek3" }, { token: "5c6bed48thbSbfWazo72LsiIFd4SulYtXPdMU8m3" }, { token: "5c6beecc1fqXsdcK8VxwXFqZIoMHAyppn6LZnnX3" }, { token: "5c6bf04aKgObuSFhhCKmDtUkWGhEuI5kEh8vwNn3" }, { token: "5c6bf1c3vcQeCNFZ0wxMWj4TiUFVhlXyMeRYLAl3" }, { token: "5c6bf33elMtm5lbxCH3u5m6013XdKoR1elIyqXC3" }, { token: "5c6bf4b2xM6BTt8bBUvb2Ritsmp6B2isoYu8lf63" }, { token: "5c6bf629Sra7XhKyiyA7cqzRQ4qr5dInm6fx4v12" }, { token: "5c6bf795c2LaLIwcIgSDEED6nuGrcXLSkxyIXnk3" }, { token: "5c6bf906B2djS6LIxPUi5n7W3XQLEndmxLac4HK3" }, { token: "5c6bfa68jOLppJzZ25ItuFS3cKhP93T95TuVbCK3" }, { token: "5c6bfbc8bKpBqvUJP3Ab7WWbW5JtYahHTKOZpdA2" }, { token: "5c6bfd2aVtdUlT96ZtuV7vLX6mS4mRpGN92oiii2" }, { token: "5c6bfe7cUN0nDZoxVRP70iQBtp87yf4xCLfJcKB2" }, { token: "5c6bffd2jiTcr2GrZSSQo9Ks5W5oD0zkPZzOUFn3" }, { token: "5c6c0129VIk5lz1UoeZhi5h7hJlUEK0dBfm7XCA3" }, { token: "5c6c0279TRZRoB3LknwS1JZI41N0uJgbaLq00hp3" }, { token: "5c6c03c3uid5Ng54HxfY456mCGIY6U9FLtK0FL23" }, { token: "5c6c050fwB1LkbGprhV2eTM9wsn5Nbda6KESCgH3" }, { token: "5c6c06552Gib8GsoUxVGiR8NXhAmvWc39OO2nU23" }, { token: "5c6c07a3T8fpftwGK2E0HWoJmrJxDtKnwCSxA6x3" }, { token: "5c6c08ebXwEFKA9fqxKe8NWtDt0XZ9wRN48WOqe2" }, { token: "5c6c0a30CpUT9A8EvSSEkmvPzhfHEBAslbeJsg52" }, { token: "5c6c0b7cNVobHHdrQFGkWDyALv5vlRqY5iH82V42" }, { token: "5c6c0cc0BtHmxER6oWLfiTmIPWLuMgf7eUbwnSe3" }, { token: "5c6c0e05R8clkU0CvUWpfaNSdFilFnhOyUcdOhC2" }, { token: "5c6c0f4fyPDv5PzORWpKrZm5u0gHUKRFImoJ1Os3" }, { token: "5c6c10a17O3jL2zvbkldVPh2UlVeuNyRmDmsznm3" }, { token: "5c6c11f8WxSfvOn9xIuFxEfP6OqcgTQjAjBqqSo3" }, { token: "5c6c1351a2oMsAO9NLjlkrgs2np2YUvjOduEGze3" }, { token: "5c6c14ac89IP7uTQyhnNQcjkZ4aFo8xndlNQ3083" }, { token: "5c6c160bzt7MeaqNvovuFgOIxrE5yh5lgxFsCBt2" }, { token: "5c6c1772VTCyIPW39JCKVEqhSwKEpZIsDCg2e243" }, { token: "5c6c18e6ofcjDuA63LLI9WUbCoRPhPa1A6fjI6a2" }, { token: "5c6c1a62ToOX2qIi35TmcupyaVsYMKxN27jRgyP3" }, { token: "5c6c1bf0oDSIO4fZJbDBIDr3O4GYfHaxbLrqxwK3" }, { token: "5c6c1d96AmKBg2ohUrBHJiwwZ2exjRoHQEn3p5w2" }, { token: "5c6c1f4dIh6h15FzogJocK8keUsf0DNQIPIRy6g2" }, { token: "5c6c21204qrUjJyOV6XMhSTR2vXnoeMxNEm9oCm3" }, { token: "5c6c2312qVcnXxr3C1zQDFV7fxugw4EsYHc8BjN3" }, { token: "5c6c2533F8ayiQmw2AUA4dckyBiHUn2qG3umYna3" }, { token: "5c6c276eOQYFTvb8JMyPLML9WU0RXHy9jYOso2Q3" }, { token: "5c6c297eg75wFtZWDy3qUE03NoMLTOeqYM51laL3" }, { token: "5c6c2be6SGIixLpYVln6E4DxL43qYqmqg9Gc0KL3" }, { token: "5c6c2ed4bnkmG5YwqIY4EpeuuGvOlWnXON1qTZB2" }, { token: "5c6c3249mAqSFFOAL1xgWcP84OVprnft5y5q6eU3" }, { token: "5c6c3667Tv3A2s6S2ilpu3YMWfDnSigElvBUCGT2" }, { token: "5c6c3b81I6UNFvkI3WCe0fTjqOLT1kKrM2StZ7J3" }, { token: "5c6c423dy9M8FPGSUMMWXUHFW2pQKX1Eiz5kAW13" }, { token: "5c6c4b6aMdrhkBU1Ivfc7Sd6dP07VBSMTs8yPSQ3" }, { token: "5c6c57d0n4GaOwYvzkJYKLCHMoyq3LAAlXECKct3" }, { token: "5c6c67d327vbJjnNKqbpHNGi8ArxZv419VnN1Sd2" }, { token: "5c6c7908ubizbPIiBvxFYlPtdhIZTKSgHIh6oYU3" }, { token: "5c6c835daGjks1dycAXBZn7pO38g7sMiWaqD3F63" }, { token: "5c6c89639O9RLGlnLDqMqGDHYE0ODktKhnrxSJq3" }, { token: "5c6c8da1Megjlf2w5vw2b0IHYYYkKpoNBRSuxoK3" }, { token: "5c6c914b9qhq0R0fcy5iZCKwepnyW3pR6ADLk2m3" }, { token: "5c6c9472SYf8PmtRsb3JoHifbZNSSRg2c7bdhHf3" }, { token: "5c6c9766pvXJJp7YNqLyz7aJZOdxmdAa5CLsEpG3" }, { token: "5c6c9a37rnjarQR6l0WyrZKCWevU1mJSS4uiXce3" }, { token: "5c6c9cd5z9GkKmFgxpixPfeLYnELudHO5LBDL4T2" }, { token: "5c6c9f5fTvTpx7cOptZf7iTYSS6ZmNXKZ5YWniF3" }, { token: "5c6ca1c5enM36ga8wUyeZqTwwtlvq5jGd6welKH3" }, { token: "5c6ca413wvw9OtORfbwLBBBkuYNqoEzYl6EIyPQ3" }, { token: "5c6ca658RBm795DZ7YRJghX9cCJSejZDUQZhlk32" }, { token: "5c6ca848WatvEDrOqwaEfUNSD4QYSbYtBOmJlee2" }, { token: "5c6caa4azxtCnbVnsC3sGvjADfVDsg1rvoeqCDp3" }, { token: "5c6cac5aiivuItD7TX5SzF1V9hkq5i4O7ucCZ083" }, { token: "5c6cae5at8GYNXz5wdzWslHeLpgv24mvalSz9lN3" }, { token: "5c6cb05bSQW05ZRSGOPql3CwhG3HjPULSOqlPYF3" }, { token: "5c6cb253hi3zVmtohwdnc1dH1QoZYAdpWxb54Xy2" }, { token: "5c6cb44aCpKcPk9dbS54TUHMVf4uaZmTtYPnTc23" }, { token: "5c6cb631CpqBppPIXoiaCCaTigNtN5LVWzSupkT3" }, { token: "5c6cb80fwDStrxgGKlFT78H6yvao7wYahWJv7NS2" }, { token: "5c6cb9f3R2obvoiRKkQZQdm1mmkcpS79m9BVmDR3" }, { token: "5c6cbbd3ACnLYaCwBBs4qLuNnk5fz74p5uAVBZ62" }, { token: "5c6cbda3tH1uNBhOAHVjWb16seJR87csKJuxPd32" }, { token: "5c6cbf73oCE79n1x3OGFItOKU6em26nHn0aXOVb3" }, { token: "5c6cc1438ZeT2ZbjLTD7kxgVQrURMQnobBanl7X3" }, { token: "5c6cc313B2l2Vx9AJtZxh12Lu8yXEEbsaRkfz9W3" }, { token: "5c6cc4eaBzvvdyYPJQ7hqou95abbzpt0e4XuESG3" }, { token: "5c6cc6b4yrCafnMjDJkpJviuT40YjKfW6JtEGnP3" }, { token: "5c6cc87d0PTl9gcWXs8Fj43RzC9Ql8BiCT5WMR42" }, { token: "5c6cca4bmdnrQp3mM4Vb2GbqXx4sjCFmcXhO2Cp3" }, { token: "5c6ccc18rQZrHOIvBmR2qwVhqCZu5FtIc4tVcOG3" }, { token: "5c6ccde8aDRhEY4Em20CAA6qBkSdCbanfS5n4JC3" }, { token: "5c6ccfb64oGIVFZgb6k4Q4watJnshVk2fq4TFT83" }, { token: "5c6cd17f9cDMR2PgtuEklGCXBr0i411p8DErlPr3" }, { token: "5c6cd3338ftdwMbIFOyn4TFcJ1lOOSEjtukIJu03" }, { token: "5c6cd4f69ogP1QFrLVhFxDtJ4QwGB7cHIRy8RDk3" }, { token: "5c6cd6b6hFc0pD1LTPfymORS5WRhC3uv8nDmber2" }, { token: "5c6cd864hA3Rtmb5QUi0W6Y9BMBh8E6Lipc78tQ3" }, { token: "5c6cda15XJ4xiAsY2PAs7wx5nDiei9LfkImgdMj2" }, { token: "5c6cdbc4Plwak4CedPxxPRwndEe5kvFenGSzr7F3" }, { token: "5c6cde72cvQMouAe4SNgu0pYwu4tH3VaXK3L61D3" } ] }
- duplicates
-
SERVER-39683 shard request to split a same chunk at the same time.
- Closed