[SERVER-19064] Unpredictable High CPU usage not related to load or iowait Created: 22/Jun/15  Updated: 25/Aug/15  Resolved: 25/Aug/15

Status: Closed
Project: Core Server
Component/s: Performance, WiredTiger
Affects Version/s: 3.0.2
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Mirko Bonadei [X] Assignee: Ramon Fernandez Marina
Resolution: Incomplete Votes: 4
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File CPU.png     PNG File RAM.png     PNG File iowait.png    
Issue Links:
Related
related to SERVER-19485 Cpu 100% when mongodb running with no... Closed
Operating System: ALL
Participants:

 Description   

Hi everyone, we are experiencing strange and unpredictable CPU peaks on our primary member of a 4 members replica set (one hidden). It doesn't seem to be related at canonical CPU problems like iowait nor to high traffic peaks.

The behaviour is: the MongoDB primary server CPU starts to increase a little... Then after a variable amount of time it reaches 100% and we are forced to perfomr a rs.stepDown(100) to restart the mongod process. After this everything comes back to normal until the next CPU peak which comes in the next 100-150 hours.

A good information is that during the peak, read are slow (from 500 to 900ms) but writes are super-slow (from 300 to 11000ms).

Here is a log of a slow insert:

2015-06-22T10:44:43.157+0200 I WRITE    [conn212353] insert recruiter.recruiter_monitoring query: { _id: ObjectId('5587caeffe4bcc137c8b4754'), waiting_time: 1, ended_at: new Date(1434962671047), tags: [ "generic" ] } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 2 } }, Database: { acquireCount: { w: 2 } }, Collection: { acquireCount: { w: 1 } }, oplog: { acquireCount: { w: 1 } } } 11846ms

I try to give as more informations as I can.

Machine:
EC2 instance m3.large 2 virtual CPUs [High Frequency Intel Xeon E5-2670 v2 (Ivy Bridge) Processors] - 7.5 GB RAM - EBS Magnetic Volumes for storage

Replica Set:
4 nodes, 1 is hidden. All nodes has the same hardware configuration.

Mongo version:
Mongo 3.0.2 with wiredTiger.

MongoStat in the minutes of the CPU peak (before the restart):

insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
     1    11      3      2       2   246|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   61k    75k  343 NameOfTheRS  PRI 10:41:37
     1     5      3      2       2   105|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   29k    43k  343 NameOfTheRS  PRI 10:41:38
    *0    12      1     *0       2   274|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   57k    70k  343 NameOfTheRS  PRI 10:41:39
    *0     1      1     *0       2   108|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   27k    34k  343 NameOfTheRS  PRI 10:41:40
     1   104     10      2      10   358|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  132k   396k  343 NameOfTheRS  PRI 10:41:41
     4    47     16     *0      15   138|0     0.1   79.9       0  7.0G 4.4G   0|0   1|0   87k   269k  343 NameOfTheRS  PRI 10:41:42
     3    31     16      6      19   343|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  148k   169k  343 NameOfTheRS  PRI 10:41:43
    *0     6     *0     *0       0    94|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   18k    41k  343 NameOfTheRS  PRI 10:41:44
    *0     6      1     *0       1   267|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   55k    61k  343 NameOfTheRS  PRI 10:41:45
    *0    34      1     *0       2   104|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   29k   192k  343 NameOfTheRS  PRI 10:41:46
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    *0    44      8     *0       7   376|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  109k   170k  343 NameOfTheRS  PRI 10:41:47
     4   130     25      2      20   200|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  160k   452k  343 NameOfTheRS  PRI 10:41:48
     4    92     25      7      27   398|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  200k   491k  343 NameOfTheRS  PRI 10:41:49
     1    35      5      2       3   112|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   45k   156k  343 NameOfTheRS  PRI 10:41:50
    *0     8     *0     *0       0   271|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   51k    77k  343 NameOfTheRS  PRI 10:41:51
    *0     5     *0     *0       0    80|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   16k    38k  343 NameOfTheRS  PRI 10:41:52
     1    16      3      2       3   275|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   66k   139k  343 NameOfTheRS  PRI 10:41:53
     1    *0      3      2       2    83|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   26k    27k  343 NameOfTheRS  PRI 10:41:54
    *0    16     *0     *0       0   237|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   52k    74k  343 NameOfTheRS  PRI 10:41:55
     1    59     10      2      10   130|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   77k   253k  343 NameOfTheRS  PRI 10:41:56
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    *0     5     *0     *0       0   261|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   49k   112k  343 NameOfTheRS  PRI 10:41:57
    *0    78      9     *0       7   135|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   72k   362k  343 NameOfTheRS  PRI 10:41:58
     1    43      1     *0       3   294|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   70k   261k  343 NameOfTheRS  PRI 10:41:59
     2    10     10      4       9   133|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   60k    56k  343 NameOfTheRS  PRI 10:42:00
    *0     5     *0     *0       0   240|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   48k    73k  343 NameOfTheRS  PRI 10:42:01
     1    13      1      2       3   110|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   29k    53k  343 NameOfTheRS  PRI 10:42:02
     3   112     22      6      18   371|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  157k   471k  343 NameOfTheRS  PRI 10:42:03
    12   239     91     21      80   516|0     0.1   80.0       0  7.0G 4.4G   1|8   2|0  449k     1m  343 NameOfTheRS  PRI 10:42:04
    13    72     37     18      38   457|0     0.1   80.0       1  7.0G 4.4G   0|0   1|0  235k   268k  343 NameOfTheRS  PRI 10:42:05
    *0    22     *0      1       0   105|0     0.0   80.0       0  7.0G 4.4G   0|1   1|0    3k    11k  344 NameOfTheRS  PRI 10:42:06
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    11   205     24     13       6   308|0     0.0   80.0       0  7.0G 4.4G   0|0   1|3  183k   705k  344 NameOfTheRS  PRI 10:42:07
    20   445     97     35      27   435|0     0.1   80.1       0  7.0G 4.4G   0|1   2|1  370k     2m  344 NameOfTheRS  PRI 10:42:08
    28   388    152     44      57   637|0     0.1   80.1       0  7.0G 4.4G  16|3   6|1  511k     3m  344 NameOfTheRS  PRI 10:42:09
    37   331    113     46      86   482|0     0.1   80.0       0  6.5G 4.4G   5|6  14|0  546k     3m  344 NameOfTheRS  PRI 10:42:10
    25   222     98     39      68   637|0     0.1   80.0       0  6.5G 4.4G  8|16   3|1  468k     2m  344 NameOfTheRS  PRI 10:42:11
    35   470    195     51      52   543|0     0.1   80.0       0  6.5G 4.4G   0|1   2|0  549k     3m  344 NameOfTheRS  PRI 10:42:12
    61   288    205     79      50   610|0     0.1   80.0       0  6.5G 4.4G   1|0   1|1  606k     3m  344 NameOfTheRS  PRI 10:42:13
    52   290    202     86     130   765|0     0.1   80.0       0  6.5G 4.4G   0|0   1|0  850k     2m  344 NameOfTheRS  PRI 10:42:14
    48   212    156     82     129   810|0     0.1   80.0       0  6.5G 4.4G   0|0   1|0  787k     1m  344 NameOfTheRS  PRI 10:42:15
    22   126     97     40      92   559|0     0.1   80.0       0  6.5G 4.4G   0|0   1|0  495k   753k  344 NameOfTheRS  PRI 10:42:16
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    31   158    115     50      66   630|0     0.1   79.9       0  6.5G 4.4G   0|0   2|0  479k     1m  345 NameOfTheRS  PRI 10:42:17
    24   156     91     46      84   501|0     0.1   79.9       0  6.5G 4.4G   0|0   1|0  496k   862k  345 NameOfTheRS  PRI 10:42:18
     1    53     11      2      11   314|0     0.1   80.0       0  6.5G 4.4G   0|0   1|0  110k   483k  345 NameOfTheRS  PRI 10:42:19
     2    37      7     *0       6   124|0     0.1   80.0       0  6.5G 4.4G   0|0   1|0   56k   198k  345 NameOfTheRS  PRI 10:42:20
     2    20      8      4      11   313|0     0.1   80.0       0  6.5G 4.4G   0|0   1|0  100k   166k  345 NameOfTheRS  PRI 10:42:21
     5    42      6      2      10   143|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   68k   687k  345 NameOfTheRS  PRI 10:42:22
    *0    45      5     *0       5   275|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   80k   207k  345 NameOfTheRS  PRI 10:42:23
     2   138     20      4      27   222|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  168k   976k  345 NameOfTheRS  PRI 10:42:24
     3   103     16      2      14   312|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  143k   461k  345 NameOfTheRS  PRI 10:42:25
     6   110     48     10      42   318|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  239k   574k  345 NameOfTheRS  PRI 10:42:26
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
     4     8     12      8      14   311|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  111k    81k  345 NameOfTheRS  PRI 10:42:27
    *0   105      8     *0       7   147|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   94k   328k  345 NameOfTheRS  PRI 10:42:28
    *0    38      2     *0       3   286|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   70k   222k  345 NameOfTheRS  PRI 10:42:29
     2    44     20     *0      19   184|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  100k   566k  345 NameOfTheRS  PRI 10:42:30
     3    61     16      7      19   312|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  152k   317k  345 NameOfTheRS  PRI 10:42:31
    *0    26      1     *0       3   126|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   38k   140k  345 NameOfTheRS  PRI 10:42:32
    *0    *0     *0     *0       0   250|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   46k    42k  345 NameOfTheRS  PRI 10:42:33
     1    35      4     *0       4   135|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   44k   481k  345 NameOfTheRS  PRI 10:42:34
    *0    32      2     *0       2   265|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   62k   163k  345 NameOfTheRS  PRI 10:42:35
     3    34     13      6      16   173|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   98k   140k  345 NameOfTheRS  PRI 10:42:36
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    *0     5      2     *0       2   250|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   60k    78k  345 NameOfTheRS  PRI 10:42:37
     6    75     26      6      28   246|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  173k   312k  345 NameOfTheRS  PRI 10:42:38
     1    33      3      2       3   269|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   66k   120k  345 NameOfTheRS  PRI 10:42:39
     2     1      6      2       5   130|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   48k    41k  345 NameOfTheRS  PRI 10:42:40
    *0     4      1     *0       1   267|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   55k    72k  345 NameOfTheRS  PRI 10:42:41
     2    19      2     *0       3   119|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   39k   212k  345 NameOfTheRS  PRI 10:42:42
    *0    41      3     *0       2   241|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   74k   163k  345 NameOfTheRS  PRI 10:42:43
    *0    *0     *0     *0       0   102|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   19k    27k  345 NameOfTheRS  PRI 10:42:44
     1    14      3      2       5   285|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   72k   208k  345 NameOfTheRS  PRI 10:42:45
     1    66     10      2      12   178|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   99k   255k  345 NameOfTheRS  PRI 10:42:46
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
     5    97     22      2      19   399|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  178k   604k  345 NameOfTheRS  PRI 10:42:47
     3   116     28      5      24   221|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  179k   562k  345 NameOfTheRS  PRI 10:42:48
     2    56     11      2      13   296|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  120k   276k  345 NameOfTheRS  PRI 10:42:49
     1    14      4      2       3   129|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   42k    61k  345 NameOfTheRS  PRI 10:42:50
    *0     1      1     *0       1   270|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   55k    72k  345 NameOfTheRS  PRI 10:42:51
     3    17      5      2       6   127|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   56k   138k  345 NameOfTheRS  PRI 10:42:52
     1    *0      3      2       3   261|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   65k    59k  345 NameOfTheRS  PRI 10:42:53
     1    30      6      2       7   143|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   59k   163k  345 NameOfTheRS  PRI 10:42:54
     2    26     10      2       7   245|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   84k   137k  345 NameOfTheRS  PRI 10:42:55
     4    56     15      6      20   187|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  117k   532k  346 NameOfTheRS  PRI 10:42:56
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
     2    22     16      4      16   315|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  114k   129k  346 NameOfTheRS  PRI 10:42:57
     1    98     14      3      13   199|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  111k   322k  346 NameOfTheRS  PRI 10:42:58
     1    40      7     *0       8   266|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   80k   555k  346 NameOfTheRS  PRI 10:42:59
     2    28      9      4       8   163|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   68k    79k  346 NameOfTheRS  PRI 10:43:00
     2     3      7      6      10   266|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   83k    76k  346 NameOfTheRS  PRI 10:43:01
     1    32      6      2       8   153|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0   60k    95k  346 NameOfTheRS  PRI 10:43:02
     4   125     30      4      25   358|0     0.1   80.0       0  7.0G 4.4G   0|1   1|0  185k   804k  346 NameOfTheRS  PRI 10:43:03
     7     6     24     14      27   225|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  149k    90k  346 NameOfTheRS  PRI 10:43:04
     8    29     30     16      30   339|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  177k   304k  346 NameOfTheRS  PRI 10:43:05
    12    20     38     24      25   241|0     0.1   80.0       0  7.0G 4.4G   0|0   1|0  163k   154k  346 NameOfTheRS  PRI 10:43:06
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
     1     5     *0      1       0   225|0     0.1   80.0       1  7.0G 4.4G   0|1   1|1    9k    48k  346 NameOfTheRS  PRI 10:43:07
    *0    *0     *0     *0       0   111|0     0.0   80.0       0  7.0G 4.4G   0|1   1|1    2k     8k  346 NameOfTheRS  PRI 10:43:08
     1     2      7      3       0   299|0     0.0   80.0       0  7.0G 4.4G   0|0   1|1  101k    83k  346 NameOfTheRS  PRI 10:43:10
    13   129     42     16      44   272|0     0.0   80.0       0  7.0G 4.4G   0|0   1|0  258k     1m  346 NameOfTheRS  PRI 10:43:11
    14   246     78     14      59   596|0     0.1   80.0       0  7.0G 4.4G   0|1   1|0  398k     3m  346 NameOfTheRS  PRI 10:43:12
    17   340     87     20      90   478|0     0.1   80.0       0  7.0G 4.4G   3|4   3|0  470k     3m  346 NameOfTheRS  PRI 10:43:13
    18   351    111     15      80   594|0     0.1   80.0       0  7.0G 4.4G   0|0   3|4  447k     3m  346 NameOfTheRS  PRI 10:43:14
    30   340    176     49     133   607|0     0.1   80.0       0  7.0G 4.4G   0|0   2|0  611k     3m  346 NameOfTheRS  PRI 10:43:15
    25   414    133     45      91   644|0     0.1   80.0       0  7.0G 4.4G   2|2   2|1  524k     3m  346 NameOfTheRS  PRI 10:43:16
    25   385    115     46      54   476|0     0.1   80.0       0  7.0G 4.4G 47|14   1|2  437k     2m  346 NameOfTheRS  PRI 10:43:17
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    18   255     87     26      19   509|0     0.0   80.0       0  7.0G 4.4G   0|1   5|1  281k     1m  347 NameOfTheRS  PRI 10:43:18
    25   392    133     42      26   430|0     0.1   80.2       0  7.0G 4.4G   4|4   2|1  391k     2m  347 NameOfTheRS  PRI 10:43:19
    33   395    166     53      38   572|0     0.1   80.0       0  7.0G 4.4G 25|16   2|5  501k     3m  347 NameOfTheRS  PRI 10:43:20
    33   308    114     35      20   347|0     0.1   80.1       0  7.0G 4.4G 24|11  1|12  335k     2m  350 NameOfTheRS  PRI 10:43:21
    25   249    105     42      17   453|0     0.1   80.0       0  7.0G 4.4G   0|0   1|8  308k     2m  349 NameOfTheRS  PRI 10:43:22
    23   209     98     40       8   301|0     0.1   80.0       0  7.0G 4.4G 34|31  2|11  287k   695k  349 NameOfTheRS  PRI 10:43:23
    33   301    165     71      15   521|0     0.1   80.0       0  7.0G 4.5G   4|6   5|6  399k     2m  349 NameOfTheRS  PRI 10:43:24
    31   378    153     47      28   452|0     0.1   80.1       0  7.0G 4.5G  8|13   5|4  429k     2m  350 NameOfTheRS  PRI 10:43:25
    27   448    142     41      45   527|0     0.1   80.0       0  7.0G 4.5G 50|11   1|1  439k     3m  351 NameOfTheRS  PRI 10:43:26
    30   369    138     49      21   458|0     0.1   79.9       0  7.0G 4.5G  17|7   5|2  409k     2m  351 NameOfTheRS  PRI 10:43:27
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    40   257    139     58      20   458|0     0.1   80.0       0  7.0G 4.5G 75|37  1|16  384k     2m  351 NameOfTheRS  PRI 10:43:28
    34   273    148     65      19   402|0     0.1   80.0       0  7.0G 4.5G 24|16   3|2  387k     2m  353 NameOfTheRS  PRI 10:43:29
    35   448    184     49      25   581|0     0.1   80.0       0  7.0G 4.5G  5|25   2|2  485k     2m  353 NameOfTheRS  PRI 10:43:30
    35   318    139     60      36   439|0     0.1   80.0       0  7.0G 4.5G 55|27   1|6  413k     3m  353 NameOfTheRS  PRI 10:43:31
    41   403    185     75      67   675|0     0.2   80.0       0  7.0G 4.5G 22|14   1|1  635k     3m  355 NameOfTheRS  PRI 10:43:32
    43   437    192     67      40   538|0     0.1   80.0       0  7.0G 4.5G 28|14   2|1  542k     3m  358 NameOfTheRS  PRI 10:43:33
    39   406    146     54      21   500|0     0.2   80.0       0  7.0G 4.5G  2|15  3|14  408k     2m  360 NameOfTheRS  PRI 10:43:34
    27   242    126     56      17   361|0     0.2   80.0       0  7.0G 4.5G 16|15   1|6  337k   983k  361 NameOfTheRS  PRI 10:43:35
    27   271    122     38      13   400|0     0.2   80.0       0  7.0G 4.5G   3|1  2|13  321k     1m  361 NameOfTheRS  PRI 10:43:36
    25   251    142     62      16   357|0     0.2   80.0       0  7.0G 4.5G   3|1   1|0  351k     2m  361 NameOfTheRS  PRI 10:43:37
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    27   377    156     41      38   537|0     0.2   80.0       0  7.0G 4.5G  5|20   1|1  416k     3m  361 NameOfTheRS  PRI 10:43:38
    44   511    194     54      44   557|0     0.2   80.0       0  7.0G 4.5G  17|7   1|6  564k     4m  362 NameOfTheRS  PRI 10:43:39
    40   514    163     66      32   571|0     0.2   80.0       0  7.0G 4.5G   7|6   1|3  538k     3m  364 NameOfTheRS  PRI 10:43:40
    34   360    178     60      26   520|0     0.2   80.0       0  7.0G 4.5G   0|1   1|4  457k     2m  364 NameOfTheRS  PRI 10:43:41
    39   413    219     67      67   659|0     0.2   80.0       0  7.0G 4.5G 10|18   2|1  611k     5m  365 NameOfTheRS  PRI 10:43:42
    37   431    183     47      42   589|0     0.2   80.0       0  7.0G 4.5G   6|7   1|1  500k     3m  366 NameOfTheRS  PRI 10:43:43
    28   488    162     44      44   580|0     0.2   80.0       0  7.0G 4.5G 26|16   2|0  513k     3m  366 NameOfTheRS  PRI 10:43:44
    35   501    207     58      60   643|0     0.2   80.0       0  7.0G 4.5G   6|8   3|1  608k     3m  367 NameOfTheRS  PRI 10:43:45
    52   381    234     88      33   599|0     0.2   80.0       0  7.0G 4.5G   0|2   1|3  559k     4m  368 NameOfTheRS  PRI 10:43:46
    36   309    171     61      18   495|0     0.2   80.0       0  7.0G 4.5G 27|17   1|2  392k     3m  368 NameOfTheRS  PRI 10:43:47
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    31   279    128     48      22   382|0     0.2   80.0       0  7.0G 4.5G 32|23   1|0  313k     2m  369 NameOfTheRS  PRI 10:43:48
    27   373    150     51      14   464|0     0.2   80.0       0  7.0G 4.5G   7|5   1|2  357k     2m  368 NameOfTheRS  PRI 10:43:49
    28   447    174     45      41   529|0     0.1   80.0       0  7.0G 4.5G  7|10   3|2  444k     3m  369 NameOfTheRS  PRI 10:43:50
    30   370    164     50      25   465|0     0.2   80.0       0  7.0G 4.5G   1|1   2|6  421k     3m  368 NameOfTheRS  PRI 10:43:51
    50   394    228     89      62   622|0     0.2   79.9       0  7.0G 4.5G 45|16   1|7  655k     4m  368 NameOfTheRS  PRI 10:43:52
    42   281    139     54      25   399|0     0.2   80.0       0  7.0G 4.5G 65|25  1|16  399k     2m  369 NameOfTheRS  PRI 10:43:53
    18   282     96     35      11   372|0     0.2   79.9       0  7.0G 4.5G   2|1   1|5  273k     2m  368 NameOfTheRS  PRI 10:43:54
    22   388    159     49      19   480|0     0.2   80.0       0  7.0G 4.5G   0|1   1|5  426k     2m  368 NameOfTheRS  PRI 10:43:55
    36   368    178     73      23   470|0     0.2   80.0       0  7.0G 4.5G 49|17   1|0  446k     2m  369 NameOfTheRS  PRI 10:43:56
    32   376    183     49      32   549|0     0.2   80.0       0  7.0G 4.5G  10|7   7|3  479k     2m  369 NameOfTheRS  PRI 10:43:57
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    26   458    153     46      56   541|0     0.2   80.0       0  7.0G 4.5G  9|14   1|0  499k     4m  368 NameOfTheRS  PRI 10:43:58
    40   469    188     59      23   538|0     0.2   80.0       0  7.0G 4.5G   0|0   2|7  511k     3m  369 NameOfTheRS  PRI 10:43:59
    41   360    170     65      18   458|0     0.2   79.9       0  7.0G 4.5G 42|35   3|5  436k     2m  369 NameOfTheRS  PRI 10:44:00
    18   332     97     31      18   405|0     0.2   80.0       0  7.0G 4.5G   0|0   2|2  334k     2m  370 NameOfTheRS  PRI 10:44:01
    38   408    185     70      86   676|0     0.2   80.0       0  7.0G 4.5G 34|12   2|0  676k     3m  370 NameOfTheRS  PRI 10:44:02
    30   460    190     46      43   586|0     0.2   80.0       0  7.0G 4.5G   0|1   1|3  490k     3m  370 NameOfTheRS  PRI 10:44:03
    27   382    140     43      25   470|0     0.2   80.0       0  7.0G 4.5G 45|20   2|1  401k     3m  371 NameOfTheRS  PRI 10:44:04
    40   447    216     63      43   621|0     0.2   80.0       0  7.0G 4.5G  1|16   4|1  550k     3m  371 NameOfTheRS  PRI 10:44:05
    38   364    189     65      26   504|0     0.2   80.0       0  7.0G 4.5G 11|22  3|12  440k     3m  371 NameOfTheRS  PRI 10:44:06
    25   296    160     44      22   502|0     0.2   80.0       0  7.0G 4.5G 16|41   2|6  366k     2m  371 NameOfTheRS  PRI 10:44:07
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    36   380    193     65      28   471|0     0.2   79.9       0  7.0G 4.5G 65|27   1|5  442k     3m  371 NameOfTheRS  PRI 10:44:08
    42   272    172     76      24   478|0     0.2   80.0       0  7.0G 4.5G 68|42   1|5  406k     2m  371 NameOfTheRS  PRI 10:44:09
    29   399    146     41      16   478|0     0.2   80.0       1  7.0G 4.5G 89|17   1|5  360k     2m  370 NameOfTheRS  PRI 10:44:10
     4    82     22      6       7   186|0     0.2   80.0       0  7.0G 4.5G 67|21   6|4   82k   544k  371 NameOfTheRS  PRI 10:44:11
    *0     2     *0     *0       0   123|0     0.1   80.0       0  7.0G 4.5G 71|21   6|4    3k     9k  371 NameOfTheRS  PRI 10:44:12
     2     8      7     *0       0    92|0     0.1   80.0       0  7.0G 4.5G 97|33   6|6   30k    78k  371 NameOfTheRS  PRI 10:44:13
    27   259    118     38      12   500|0     0.2   80.0       0  7.0G 4.5G 15|11  1|13  346k     2m  370 NameOfTheRS  PRI 10:44:14
    36   306    147     58      16   331|0     0.2   80.0       0  7.0G 4.5G 32|23  6|17  351k     2m  370 NameOfTheRS  PRI 10:44:15
    25   219    136     55      13   505|0     0.2   80.0       0  7.0G 4.5G 72|54   2|8  357k     2m  370 NameOfTheRS  PRI 10:44:16
    18   264     87     26      11   310|0     0.2   80.0       0  7.0G 4.5G 22|19   1|9  236k     1m  371 NameOfTheRS  PRI 10:44:17
insert query update delete getmore command % dirty % used flushes vsize  res qr|qw ar|aw netIn netOut conn      set repl     time
    26   231    128     37      11   396|0     0.2   80.0       0  7.0G 4.5G 77|58  1|18  325k     2m  371 NameOfTheRS  PRI 10:44:18
    30   229    112     48      14   291|0     0.3   80.0       0  7.0G 4.5G 33|23 11|35  274k     2m  371 NameOfTheRS  PRI 10:44:19
    19   194     95     25      21   400|0     0.3   80.0       0  7.0G 4.5G 101|43  1|41  273k     2m  373 NameOfTheRS  PRI 10:44:20
    14   178     61     20       7   273|0     0.3   80.0       0  7.0G 4.5G    0|1  2|41  180k   903k  373 NameOfTheRS  PRI 10:44:21
    15   147     76     19      10   317|0     0.3   80.0       0  7.0G 4.5G  72|38  1|41  203k   966k  373 NameOfTheRS  PRI 10:44:22
     7   164     53     24       6   187|0     0.3   80.0       0  7.0G 4.5G   55|9  1|31  151k   719k  373 NameOfTheRS  PRI 10:44:23
    13   128     54     23      10   314|0     0.3   80.0       0  7.0G 4.5G  51|27  4|36  175k     1m  373 NameOfTheRS  PRI 10:44:24
    13   131     56     23      12   236|0     0.3   80.0       0  7.0G 4.5G   3|21  3|34  186k     1m  373 NameOfTheRS  PRI 10:44:25
    10   104     58     16      11   286|0     0.3   80.0       0  7.0G 4.5G  26|19  1|32  156k     1m  373 NameOfTheRS  PRI 10:44:26
    20    74     71     29       5   177|0     0.4   80.0       0  7.0G 4.5G   5|29  1|41  174k   770k  373 NameOfTheRS  PRI 10:44:27
insert query update delete getmore command % dirty % used flushes vsize  res  qr|qw ar|aw netIn netOut conn      set repl     time
    16   100     38     15       8   289|0     0.4   80.0       0  7.0G 4.5G    1|1  2|48  154k   595k  373 NameOfTheRS  PRI 10:44:28
    10   140     50     18       4   204|0     0.4   80.0       0  7.0G 4.5G    0|1  2|48  147k   443k  373 NameOfTheRS  PRI 10:44:29
    10   115     37      9       5   221|0     0.4   80.0       0  7.0G 4.5G    0|1  1|51  129k   541k  373 NameOfTheRS  PRI 10:44:30
    11   117     39     15       6   181|0     0.4   80.0       0  7.0G 4.5G  87|46  1|53  136k   832k  373 NameOfTheRS  PRI 10:44:31
     4    76     32     16       5   284|0     0.4   80.0       0  7.0G 4.5G  59|40  1|46  109k   489k  373 NameOfTheRS  PRI 10:44:32
     3   113     50     15       5   220|0     0.4   80.0       0  7.0G 4.5G  58|37  1|43  134k   568k  373 NameOfTheRS  PRI 10:44:33
     8    81     46     11       4   280|0     0.4   80.0       0  7.0G 4.5G    5|3  2|44  118k   494k  373 NameOfTheRS  PRI 10:44:34
    11    98     72     24       3   175|0     0.4   80.0       0  7.0G 4.5G    0|1  1|48  149k   497k  373 NameOfTheRS  PRI 10:44:35
    16    93     38     13       5   222|0     0.4   80.0       0  7.0G 4.5G   29|9  1|59  127k   435k  373 NameOfTheRS  PRI 10:44:36
     7    78     37     17       6   143|0     0.4   80.0       0  7.0G 4.5G  76|27  1|55  113k   484k  373 NameOfTheRS  PRI 10:44:37
insert query update delete getmore command % dirty % used flushes vsize  res  qr|qw ar|aw netIn netOut conn      set repl     time
     6   100     19     11       6   234|0     0.4   80.0       0  7.0G 4.5G  84|13  1|53  101k   764k  373 NameOfTheRS  PRI 10:44:38
     5    90     34     12       5   164|0     0.5   80.0       0  7.0G 4.5G  72|49  1|50  102k   497k  373 NameOfTheRS  PRI 10:44:39
     5    48     38     13       6   273|0     0.5   80.0       0  7.0G 4.5G  64|52  2|46  134k   350k  373 NameOfTheRS  PRI 10:44:40
     4    62     27      5       8   180|0     0.5   79.9       0  7.0G 4.5G   9|25 14|44   95k   772k  373 NameOfTheRS  PRI 10:44:41
     3    56     26      7       7   231|0     0.5   80.0       0  7.0G 4.5G  70|41  1|43   88k   310k  373 NameOfTheRS  PRI 10:44:42
     4    75     32      7       7   167|0     0.5   80.0       0  7.0G 4.5G  26|16  4|43  108k   936k  373 NameOfTheRS  PRI 10:44:43
     6    67     30      7       4   252|0     0.5   80.0       0  7.0G 4.5G  25|27  1|44   85k   422k  373 NameOfTheRS  PRI 10:44:44
     7    89     28      9       7   155|0     0.5   80.0       0  7.0G 4.5G  55|44  1|43  113k   699k  373 NameOfTheRS  PRI 10:44:45
     8    74     22      5       9   265|0     0.5   79.9       0  7.0G 4.5G  85|35  1|45  115k   364k  373 NameOfTheRS  PRI 10:44:46
     1    79      9      5       4   136|0     0.5   80.0       0  7.0G 4.5G  17|16  4|43   69k   461k  373 NameOfTheRS  PRI 10:44:47
insert query update delete getmore command % dirty % used flushes vsize  res  qr|qw ar|aw netIn netOut conn      set repl     time
     2    81     13      4       5   232|0     0.5   80.0       0  7.0G 4.5G  22|15  1|41   76k   464k  373 NameOfTheRS  PRI 10:44:48
     2    81     19      4       4   157|0     0.5   80.0       0  7.0G 4.5G  59|20  1|39   71k   567k  373 NameOfTheRS  PRI 10:44:49
     1    78     22      2       5   240|0     0.5   80.0       0  7.0G 4.5G  48|17  1|37   81k   566k  374 NameOfTheRS  PRI 10:44:50
     9   103     28     15       5   306|0     0.5   80.0       0  7.0G 4.5G    0|1  1|38  139k   428k  374 NameOfTheRS  PRI 10:44:52
     2    68     15      3       4   181|0     0.5   80.0       0  7.0G 4.5G  45|27  1|36   63k   463k  374 NameOfTheRS  PRI 10:44:53
     2    64     16      6       3   194|0     0.5   80.0       0  7.0G 4.5G 121|43  1|32   79k   302k  374 NameOfTheRS  PRI 10:44:54
     3    59     21      5       6   182|0     0.5   80.0       0  7.0G 4.5G  12|41  1|35   87k   330k  375 NameOfTheRS  PRI 10:44:55
     4    55     15      6       1   182|0     0.5   80.0       0  7.0G 4.5G  33|21  1|36   62k   380k  375 NameOfTheRS  PRI 10:44:56
     2    49     14      4       3   190|0     0.5   80.0       0  7.0G 4.5G  52|51  3|35   68k   397k  375 NameOfTheRS  PRI 10:44:57
     4    62     11      8       4   180|0     0.5   80.0       0  7.0G 4.5G  23|23  3|37   68k   367k  375 NameOfTheRS  PRI 10:44:58
insert query update delete getmore command % dirty % used flushes vsize  res  qr|qw ar|aw netIn netOut conn      set repl     time
     3    52     15      7       6   199|0     0.5   80.0       0  7.0G 4.5G  23|39  1|35   68k   307k  376 NameOfTheRS  PRI 10:44:59
     4    64     18      4       3   177|0     0.5   80.0       0  7.0G 4.5G  61|35  2|33   67k   276k  376 NameOfTheRS  PRI 10:45:00
     3    52     16      5       1   191|0     0.5   80.0       0  7.0G 4.5G  85|47  3|34   59k   551k  377 NameOfTheRS  PRI 10:45:01
     2    36     14      4       4   206|0     0.5   80.0       0  7.0G 4.5G  33|17  1|33   76k   416k  380 NameOfTheRS  PRI 10:45:02
     2    46     10      6       1   176|0     0.5   80.0       0  7.0G 4.5G 127|45  1|33   49k   146k  382 NameOfTheRS  PRI 10:45:03
     4    45     21      4       1   159|0     0.6   80.0       0  7.0G 4.5G 117|63  3|33   55k   285k  382 NameOfTheRS  PRI 10:45:04
     3    20     18      6       3   200|0     0.5   80.0       0  7.0G 4.5G 168|73  2|32   92k   170k  385 NameOfTheRS  PRI 10:45:05
     2    52     16      6       1   191|0     0.6   80.0       0  7.0G 4.5G 102|62  2|33   48k   210k  386 NameOfTheRS  PRI 10:45:06
     3    48     15      7       1   176|0     0.6   80.0       0  7.0G 4.5G 111|47  2|33   57k   230k  386 NameOfTheRS  PRI 10:45:07
     4    37     15      5       2   157|0     0.7   80.0       0  7.0G 4.5G  39|34  1|35   58k   198k  386 NameOfTheRS  PRI 10:45:08
insert query update delete getmore command % dirty % used flushes vsize  res  qr|qw ar|aw netIn netOut conn      set repl     time
     3    55     18      3       1   161|0     0.8   80.0       0  7.0G 4.5G   13|7  1|36   57k   942k  386 NameOfTheRS  PRI 10:45:09
     5    66     25      6       3   182|0     0.8   80.0       0  7.0G 4.5G    0|1  1|39   77k   269k  388 NameOfTheRS  PRI 10:45:10
     1    42     12      3       0   128|0     0.8   80.0       0  7.0G 4.5G  19|17  1|36   49k   166k  389 NameOfTheRS  PRI 10:45:11
     3    53     26      9       1   173|0     0.8   80.0       0  7.0G 4.5G 129|63  1|34   84k   224k  388 NameOfTheRS  PRI 10:45:12
     5    44     28     14       2   179|0     0.8   80.0       0  7.0G 4.5G  38|41  2|34   76k   245k  389 NameOfTheRS  PRI 10:45:13
     5    35     22      7       3   187|0     0.8   80.0       1  7.0G 4.5G  71|41  1|37   65k   171k  391 NameOfTheRS  PRI 10:45:14
     6    30     14      2       0   191|0     0.7   80.0       0  7.0G 4.5G  33|63  1|42   43k   613k  391 NameOfTheRS  PRI 10:45:16
    12    66     27     14       4   299|0     0.7   80.0       0  7.0G 4.5G  79|35  1|49  120k   351k  394 NameOfTheRS  PRI 10:45:18
     8    55     21      7       1   215|0     0.7   80.0       0  7.0G 4.5G  85|69  1|53   79k   251k  394 NameOfTheRS  PRI 10:45:19
     7    32     24     15       6   172|0     0.8   80.0       0  7.0G 4.5G    9|3  1|52   89k   181k  394 NameOfTheRS  PRI 10:45:20
insert query update delete getmore command % dirty % used flushes vsize  res  qr|qw ar|aw netIn netOut conn      set repl     time
     7    51     20      4       1   157|0     0.8   79.9       0  7.0G 4.5G 119|33  1|57   61k   116k  396 NameOfTheRS  PRI 10:45:21
     4    61     19      3       0   145|0     0.8   80.0       0  7.0G 4.5G 105|50  2|60   64k   389k  396 NameOfTheRS  PRI 10:45:22
     8    45      7      7       2   151|0     0.8   80.0       0  7.0G 4.5G  53|29  2|63   68k   285k  396 NameOfTheRS  PRI 10:45:23
     4    92     19     11       1   240|0     0.8   80.0       0  7.0G 4.5G 180|55  3|63   76k   402k  397 NameOfTheRS  PRI 10:45:25
     5    33     21      6       2   147|0     0.8   80.0       0  7.0G 4.5G  70|57  6|63   56k   198k  398 NameOfTheRS  PRI 10:45:26
     2    64     13      6       2   163|0     0.8   80.0       0  7.0G 4.5G  59|41  1|61   54k   172k  399 NameOfTheRS  PRI 10:45:27
     2    57     13      7       3   176|0     0.8   80.0       0  7.0G 4.5G  28|39  1|59   46k   223k  402 NameOfTheRS  PRI 10:45:28
 
     7   104     41      6       3   292|0     0.8   79.9       0  7.0G 4.5G  89|63  1|59  110k   542k  404 NameOfTheRS  PRI 10:45:30
     4    61     19      7       0   164|0     0.8   80.0       0  7.0G 4.5G  21|15  1|60   65k   288k  406 NameOfTheRS  PRI 10:45:31
     8   116     35      9       2   304|0     0.7   80.0       0  7.1G 4.5G 119|37  1|60  127k   431k  410 NameOfTheRS  PRI 10:45:32
insert query update delete getmore command % dirty % used flushes vsize  res  qr|qw ar|aw netIn netOut conn      set repl     time
     7    44     14     13       2   156|0     0.7   80.0       0  7.1G 4.5G  31|59  1|64   70k   489k  412 NameOfTheRS  PRI 10:45:34
     5    78     17      5       2   161|0     0.7   80.0       0  7.1G 4.5G   15|7  1|68   67k   196k  413 NameOfTheRS  PRI 10:45:35
     6    75     22      8       2   176|0     0.7   80.0       0  7.1G 4.5G  46|37  4|73   65k   563k  413 NameOfTheRS  PRI 10:45:36
     7    52     17      1       1   155|0     0.8   80.0       0  7.1G 4.5G  66|53 17|76   59k   197k  413 NameOfTheRS  PRI 10:45:37
    10    54     15      4       1   140|0     0.8   80.0       0  7.1G 4.5G 175|69  1|81   63k   217k  414 NameOfTheRS  PRI 10:45:38
     1    36     11      5       2   151|0     0.8   80.0       0  7.1G 4.5G  38|21  1|80   50k   227k  414 NameOfTheRS  PRI 10:45:39
     2    76     17      3       3   172|0     0.8   80.0       0  7.1G 4.5G 201|61  1|80   73k   299k  416 NameOfTheRS  PRI 10:45:40
     3    53     18      6       1   150|0     0.8   80.0       0  7.1G 4.5G 109|43 12|82   54k   771k  419 NameOfTheRS  PRI 10:45:41
     4    40     26      7       1   162|0     0.8   80.0       0  7.1G 4.5G 194|79 12|82   66k   212k  419 NameOfTheRS  PRI 10:45:42
     4    55     14      4       2   135|0     0.8   79.9       0  7.1G 4.5G 125|89  3|82   67k   327k  420 NameOfTheRS  PRI 10:45:43
insert query update delete getmore command % dirty % used flushes vsize  res  qr|qw ar|aw netIn netOut conn      set repl     time
     2    46     13      4       4   170|0     0.8   80.0       0  7.1G 4.5G  48|61  4|84   53k   267k  422 NameOfTheRS  PRI 10:45:44
     3    64     16      1       3   153|0     0.8   80.0       0  7.1G 4.5G 146|111  7|86   61k   173k  422 NameOfTheRS  PRI 10:45:45
     2    60     12      3       1   201|0     0.8   80.0       0  7.1G 4.5G   88|75  1|82   66k   247k  423 NameOfTheRS  PRI 10:45:46
     2    51     12      4       2   155|0     0.8   80.0       0  7.1G 4.5G 195|121  1|81   63k   257k  423 NameOfTheRS  PRI 10:45:47
    *0    49      7      2       0   160|0     0.8   80.0       0  7.1G 4.5G   68|33 10|79   39k   211k  424 NameOfTheRS  PRI 10:45:48
    *0    46     13      4       1   144|0     0.8   80.0       0  7.1G 4.5G   73|59  1|78   43k   199k  424 NameOfTheRS  PRI 10:45:49
     1    62     12      6       3   166|0     0.8   80.0       0  7.1G 4.5G  108|67  1|76   58k   313k  426 NameOfTheRS  PRI 10:45:50
     3    67     16      6       1   176|0     0.9   80.0       0  7.1G 4.5G 249|103  1|74   74k   218k  428 NameOfTheRS  PRI 10:45:51
    *0    57      9      5       2   166|0     0.9   80.0       0  7.1G 4.5G  138|67  2|72   56k   910k  427 NameOfTheRS  PRI 10:45:52
     7    58     12      3       1   162|0     0.9   80.0       0  7.1G 4.5G   67|43  3|75   63k   126k  427 NameOfTheRS  PRI 10:45:53
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw ar|aw netIn netOut conn      set repl     time
    *0    46      6      3       1   104|0     0.9   80.0       0  7.1G 4.5G   85|69  7|73   36k   219k  427 NameOfTheRS  PRI 10:45:54
     2    62     19      4       4   187|0     0.9   80.0       0  7.1G 4.5G   22|49  3|73   53k   267k  431 NameOfTheRS  PRI 10:45:55
     2    31      9      2       1   142|0     0.9   80.0       0  7.1G 4.5G   93|59  1|75   44k   125k  433 NameOfTheRS  PRI 10:45:56
     4    99     18      3       5   318|0     0.9   79.9       0  7.1G 4.5G   79|93  1|73  110k   334k  440 NameOfTheRS  PRI 10:45:58
    *0   108     23      7       3   280|0     0.9   80.0       0  7.1G 4.5G  181|83  1|68   86k   326k  442 NameOfTheRS  PRI 10:46:01
     2    89     18      5       2   299|0     0.9   80.0       0  7.1G 4.5G   56|45  2|68   91k   445k  445 NameOfTheRS  PRI 10:46:03
     2    35      6      2       0   126|0     0.9   79.9       0  7.1G 4.5G  137|65  1|69   30k   119k  445 NameOfTheRS  PRI 10:46:04
     3    78     12      2       2   207|0     0.9   80.0       0  7.1G 4.5G  177|93  1|68   65k   603k  446 NameOfTheRS  PRI 10:46:05
     4    68     26      4       1   262|0     0.9   80.0       0  7.1G 4.5G 184|119  3|67   90k   474k  449 NameOfTheRS  PRI 10:46:07
     5    34     21      3       1   227|0     1.0   80.0       0  7.1G 4.5G 216|105  1|68   78k   133k  453 NameOfTheRS  PRI 10:46:09
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw ar|aw netIn netOut conn      set repl     time
     1    34     17      3       2   187|0     1.0   80.0       0  7.1G 4.5G 283|127  1|67   65k   109k  454 NameOfTheRS  PRI 10:46:10
     1    15      2      1       3   150|0     1.0   80.0       0  7.1G 4.5G   62|51 12|67   39k   280k  456 NameOfTheRS  PRI 10:46:11
     1    91      7      1       1   225|0     1.0   80.0       0  7.1G 4.5G  244|84 12|66   52k   321k  456 NameOfTheRS  PRI 10:46:12
     3    27      7      4       1   156|0     1.0   80.1       0  7.1G 4.5G   28|59  6|68   45k   219k  458 NameOfTheRS  PRI 10:46:13
     5   133     20      5       3   360|0     0.9   79.9       1  7.1G 4.5G 301|127  1|64  103k   455k  459 NameOfTheRS  PRI 10:46:16
    11   108     13      6       0   388|0     0.7   79.9       0  7.1G 4.5G 234|100  5|63   85k   434k  470 NameOfTheRS  PRI 10:46:22
     6    48     11      2       2   161|0     0.7   80.0       0  7.1G 4.5G 336|119  5|65   63k   262k  469 NameOfTheRS  PRI 10:46:23
     6     9     16      7       3   151|0     0.7   80.1       0  7.1G 4.5G  109|52 29|77   72k   136k  469 NameOfTheRS  PRI 10:46:24
     1    41      4      3       4   243|0     0.7   80.0       0  7.1G 4.5G  112|77  5|64   35k   250k  476 NameOfTheRS  PRI 10:46:25
     1    59     10      2       0   183|0     0.7   80.0       0  7.1G 4.5G  97|105  8|60   45k   170k  476 NameOfTheRS  PRI 10:46:26
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw ar|aw netIn netOut conn      set repl     time
     3    60      9      2       2   168|0     0.7   80.0       0  7.1G 4.5G 273|128  1|63   58k   175k  477 NameOfTheRS  PRI 10:46:27
     3   124     11      6       1   406|0     0.7   80.0       0  7.2G 4.5G  249|95  1|61   96k   924k  485 NameOfTheRS  PRI 10:46:30
     1    49     15      2       1   169|0     0.7   79.9       0  7.2G 4.5G 356|129  1|59   46k   374k  490 NameOfTheRS  PRI 10:46:31
     1    65     15      8       3   320|0     0.8   80.0       0  7.2G 4.5G 179|105 13|54   93k   875k  493 NameOfTheRS  PRI 10:46:33
    *0    53     14      3       2   161|0     0.8   80.0       0  7.2G 4.5G 289|131 13|54   48k   479k  494 NameOfTheRS  PRI 10:46:34
     1    15      8      2       1   135|0     0.8   80.0       0  7.2G 4.5G 322|139 13|53   44k   327k  496 NameOfTheRS  PRI 10:46:35
     2     8      5      3       3   130|0     0.8   80.0       0  7.2G 4.5G 368|141  8|52   55k   332k  497 NameOfTheRS  PRI 10:46:36
    *0    16      9      4       3   185|0     0.8   80.0       0  7.2G 4.5G   97|61 49|49   35k   837k  499 NameOfTheRS  PRI 10:46:37
     2    54      7      4       1   246|0     0.8   80.0       0  7.2G 4.5G  210|99 49|49   47k   290k  499 NameOfTheRS  PRI 10:46:38
     2    39     13      6       1   210|0     0.8   80.0       0  7.2G 4.5G 351|113  2|48   60k   384k  500 NameOfTheRS  PRI 10:46:40
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw ar|aw netIn netOut conn      set repl     time
     3    26     10      2       1   189|0     0.8   80.0       0  7.2G 4.5G   76|59  8|49   41k   441k  503 NameOfTheRS  PRI 10:46:41
     3   104     17      2       1   414|0     0.8   79.9       0  7.2G 4.5G 150|111 24|47   92k   423k  509 NameOfTheRS  PRI 10:46:43
     2    42      6      2       0   146|0     0.8   79.9       0  7.2G 4.5G 230|129 24|47   43k   332k  508 NameOfTheRS  PRI 10:46:44
     2    36     14      2       1   213|0     0.8   80.0       0  7.2G 4.5G 299|161 24|47   69k   586k  509 NameOfTheRS  PRI 10:46:46
     4    16      7      3       2   167|0     0.8   80.0       0  7.2G 4.5G   39|59  2|47   44k   218k  513 NameOfTheRS  PRI 10:46:47
     5    91      7      2       0   369|0     0.8   80.0       0  7.2G 4.5G  95|153  4|48   70k   547k  516 NameOfTheRS  PRI 10:46:49
     2   106     12      1       1   304|0     0.8   80.0       0  7.2G 4.5G 315|217  4|48   82k   394k  521 NameOfTheRS  PRI 10:46:51
     1    36     17      4       1   189|0     0.8   80.0       0  7.2G 4.5G 384|245  4|41   57k   419k  524 NameOfTheRS  PRI 10:46:52
    *0    98     20     10       3   362|0     0.8   79.9       0  7.2G 4.5G 216|227 12|36   91k   855k  530 NameOfTheRS  PRI 10:46:55
     2    91     11      7       1   245|0     0.8   79.9       0  7.2G 4.5G 400|263 12|33   71k   765k  533 NameOfTheRS  PRI 10:46:57
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw ar|aw netIn netOut conn      set repl     time
     6   166     26      2       3   721|0     0.9   80.0       0  7.2G 4.5G 288|255  8|35  156k   880k  547 NameOfTheRS  PRI 10:47:01
     1   168     15      5       2   457|0     0.9   80.0       0  7.2G 4.5G 309|263  8|31  113k     1m  554 NameOfTheRS  PRI 10:47:05
     2    96     10      5       2   396|0     0.9   80.0       0  7.2G 4.5G 165|213 15|33   80k   596k  565 NameOfTheRS  PRI 10:47:08
     3    39      9     *0       1   140|0     0.9   80.0       0  7.2G 4.5G 249|257 15|29   35k    85k  566 NameOfTheRS  PRI 10:47:09
    *0    51     11      3       1   132|0     0.9   80.0       0  7.2G 4.5G 353|279 15|29   36k   488k  568 NameOfTheRS  PRI 10:47:10
    *0    27      4     *0       1   113|0     0.9   80.0       0  7.2G 4.5G 414|289 14|28   30k    72k  570 NameOfTheRS  PRI 10:47:11
     2    11      4      1       1   137|0     0.9   80.0       0  7.2G 4.5G 436|293 14|28   35k   381k  571 NameOfTheRS  PRI 10:47:12
     1     9      7      2       2   176|0     0.9   80.0       0  7.2G 4.5G 465|293 14|25   52k   626k  572 NameOfTheRS  PRI 10:47:13
    *0     4      5      4       2   108|0     0.8   79.9       0  7.2G 4.5G 486|293  1|22   31k   319k  571 NameOfTheRS  PRI 10:47:14
     2    18      3      4       4   122|0     0.9   80.0       0  7.2G 4.5G  79|207  2|22   34k   524k  572 NameOfTheRS  PRI 10:47:15
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw ar|aw netIn netOut conn      set repl     time
     1    40      4     *0       2   180|0     0.9   80.0       0  7.2G 4.5G 161|239  2|22   31k   137k  574 NameOfTheRS  PRI 10:47:16
     3   258     23      4       4   694|0     0.9   80.0       1  7.3G 4.5G 253|221  2|22  152k     2m  582 NameOfTheRS  PRI 10:47:21
    *0    52      8      1       0   142|0     0.9   80.0       0  7.3G 4.5G 365|279  2|21   35k   165k  585 NameOfTheRS  PRI 10:47:22
    *0    69     12      3       2   347|0     0.9   80.0       0  7.3G 4.5G 505|335  2|16   81k   218k  598 NameOfTheRS  PRI 10:47:29
     1    13      4      1       1   113|0     0.8   80.0       0  7.3G 4.5G 553|337  1|14   28k   377k  599 NameOfTheRS  PRI 10:47:30
     2    94      8      2       2   406|0     0.9   80.0       0  7.3G 4.5G 412|323  4|14   82k   655k  603 NameOfTheRS  PRI 10:47:32
    *0    57      8      3       1   186|0     0.8   80.0       0  7.3G 4.5G 523|349  4|11   46k   212k  605 NameOfTheRS  PRI 10:47:33
    *0    27      3     *0       3   174|0     0.8   80.0       0  7.3G 4.5G 121|233 23|11   32k   537k  610 NameOfTheRS  PRI 10:47:34
     3   151     15      6       1   436|0     0.9   79.9       0  7.3G 4.5G 459|291  16|9  100k   966k  611 NameOfTheRS  PRI 10:47:37
     2    28     15      4       1   142|0     0.7   79.8       0  7.3G 4.5G 525|183 12|12   53k   377k  612 NameOfTheRS  PRI 10:47:38
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw ar|aw netIn netOut conn      set repl     time
     3    27     27      4       3   238|0     0.7   80.0       0  7.4G 4.5G  73|163 21|12   90k     1m  613 NameOfTheRS  PRI 10:47:39
     1    40      6      1       3   226|0     0.7   79.9       0  7.4G 4.6G  159|77 13|13   38k   165k  613 NameOfTheRS  PRI 10:47:40
     9   181     46     10       2   573|0     0.7   80.0       0  7.4G 4.6G 565|269 11|13  229k     1m  620 NameOfTheRS  PRI 10:47:43
     1    63     13      2       3   192|0     0.8   80.0       0  7.4G 4.6G 204|139 16|17   50k   656k  621 NameOfTheRS  PRI 10:47:44
     2    96      9      3       1   236|0     0.7   79.9       0  7.4G 4.6G 424|221 16|17   71k   433k  624 NameOfTheRS  PRI 10:47:45
     3    53     18      6       3   266|0     0.7   80.0       0  7.4G 4.6G 582|333  1|13   96k   613k  626 NameOfTheRS  PRI 10:47:46
    *0    27      5      4       2   129|0     0.7   80.0       0  7.4G 4.6G  62|132  8|17   27k     1m  627 NameOfTheRS  PRI 10:47:47
     4   203     32      6       4   425|0     0.6   79.9       0  7.4G 4.6G 489|290  1|12  140k   853k  633 NameOfTheRS  PRI 10:47:49
     3    53      7      4       1   246|0     0.6   80.0       0  7.4G 4.6G 235|155  1|13   75k   877k  633 NameOfTheRS  PRI 10:47:50
     4   108     25     10       2   273|0     0.7   80.0       0  7.4G 4.6G 595|197  1|13  104k   506k  637 NameOfTheRS  PRI 10:47:51
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw ar|aw netIn netOut conn      set repl     time
     3    50     17      6       1   303|0     0.6   80.0       0  7.4G 4.6G  78|131 50|12   77k   475k  640 NameOfTheRS  PRI 10:47:52
     2   126     19      8       1   202|0     0.6   80.0       0  7.4G 4.6G 345|187 50|12   88k   895k  640 NameOfTheRS  PRI 10:47:53
    13    82     27     11       4   273|0     0.6   80.0       0  7.4G 4.6G 518|223 14|17  143k   572k  639 NameOfTheRS  PRI 10:47:54
    12   103     52     35       7   333|0     0.6   80.0       0  7.4G 4.6G 485|150  1|11  159k   238k  642 NameOfTheRS  PRI 10:47:55
    10   246     45     12       4   424|0     0.6   80.0       0  7.4G 4.6G  204|89 36|20  170k     1m  643 NameOfTheRS  PRI 10:47:56
     6   127     25      9       5   235|0     0.6   80.0       0  7.4G 4.6G  81|157  9|13   96k   853k  645 NameOfTheRS  PRI 10:47:57
    12   261     44     13       5   356|0     0.6   80.0       0  7.4G 4.6G  182|81  5|17  197k     1m  649 NameOfTheRS  PRI 10:47:59
     4   263     33     11       3   259|0     0.6   80.0       0  7.4G 4.6G 569|213   1|9  153k     2m  650 NameOfTheRS  PRI 10:48:00
     4   194     24      4       5   258|0     0.6   80.0       0  7.4G 4.6G 391|193  2|10  106k     1m  653 NameOfTheRS  PRI 10:48:01
     6    85     24      7       5   226|0     0.6   80.0       0  7.4G 4.6G  56|125  2|12  125k     2m  653 NameOfTheRS  PRI 10:48:02
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw ar|aw netIn netOut conn      set repl     time
     6   231     34      9       3   431|0     0.6   79.9       0  7.4G 4.6G 357|221  8|11  133k   797k  660 NameOfTheRS  PRI 10:48:03
    13   130     33      7       4   352|0     0.6   80.0       0  7.4G 4.6G 413|167  1|12  140k   282k  666 NameOfTheRS  PRI 10:48:04
     2   156     31      6       3   302|0     0.5   79.9       0  7.4G 4.6G 401|207  6|11  113k   823k  667 NameOfTheRS  PRI 10:48:05
    13    79     37     11       6   251|0     0.5   80.1       0  7.4G 4.6G  49|131  16|1  158k     1m  667 NameOfTheRS  PRI 10:48:06
     9   340     75     21       5   472|0     0.4   80.2       0  7.4G 4.6G   55|99 115|23  249k     2m  668 NameOfTheRS  PRI 10:48:07
     6   196     46      7       5   369|0     0.4   80.1       0  7.4G 4.6G 178|156   8|13  164k     1m  670 NameOfTheRS  PRI 10:48:08
     7   209     53     14       7   399|0     0.4   79.9       0  7.4G 4.6G 266|179    1|6  169k     1m  671 NameOfTheRS  PRI 10:48:09
     4   222     46      9       7   333|0     0.5   80.0       0  7.4G 4.6G 105|115   10|9  146k     1m  671 NameOfTheRS  PRI 10:48:10
    10   211     62     14       6   355|0     0.5   80.0       0  7.4G 4.6G 226|169   3|12  168k     1m  670 NameOfTheRS  PRI 10:48:11
    17   139     41     13       1   235|0     0.5   79.9       0  7.4G 4.6G 514|218   2|16  167k     1m  670 NameOfTheRS  PRI 10:48:12
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw  ar|aw netIn netOut conn      set repl     time
    13   186     58     19       6   381|0     0.5   80.0       0  7.4G 4.6G 474|261   3|22  180k     1m  670 NameOfTheRS  PRI 10:48:13
    15   125     65     22       3   350|0     0.5   79.9       0  7.4G 4.6G 503|227   1|14  175k     1m  670 NameOfTheRS  PRI 10:48:14
     6   181     54     18       7   364|0     0.5   80.1       0  7.4G 4.6G 170|119  31|26  176k     2m  671 NameOfTheRS  PRI 10:48:15
    11   116     56     15       3   288|0     0.5   80.2       0  7.4G 4.6G  73|115   2|15  156k     1m  671 NameOfTheRS  PRI 10:48:16
    12   184     53      9       6   301|0     0.5   80.0       0  7.4G 4.6G 182|129  13|22  164k     1m  670 NameOfTheRS  PRI 10:48:17
     9   112     42     10       2   279|0     0.5   80.0       0  7.5G 4.6G 404|213   2|18  135k   579k  673 NameOfTheRS  PRI 10:48:18
     9    82     41     13       8   291|0     0.5   80.0       0  7.5G 4.6G 214|136   3|14  138k   992k  674 NameOfTheRS  PRI 10:48:19
     3   146     29      6       2   352|0     0.5   80.3       0  7.5G 4.6G 176|124   4|10  131k   829k  675 NameOfTheRS  PRI 10:48:20
    10   125     43     11       1   275|0     0.5   80.2       0  7.5G 4.6G  100|91 100|24  133k     1m  675 NameOfTheRS  PRI 10:48:21
     7   148     26      5       3   303|0     0.5   79.9       0  7.5G 4.6G 386|201  32|12  103k   902k  677 NameOfTheRS  PRI 10:48:22
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw  ar|aw netIn netOut conn      set repl     time
     6   186     45      9       6   338|0     0.5   79.9       0  7.5G 4.6G  168|89    3|8  159k     1m  678 NameOfTheRS  PRI 10:48:23
     4   132     53     11       6   295|0     0.5   80.1       0  7.5G 4.6G 127|127    4|6  157k     2m  679 NameOfTheRS  PRI 10:48:24
    14   263     74     15      10   528|0     0.4   80.0       0  7.5G 4.6G 242|190    4|3  273k     1m  679 NameOfTheRS  PRI 10:48:25
    10   315    100     13      13   486|0     0.5   80.0       0  7.5G 4.6G 423|241    4|6  253k     2m  679 NameOfTheRS  PRI 10:48:26
    20   311    129     27      10   529|0     0.4   79.9       0  7.5G 4.6G 286|292   10|1  350k     2m  678 NameOfTheRS  PRI 10:48:27
    11   267     69      7      12   452|0     0.4   80.0       0  7.5G 4.6G 196|112    1|3  217k     1m  677 NameOfTheRS  PRI 10:48:28
    18   357    117     15       4   481|0     0.3   79.9       1  7.5G 4.6G  131|83    4|5  282k     2m  675 NameOfTheRS  PRI 10:48:29
     5   130     62     12       4   390|0     0.2   80.0       0  7.5G 4.6G 461|183    3|4  129k   563k  676 NameOfTheRS  PRI 10:48:33
     9   132     48      9       5   471|0     0.2   80.0       0  7.5G 4.6G  73|123   4|10  185k     1m  674 NameOfTheRS  PRI 10:48:34
    33   191    116     29      10   399|0     0.2   80.0       0  7.5G 4.6G   53|69  13|46  294k     1m  674 NameOfTheRS  PRI 10:48:35
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw  ar|aw netIn netOut conn      set repl     time
     9   251     72     12       1   441|0     0.2   80.0       0  7.5G 4.6G 299|163   4|19  160k   956k  675 NameOfTheRS  PRI 10:48:36
    11   243     77     12       5   194|0     0.3   80.0       0  7.5G 4.6G 402|187  15|23  210k     1m  675 NameOfTheRS  PRI 10:48:37
     5    87     34     10       2   228|0     0.3   80.0       0  7.5G 4.6G 433|129   1|22  122k   353k  674 NameOfTheRS  PRI 10:48:38
     7   144     41     10       3   205|0     0.3   80.0       0  7.5G 4.6G 227|171  86|21  130k     1m  674 NameOfTheRS  PRI 10:48:39
    10   190     49     10       7   386|0     0.3   79.9       0  7.5G 4.6G 346|163   4|23  142k     1m  674 NameOfTheRS  PRI 10:48:40
     7   102     48     13      12   233|0     0.3   80.0       0  7.5G 4.6G 101|111   8|25  141k     1m  673 NameOfTheRS  PRI 10:48:41
     8   155     27     12       1   382|0     0.3   79.9       0  7.5G 4.6G 464|167   5|27  113k   927k  673 NameOfTheRS  PRI 10:48:42
    20    92     51     17      12   217|0     0.3   79.9       0  7.5G 4.6G  80|103   6|35  179k     1m  673 NameOfTheRS  PRI 10:48:43
    *0   136     25     11       4   248|0     0.4   79.9       0  7.5G 4.6G 373|193   6|31   79k   902k  673 NameOfTheRS  PRI 10:48:44
    13    94     48     22      10   216|0     0.3   80.0       0  7.5G 4.6G  59|115   8|30  158k   969k  672 NameOfTheRS  PRI 10:48:45
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw  ar|aw netIn netOut conn      set repl     time
     6   172     48      9       0   324|0     0.3   80.0       0  7.5G 4.6G 425|219   8|29  100k   807k  673 NameOfTheRS  PRI 10:48:46
    12    94     50     16       5   191|0     0.4   80.0       0  7.5G 4.6G 245|113   2|30  152k   967k  672 NameOfTheRS  PRI 10:48:47
     5    85     29     11       3   273|0     0.4   80.0       0  7.4G 4.6G 565|207   1|27  108k   539k  671 NameOfTheRS  PRI 10:48:48
     4    93      5      6       3   171|0     0.4   80.0       0  7.4G 4.6G 236|125  10|26   59k     1m  671 NameOfTheRS  PRI 10:48:49
    12   145     60     14       3   270|0     0.4   80.0       0  7.4G 4.6G 552|187   9|28  161k   637k  670 NameOfTheRS  PRI 10:48:50
     9    92     40     10       2   214|0     0.4   79.9       0  7.4G 4.6G 315|155   7|27  109k   439k  670 NameOfTheRS  PRI 10:48:51
     5    92     45     19       5   295|0     0.3   80.0       0  7.4G 4.6G   62|91  30|20  139k     1m  670 NameOfTheRS  PRI 10:48:52
     6   174     27      4       3   283|0     0.4   79.9       0  7.4G 4.6G 363|161  39|19   93k   621k  670 NameOfTheRS  PRI 10:48:53
    17   118     46     12       2   305|0     0.4   80.1       0  7.4G 4.6G  105|94  34|38  166k   995k  669 NameOfTheRS  PRI 10:48:54
    *0   164     20      6       1   199|0     0.4   80.0       0  7.4G 4.6G 415|141   6|25   75k   408k  669 NameOfTheRS  PRI 10:48:55
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw  ar|aw netIn netOut conn      set repl     time
    10   119     32     11       4   231|0     0.4   80.0       0  7.4G 4.6G  219|91  26|31  102k   553k  669 NameOfTheRS  PRI 10:48:56
     5   119     26      4       7   192|0     0.4   79.9       0  7.4G 4.6G   61|73   6|31   85k     1m  669 NameOfTheRS  PRI 10:48:57
    23   270     72     18       3   621|0     0.4   80.0       0  7.4G 4.6G 595|149   1|37  269k     2m  670 NameOfTheRS  PRI 10:49:00
     4    17     11      6       1    97|0     0.4   80.0       0  7.4G 4.6G  166|79   6|35   53k   439k  670 NameOfTheRS  PRI 10:49:01
     4   154     39     12       5   414|0     0.4   80.1       0  7.4G 4.6G   42|63   8|33  119k   846k  671 NameOfTheRS  PRI 10:49:03
    12   275     40     16      10   659|0     0.4   80.0       0  7.4G 4.6G   86|89  11|35  186k     2m  672 NameOfTheRS  PRI 10:49:06
    11   186     35      8       2   345|0     0.4   80.0       0  7.4G 4.6G 468|185  11|39  151k   830k  672 NameOfTheRS  PRI 10:49:09
     7    59     38     12       1   203|0     0.4   80.0       0  7.4G 4.6G 291|258   4|28   94k   891k  672 NameOfTheRS  PRI 10:49:10
     2   100     18     11      20   285|0     0.4   80.0       0  7.4G 4.6G 181|169   1|16   54k   989k  672 NameOfTheRS  PRI 10:49:11
    11   206     41     17       3   392|0     0.4   80.0       0  7.4G 4.6G 609|293   1|17  146k     2m  674 NameOfTheRS  PRI 10:49:12
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw  ar|aw netIn netOut conn      set repl     time
     6   116     32     15       1   154|0     0.4   79.9       0  7.5G 4.6G 623|303   16|7   72k   945k  673 NameOfTheRS  PRI 10:49:13
     6   105     45      7       8   203|0     0.3   80.0       0  7.5G 4.6G 197|115  21|48  126k   971k  673 NameOfTheRS  PRI 10:49:14
     8   182     40      8       3   291|0     0.3   80.0       0  7.5G 4.6G 525|248   40|3  121k   995k  674 NameOfTheRS  PRI 10:49:15
    11   156     55     13      13   282|0     0.3   80.0       0  7.5G 4.6G 367|253   1|11  140k     3m  674 NameOfTheRS  PRI 10:49:16
     5   180     30      7       3   224|0     0.3   80.0       0  7.5G 4.6G 205|244  54|11  125k     1m  673 NameOfTheRS  PRI 10:49:17
    13   220     41     13       7   260|0     0.3   79.9       0  7.5G 4.6G 394|241   14|4  156k     2m  674 NameOfTheRS  PRI 10:49:18
    22   275     69     17       6   258|0     0.3   80.0       0  7.5G 4.6G 182|130   10|5  196k     2m  673 NameOfTheRS  PRI 10:49:19
     7   276     41     12      10   258|0     0.3   80.0       0  7.5G 4.6G 382|296    4|1  172k     2m  672 NameOfTheRS  PRI 10:49:20
     9   210     42     11       3   209|0     0.3   80.1       0  7.5G 4.6G 183|231 120|20  126k     1m  671 NameOfTheRS  PRI 10:49:22
    10   256     58     16       6   343|0     0.3   80.0       0  7.5G 4.6G 168|185   90|6  205k     2m  667 NameOfTheRS  PRI 10:49:23
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw  ar|aw netIn netOut conn      set repl     time
    21   295     57     18      12   340|0     0.3   80.0       0  7.5G 4.6G 139|131   72|9  217k     3m  665 NameOfTheRS  PRI 10:49:24
    11   165     52      7       5   255|0     0.3   80.0       0  7.5G 4.6G 328|323   18|6  124k     1m  662 NameOfTheRS  PRI 10:49:25
     5   142     52      8       6   169|0     0.3   80.0       0  7.5G 4.6G 130|197   90|3   95k     1m  662 NameOfTheRS  PRI 10:49:26
    19   208     68     20       7   312|0     0.3   80.0       0  7.5G 4.6G 362|408   30|2  210k     2m  662 NameOfTheRS  PRI 10:49:27
    18   133     58     18       1   236|0     0.2   80.0       0  7.5G 4.6G 149|155  75|23  134k     1m  662 NameOfTheRS  PRI 10:49:28
    23   232     91     21       3   351|0     0.3   79.9       0  7.5G 4.6G 454|376    3|0  252k     1m  660 NameOfTheRS  PRI 10:49:29
    19   221     65     14       5   352|0     0.2   79.9       0  7.5G 4.6G 347|326   26|4  212k   956k  659 NameOfTheRS  PRI 10:49:30
    17   171     69     16       7   239|0     0.3   80.0       0  7.5G 4.6G 239|259   74|3  184k     1m  656 NameOfTheRS  PRI 10:49:31
     9   150     49     15       4   196|0     0.2   80.0       0  7.5G 4.6G 275|337    1|3  155k     1m  654 NameOfTheRS  PRI 10:49:32
    12   232     81     24       7   264|0     0.3   79.9       1  7.5G 4.6G 236|295    4|7  194k     1m  650 NameOfTheRS  PRI 10:49:33
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw  ar|aw netIn netOut conn      set repl     time
    35   224     92     21       3   327|0     0.3   79.9       0  7.5G 4.6G 253|365   1|13  236k     2m  646 NameOfTheRS  PRI 10:49:34
     2    36      6      2       0   102|0     0.2   79.9       0  7.5G 4.6G 335|457   1|12   24k    70k  636 NameOfTheRS  PRI 10:49:36
    24   189     56     14       2   325|0     0.2   79.9       0  7.5G 4.6G 313|355   1|18  173k     1m  633 NameOfTheRS  PRI 10:49:37
     5   236     79     31       2   308|0     0.2   79.9       0  7.5G 4.6G 302|217    3|1  204k     1m  629 NameOfTheRS  PRI 10:49:38
    21   385    124     33       9   361|0     0.3   79.9       0  7.5G 4.6G 260|259    2|1  326k     2m  625 NameOfTheRS  PRI 10:49:39
    28   328    142     27       9   285|0     0.3   80.0       0  7.5G 4.6G 283|332    2|9  337k     2m  621 NameOfTheRS  PRI 10:49:40
    20   177     75     27       4   260|0     0.4   79.9       0  7.5G 4.6G  93|261    1|8  187k     1m  618 NameOfTheRS  PRI 10:49:41
    11   253     83     13       4   352|0     0.4   79.9       0  7.5G 4.6G 268|288    1|9  240k     1m  613 NameOfTheRS  PRI 10:49:42
     8   223     84     31       8   392|0     0.3   79.9       0  7.5G 4.6G 172|223   11|0  205k     1m  609 NameOfTheRS  PRI 10:49:43
    29   357    135     48       6   479|0     0.3   80.0       0  7.5G 4.6G 152|165    2|5  331k     1m  605 NameOfTheRS  PRI 10:49:44
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw  ar|aw netIn netOut conn      set repl     time
    42   350    165     61      12   346|0     0.3   80.0       0  7.5G 4.6G 310|279   2|11  360k     2m  601 NameOfTheRS  PRI 10:49:45
    31   287    119     42      10   254|0     0.4   80.0       0  7.5G 4.6G 128|132  13|49  297k     2m  597 NameOfTheRS  PRI 10:49:46
    24   256    118     30       5   301|0     0.4   80.0       0  7.5G 4.6G 273|286   1|11  306k     2m  593 NameOfTheRS  PRI 10:49:47
    20   230    110     27       5   351|0     0.4   80.0       0  7.5G 4.6G  97|170  10|19  247k     2m  589 NameOfTheRS  PRI 10:49:48
    23   288    131     29      13   345|0     0.4   80.0       0  7.5G 4.6G  79|191   7|15  316k     2m  585 NameOfTheRS  PRI 10:49:49
    36   245    139     38      11   352|0     0.4   80.0       0  7.4G 4.6G 106|227  18|18  318k     2m  581 NameOfTheRS  PRI 10:49:50
    34   210    131     53       8   222|0     0.4   79.9       0  7.4G 4.6G 171|366   18|8  270k     2m  577 NameOfTheRS  PRI 10:49:51
    28   192    131     49      14   348|0     0.4   80.0       0  7.4G 4.6G  86|279   1|12  322k     3m  573 NameOfTheRS  PRI 10:49:52
    20   258    124     46       9   335|0     0.3   80.0       0  7.4G 4.6G 146|158   2|33  299k     3m  569 NameOfTheRS  PRI 10:49:53
    31   314    119     35      16   336|0     0.3   80.0       0  7.4G 4.6G  72|147    1|6  323k     3m  565 NameOfTheRS  PRI 10:49:54
insert query update delete getmore command % dirty % used flushes vsize  res   qr|qw  ar|aw netIn netOut conn      set repl     time
    33   280    113     37       6   322|0     0.3   80.0       0  7.4G 4.6G 125|146   6|23  278k     2m  561 NameOfTheRS  PRI 10:49:55
    33   256    119     43       7   275|0     0.4   80.0       0  7.4G 4.6G  44|181   3|23  301k     2m  558 NameOfTheRS  PRI 10:49:56
    28   159    113     27      12   279|0     0.4   80.0       0  7.4G 4.6G 103|280   1|20  244k     1m  554 NameOfTheRS  PRI 10:49:57
    24   183    103     41       4   300|0     0.4   80.0       0  7.4G 4.6G  99|263   2|20  234k     2m  551 NameOfTheRS  PRI 10:49:58
    19   177    101     47       6   242|0     0.4   80.0       0  7.4G 4.6G  94|176   4|11  228k   885k  547 NameOfTheRS  PRI 10:49:59
    29   256    135     42       4   297|0     0.4   79.9       0  7.4G 4.6G 156|310    1|4  322k     2m  543 NameOfTheRS  PRI 10:50:00
    23   210    161     30       7   445|0     0.4   80.0       0  7.4G 4.6G 156|258    1|3  338k     1m  539 NameOfTheRS  PRI 10:50:01
    32   267    127     53       4   373|0     0.4   79.9       0  7.4G 4.6G 104|175   1|11  361k     1m  535 NameOfTheRS  PRI 10:50:02
    46   204    123     48       5   373|0     0.4   79.9       0  7.4G 4.6G  71|151   1|41  286k   978k  532 NameOfTheRS  PRI 10:50:03
    32   142    106     44       7   222|0     0.4   80.0       0  7.4G 4.6G 152|164   1|42  227k   854k  529 NameOfTheRS  PRI 10:50:04

MongoStat after the restart:

insert query update delete getmore command % dirty % used flushes vsize    res qr|qw ar|aw netIn netOut conn      set repl     time
    21   180     97     32     189   604|0     1.5    7.7       0  2.1G 669.0M   0|0   1|0  564k   716k  381 NameOfTheRS  PRI 10:55:19
    28   112    106     44     233   642|0     1.5    7.7       0  2.1G 670.0M   0|0   1|0  685k   724k  380 NameOfTheRS  PRI 10:55:20
    44   201    151     36     266   740|0     1.6    8.0       0  2.1G 690.0M   0|0   2|0  969k     2m  379 NameOfTheRS  PRI 10:55:21
     8   270     49     14     122   554|0     1.6    9.3       0  2.2G 769.0M   1|6   7|0  386k     1m  378 NameOfTheRS  PRI 10:55:22
    23   416    118     24     226   664|0     1.6   10.7       0  2.3G 847.0M   5|8   3|0  725k     3m  379 NameOfTheRS  PRI 10:55:23
    26   358    147     28     270   807|0     1.6   11.4       0  2.3G 892.0M   0|0   1|0  821k     3m  379 NameOfTheRS  PRI 10:55:24
    38   422    186     44     342   935|0     1.6   11.7       0  2.3G 912.0M   0|0   1|1    1m     4m  378 NameOfTheRS  PRI 10:55:25
    26   358    124     29     239   719|0     1.7   12.0       0  2.3G 931.0M   0|0   1|1  708k     3m  378 NameOfTheRS  PRI 10:55:26
    27   495    147     32     291   816|0     1.7   12.2       0  2.4G 940.0M   1|2   2|0  845k     4m  378 NameOfTheRS  PRI 10:55:27
    35   302    161     54     342   939|0     1.7   12.3       0  2.4G 947.0M   0|0   1|0  912k     2m  378 NameOfTheRS  PRI 10:55:28
insert query update delete getmore command % dirty % used flushes vsize    res qr|qw ar|aw netIn netOut conn      set repl     time
    31   287    131     52     251   693|0     1.7   12.4       0  2.4G 953.0M   0|0   1|0  750k     2m  378 NameOfTheRS  PRI 10:55:29
    24   131     86     40     195   611|0     1.7   12.4       0  2.4G 955.0M   0|0   1|0  567k   747k  378 NameOfTheRS  PRI 10:55:30
    32   210    142     64     274   773|0     1.7   12.4       0  2.4G 957.0M   0|0   1|0  756k     1m  378 NameOfTheRS  PRI 10:55:31
    22   272    104     36     222   703|0     1.7   12.5       0  2.4G 960.0M   0|0   1|0  643k     1m  378 NameOfTheRS  PRI 10:55:32
    43   306    177     74     317   830|0     1.8   12.5       0  2.4G 961.0M   0|0   1|0  948k     2m  378 NameOfTheRS  PRI 10:55:33
    26   223    101     34     186   607|0     1.8   12.5       0  2.4G 961.0M   0|1   1|0  607k     2m  378 NameOfTheRS  PRI 10:55:34
    19   124     62     10     120   381|0     1.8   12.5       0  2.4G 961.0M   0|0   1|0  442k     1m  377 NameOfTheRS  PRI 10:55:35
    21   163     95     18     178   612|0     1.8   12.5       0  2.4G 962.0M   0|0   1|1  606k     1m  376 NameOfTheRS  PRI 10:55:36
    31   144    117     28     205   629|0     1.8   12.5       0  2.4G 963.0M   0|0   1|0  734k     1m  375 NameOfTheRS  PRI 10:55:37
    20   111     84     16     139   534|0     1.8   12.5       0  2.4G 964.0M   0|0   1|0  493k     1m  375 NameOfTheRS  PRI 10:55:38
insert query update delete getmore command % dirty % used flushes vsize    res qr|qw ar|aw netIn netOut conn      set repl     time
     7    91     34     13      71   364|0     1.8   12.5       0  2.4G 964.0M   0|0   1|0  230k   556k  374 NameOfTheRS  PRI 10:55:39
     3    96     18      2      37   321|0     1.8   12.5       0  2.4G 965.0M   0|0   1|0  139k     1m  373 NameOfTheRS  PRI 10:55:40
     4   101     29      2      63   313|0     1.8   12.5       0  2.4G 965.0M   0|0   1|0  201k   591k  372 NameOfTheRS  PRI 10:55:41
    10    91     42     17      95   463|0     1.8   12.5       0  2.4G 965.0M   0|0   1|0  294k   554k  371 NameOfTheRS  PRI 10:55:42
    *0    53      7     *0      14   232|0     1.8   12.6       0  2.4G 965.0M   0|1   1|0   90k   249k  370 NameOfTheRS  PRI 10:55:43
     2    61     13      4      39   270|0     1.8   12.6       0  2.4G 965.0M   0|0   1|0  143k   220k  369 NameOfTheRS  PRI 10:55:44
     6   220     47      7      87   409|0     1.8   12.6       0  2.4G 970.0M   0|0   1|0  313k     1m  367 NameOfTheRS  PRI 10:55:45
    37   251    137      7     207   626|0     1.0   12.6       1  2.4G 971.0M   0|0   2|0  895k     2m  369 NameOfTheRS  PRI 10:55:46
    69   143    240     12     308   853|0     1.0   12.7       0  2.4G 974.0M   0|0   2|0    1m     3m  369 NameOfTheRS  PRI 10:55:47
    42   125    153     14     214   649|0     0.9   12.7       0  2.4G 976.0M   0|0   1|0  908k     2m  368 NameOfTheRS  PRI 10:55:48
insert query update delete getmore command % dirty % used flushes vsize    res qr|qw ar|aw netIn netOut conn      set repl     time
    22   173    100      7     154   505|0     0.9   12.7       0  2.4G 977.0M   0|0   1|0  578k     2m  367 NameOfTheRS  PRI 10:55:49
    10   123     44      9      86   367|0     0.5   12.7       0  2.4G 979.0M   0|0   1|0  294k     1m  366 NameOfTheRS  PRI 10:55:50
     2    50     12     *0      25   245|0     0.4   12.7       0  2.4G 980.0M   0|0   1|0  125k   301k  363 NameOfTheRS  PRI 10:55:51
     6    41     22     *0      47   255|0     0.4   12.8       0  2.4G 982.0M   1|4   1|1  190k   239k  363 NameOfTheRS  PRI 10:55:52
     3   118     21     *0      39   273|0     0.4   12.8       0  2.4G 983.0M   0|0   1|1  171k   858k  362 NameOfTheRS  PRI 10:55:53
     5   107     29      5      59   316|0     0.4   12.8       0  2.4G 983.0M   0|0   1|0  206k   837k  362 NameOfTheRS  PRI 10:55:54
     1    41     10      2      14   227|0     0.5   12.8       0  2.4G 983.0M   0|0   1|0   75k   321k  362 NameOfTheRS  PRI 10:55:55
     5   130     37      7      82   340|0     0.5   12.8       0  2.4G 983.0M   0|1   2|0  259k   716k  362 NameOfTheRS  PRI 10:55:56
     8   114     41     16      85   389|0     0.5   12.8       0  2.4G 984.0M   0|0   1|0  259k   766k  362 NameOfTheRS  PRI 10:55:57
    10   101     43     11      89   374|0     0.5   12.8       0  2.4G 984.0M   0|0   1|0  270k     1m  362 NameOfTheRS  PRI 10:55:58
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     2   122     10      2      20   263|0     0.5   13.2       0  2.4G 1007.0M   0|0   1|0  108k   290k  362 NameOfTheRS  PRI 10:55:59
    16   177     60     22     120   454|0     0.5   13.5       0  2.4G    1.0G   0|0   2|1  381k   543k  362 NameOfTheRS  PRI 10:56:00
    19   376     90     24     211   725|0     0.5   13.9       0  2.5G    1.0G   0|0   1|0  630k     2m  362 NameOfTheRS  PRI 10:56:01
    43   354    137     69     297   865|0     0.5   14.2       0  2.5G    1.0G   0|0   1|0  871k     1m  362 NameOfTheRS  PRI 10:56:02
    33   508    127     46     259   835|0     0.5   14.6       0  2.5G    1.1G   0|0   1|0  813k     2m  362 NameOfTheRS  PRI 10:56:03
    42   451    152     62     281   886|0     0.6   14.8       0  2.5G    1.1G   0|0   1|0  882k     2m  362 NameOfTheRS  PRI 10:56:04
    45   547    167     73     310   988|0     0.4   15.3       0  2.5G    1.1G 11|10   2|0  984k     2m  362 NameOfTheRS  PRI 10:56:05
    48   490    189     85     351  1060|0     0.4   15.6       0  2.6G    1.1G   0|0   1|0    1m     2m  362 NameOfTheRS  PRI 10:56:06
    36   535    181     62     329   991|0     0.5   15.8       0  2.6G    1.1G   0|1   2|0  953k     2m  362 NameOfTheRS  PRI 10:56:07
    35   578    164     60     294  1006|0     0.5   16.2       0  2.6G    1.2G   0|0   1|0  911k     3m  362 NameOfTheRS  PRI 10:56:08
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    38   569    175     56     324   979|0     0.5   16.6       0  2.6G    1.2G  21|8   2|0  971k     3m  363 NameOfTheRS  PRI 10:56:09
    41   626    167     60     328  1032|0     0.5   17.1       0  2.6G    1.2G   0|0   1|0    1m     3m  364 NameOfTheRS  PRI 10:56:10
    67   601    257    104     447  1185|0     0.6   17.3       0  2.7G    1.2G   0|2   2|0    1m     4m  366 NameOfTheRS  PRI 10:56:11
    49   605    169     74     376  1128|0     0.6   17.6       0  2.7G    1.2G   0|0   1|0    1m     3m  368 NameOfTheRS  PRI 10:56:12
    69   597    280     91     462  1260|0     0.6   17.8       0  2.7G    1.3G   0|0   2|0    1m     5m  368 NameOfTheRS  PRI 10:56:13
    66   521    239    109     422  1223|0     0.7   17.9       0  2.7G    1.3G   0|0   1|0    1m     3m  367 NameOfTheRS  PRI 10:56:14
    41   480    189     76     330   995|0     0.7   18.0       0  2.7G    1.3G   0|0   1|0    1m     2m  369 NameOfTheRS  PRI 10:56:15
    49   484    222     82     380  1096|0     0.7   18.1       0  2.7G    1.3G   0|0   1|0    1m     2m  370 NameOfTheRS  PRI 10:56:16
    42   447    182     72     330   993|0     0.7   18.2       0  2.7G    1.3G   0|0   4|1  979k     3m  375 NameOfTheRS  PRI 10:56:17
    31   501    181     44     347  1058|0     0.8   18.3       0  2.7G    1.3G   0|0   1|0  964k     3m  378 NameOfTheRS  PRI 10:56:18
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    36   454    182     60     308   930|0     0.8   18.4       0  2.7G    1.3G   0|0   1|0  945k     3m  378 NameOfTheRS  PRI 10:56:19
    39   560    175     63     318   953|0     0.8   18.9       0  2.7G    1.3G  19|7   2|1  979k     3m  380 NameOfTheRS  PRI 10:56:20
    51   565    190     71     364  1101|0     0.8   19.4       0  2.8G    1.3G   0|0   1|0    1m     3m  383 NameOfTheRS  PRI 10:56:21
    49   431    179     69     355  1019|0     0.8   19.6       0  2.8G    1.4G   0|0   1|1    1m     2m  383 NameOfTheRS  PRI 10:56:22
    48   679    200     72     349  1044|0     0.9   20.2       0  2.8G    1.4G   0|0   2|0    1m     3m  382 NameOfTheRS  PRI 10:56:23
    45   525    171     72     358  1055|0     0.9   20.5       0  2.9G    1.4G   0|0   1|0    1m     2m  385 NameOfTheRS  PRI 10:56:24
    38   434    148     73     322   974|0     0.9   20.6       0  2.9G    1.4G   0|0   1|0  947k     2m  386 NameOfTheRS  PRI 10:56:25
    32   483    151     47     290   881|0     0.9   20.7       0  2.9G    1.4G   0|1   1|0  902k     2m  387 NameOfTheRS  PRI 10:56:26
    26   440    129     36     236   781|0     0.9   20.8       0  2.9G    1.4G   0|1   1|0  742k     2m  388 NameOfTheRS  PRI 10:56:27
    39   543    187     70     330   974|0     0.9   20.8       0  2.9G    1.4G   0|3   2|0    1m     3m  388 NameOfTheRS  PRI 10:56:28
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    45   515    188     86     340  1010|0     1.0   20.9       0  2.9G    1.4G   0|0   1|0    1m     4m  395 NameOfTheRS  PRI 10:56:29
    30   531    145     44     252   842|0     1.0   20.9       0  2.9G    1.4G   0|0   2|0  785k     3m  399 NameOfTheRS  PRI 10:56:30
    28   535    153     45     299   929|0     1.0   21.0       0  2.9G    1.4G   0|1   1|0  870k     4m  398 NameOfTheRS  PRI 10:56:31
    30   469    161     53     297   896|0     1.0   21.1       0  2.9G    1.4G   0|0   1|0  868k     3m  402 NameOfTheRS  PRI 10:56:32
    42   548    200     68     371  1027|0     1.0   21.1       0  2.9G    1.4G   0|0   1|0    1m     4m  400 NameOfTheRS  PRI 10:56:33
    41   311    198     79     364  1005|0     1.0   21.1       0  2.9G    1.5G   0|0   1|0    1m     2m  399 NameOfTheRS  PRI 10:56:34
    32   351    150     59     279   820|0     1.1   21.1       0  2.9G    1.5G   0|0   2|0  797k     3m  399 NameOfTheRS  PRI 10:56:35
    26   290    112     38     250   729|0     1.1   21.1       0  2.9G    1.5G   0|0   2|0  679k     2m  399 NameOfTheRS  PRI 10:56:36
    28   311    138     54     260   837|0     1.1   21.6       0  2.9G    1.5G   0|0   1|0  763k     2m  400 NameOfTheRS  PRI 10:56:37
    22   363    101     41     191   683|0     1.1   21.6       0  2.9G    1.5G   0|0   1|0  616k     1m  400 NameOfTheRS  PRI 10:56:38
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    13   260     46     14      89   409|0     1.1   21.6       0  2.9G    1.5G   0|0   1|0  341k     1m  398 NameOfTheRS  PRI 10:56:39
    12   118     41     14      80   376|0     1.1   21.6       0  2.9G    1.5G   0|0   1|0  290k   589k  397 NameOfTheRS  PRI 10:56:40
    31   139    106     14     168   578|0     1.1   21.6       0  2.9G    1.5G   0|0   1|0  664k     1m  396 NameOfTheRS  PRI 10:56:41
     7   101     31     11      68   330|0     1.1   21.6       0  2.9G    1.5G   0|0   1|0  234k   513k  395 NameOfTheRS  PRI 10:56:42
     7    93     27     *0      53   333|0     1.1   21.6       0  2.9G    1.5G   0|1   1|0  233k   571k  394 NameOfTheRS  PRI 10:56:43
     6    58     23      2      51   306|0     1.1   21.6       0  2.9G    1.5G   0|0   1|0  189k     1m  394 NameOfTheRS  PRI 10:56:44
    11    91     39      8      74   360|0     1.1   21.6       0  2.9G    1.5G   0|0   1|1  290k   508k  394 NameOfTheRS  PRI 10:56:45
     8   220     33      2      79   356|0     1.1   21.6       0  2.9G    1.5G   0|0   1|0  319k     1m  393 NameOfTheRS  PRI 10:56:46
     2   122     14     *0      38   338|0     1.1   21.7       0  3.0G    1.5G   0|0   2|0  148k     1m  392 NameOfTheRS  PRI 10:56:47
     6    95     19      4      49   277|0     1.1   21.7       0  3.0G    1.5G   0|0   1|0  169k   391k  391 NameOfTheRS  PRI 10:56:48
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     7   129     33      8      82   338|0     1.1   21.7       0  3.0G    1.5G   0|0   1|0  245k     1m  390 NameOfTheRS  PRI 10:56:49
     7   125     24      4      51   302|0     1.1   21.8       0  3.0G    1.5G   0|0   1|0  214k   554k  389 NameOfTheRS  PRI 10:56:50
    11    47     28     10      63   336|0     1.1   21.8       0  3.0G    1.5G   0|0   1|0  196k   248k  388 NameOfTheRS  PRI 10:56:51
     3   192     28      2      45   295|0     1.1   21.8       0  3.0G    1.5G   0|0   1|0  190k   904k  387 NameOfTheRS  PRI 10:56:52
     6   119     31      5      71   322|0     0.3   21.8       1  2.9G    1.5G   0|0   1|0  238k   745k  386 NameOfTheRS  PRI 10:56:53
    13    18     41      6      60   284|0     0.5   21.8       0  2.9G    1.5G   0|2   1|2  266k   350k  385 NameOfTheRS  PRI 10:56:54
     6   145     34      2      59   328|0     0.5   21.8       0  2.9G    1.5G   0|1   1|0  240k   520k  384 NameOfTheRS  PRI 10:56:55
    15   162     68      4     138   490|0     0.6   21.8       0  2.9G    1.5G   0|0   1|0  472k     1m  383 NameOfTheRS  PRI 10:56:56
    22    61     72      9     116   419|0     0.6   21.8       0  2.9G    1.5G   0|0   1|0  471k   898k  382 NameOfTheRS  PRI 10:56:57
    11   156     45      2      76   352|0     0.4   21.6       0  2.9G    1.5G   0|0   1|0  339k   892k  381 NameOfTheRS  PRI 10:56:58
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     2   129     18      2      37   279|0     0.4   21.6       0  2.9G    1.5G   0|0   1|0  160k   529k  380 NameOfTheRS  PRI 10:56:59
    13   225     61     12     109   525|0     0.4   21.9       0  3.0G    1.5G   0|0   1|0  400k   781k  379 NameOfTheRS  PRI 10:57:00
    25   255     75     34     190   613|0     0.4   22.0       0  3.0G    1.5G   0|0   1|0  544k     2m  378 NameOfTheRS  PRI 10:57:01
    16   159     63     29     143   503|0     0.5   22.0       0  3.0G    1.5G   0|0   1|0  412k   759k  377 NameOfTheRS  PRI 10:57:02
    13   321     74     18     159   574|0     0.5   22.3       0  3.0G    1.5G   0|0   2|0  465k     1m  376 NameOfTheRS  PRI 10:57:03
    24   378    129     33     248   772|0     0.5   22.3       0  3.0G    1.5G   0|0   1|0  748k     3m  375 NameOfTheRS  PRI 10:57:04
    21   298     85     34     211   617|0     0.5   22.4       0  3.0G    1.5G   0|0   1|0  582k     2m  374 NameOfTheRS  PRI 10:57:05
    54   661    219     30     311   965|0     0.6   22.5       0  3.0G    1.5G   0|0   1|0    1m     4m  373 NameOfTheRS  PRI 10:57:06
    81   498    310     20     393  1066|0     0.7   22.6       0  3.0G    1.5G   0|0   1|0    2m     6m  373 NameOfTheRS  PRI 10:57:07
    70   550    280     44     430  1209|0     0.7   22.9       0  3.0G    1.6G  21|8   3|0    2m     5m  373 NameOfTheRS  PRI 10:57:08
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    58   572    250     65     392  1108|0     0.7   23.3       0  3.0G    1.6G  15|8   2|0    1m     4m  373 NameOfTheRS  PRI 10:57:09
    60   597    247     94     414  1179|0     0.8   23.8       0  3.0G    1.6G 19|14   2|0    1m     3m  373 NameOfTheRS  PRI 10:57:10
    60   629    258     96     429  1258|0     0.8   24.1       0  3.1G    1.6G   1|2   2|0    1m     3m  372 NameOfTheRS  PRI 10:57:11
    66   384    244    112     444  1195|0     0.8   24.7       0  3.1G    1.7G 21|10   3|0    1m     2m  371 NameOfTheRS  PRI 10:57:12
    64   524    224     94     402  1161|0     0.8   25.5       0  3.2G    1.7G 11|14   2|0    1m     2m  371 NameOfTheRS  PRI 10:57:13
    58   427    199     98     343  1090|0     0.8   26.2       0  3.2G    1.8G   0|4   3|0    1m     2m  370 NameOfTheRS  PRI 10:57:14
    44   432    177     71     347  1034|0     0.9   26.3       0  3.2G    1.8G   0|0   1|0    1m     2m  370 NameOfTheRS  PRI 10:57:15
    57   454    199     94     366  1138|0     0.9   26.4       0  3.2G    1.8G   1|1   2|1    1m     2m  370 NameOfTheRS  PRI 10:57:16
    54   561    194     78     358  1053|0     0.8   26.4       0  3.2G    1.8G   0|0   2|2    1m     2m  370 NameOfTheRS  PRI 10:57:17
    68   629    240    110     394  1248|0     0.8   26.6       0  3.2G    1.8G   0|1   1|0    1m     2m  370 NameOfTheRS  PRI 10:57:18
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    54   311    176     96     320   888|0     0.8   26.6       0  3.2G    1.8G   0|0   1|0  940k     1m  369 NameOfTheRS  PRI 10:57:19
    20   241     88     31     191   658|0     0.9   26.6       0  3.2G    1.8G   0|0   1|0  532k     2m  368 NameOfTheRS  PRI 10:57:20
    12   197     79     22     157   481|0     0.9   26.6       0  3.2G    1.8G   0|0   1|0  418k     1m  367 NameOfTheRS  PRI 10:57:21
     8    94     39     12      80   360|0     0.9   26.6       0  3.2G    1.8G   0|0   2|0  240k   848k  366 NameOfTheRS  PRI 10:57:22
    10   149     39     16      89   317|0     0.9   26.6       0  3.2G    1.8G   0|0   1|0  247k   839k  365 NameOfTheRS  PRI 10:57:23
    11   132     43     18      92   396|0     0.9   26.7       0  3.2G    1.8G   0|0   1|0  288k   542k  363 NameOfTheRS  PRI 10:57:24
     1   150     21      3      43   270|0     0.9   26.7       0  3.2G    1.8G   0|0   1|0  161k   447k  363 NameOfTheRS  PRI 10:57:25
     8   171     46      9     104   447|0     0.9   26.8       0  3.2G    1.8G   0|0   1|0  320k   656k  362 NameOfTheRS  PRI 10:57:26
    13   177     45     15      93   377|0     0.9   26.8       0  3.2G    1.8G   0|0   1|0  311k   851k  362 NameOfTheRS  PRI 10:57:27
     5   140     19      5      37   285|0     0.9   26.8       0  3.2G    1.8G   0|0   1|0  162k   685k  362 NameOfTheRS  PRI 10:57:28
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     1   114      7      2      19   195|0     0.9   26.8       0  3.2G    1.8G   0|0   1|0   97k   799k  362 NameOfTheRS  PRI 10:57:29
     1    52      3      2       8   224|0     0.9   26.8       0  3.2G    1.8G   0|0   1|0   63k   210k  362 NameOfTheRS  PRI 10:57:30
    *0    28      1     *0       4   157|0     0.9   26.8       0  3.2G    1.8G   0|0   1|0   36k   122k  362 NameOfTheRS  PRI 10:57:31
    *0    61      2     *0       7   246|0     0.9   26.8       0  3.2G    1.8G   0|0   1|0   67k   253k  362 NameOfTheRS  PRI 10:57:32
     2   135     19      2      34   228|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0  148k   444k  362 NameOfTheRS  PRI 10:57:33
     5   145     34      4      59   342|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0  203k   843k  362 NameOfTheRS  PRI 10:57:34
    12   135     53     18     112   382|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0  323k   849k  362 NameOfTheRS  PRI 10:57:35
     2    73     10      4      25   253|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0  106k   292k  362 NameOfTheRS  PRI 10:57:36
     2    59      4      2      12   193|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0   70k   217k  362 NameOfTheRS  PRI 10:57:37
     6    73     19      3      38   313|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0  143k   350k  361 NameOfTheRS  PRI 10:57:38
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     1    88     12     *0      25   204|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0  106k   587k  361 NameOfTheRS  PRI 10:57:39
    *0    97      4     *0      10   218|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0   83k   333k  361 NameOfTheRS  PRI 10:57:40
     3    25     15      6      35   237|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0  111k   168k  361 NameOfTheRS  PRI 10:57:41
     7   168     37      7      73   388|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0  251k   611k  361 NameOfTheRS  PRI 10:57:42
    13   126     34      8      67   333|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0  243k   458k  361 NameOfTheRS  PRI 10:57:43
     3   156     32     *0      62   379|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0  202k     1m  361 NameOfTheRS  PRI 10:57:44
     5    95     19      7      39   228|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0  143k   388k  361 NameOfTheRS  PRI 10:57:45
    *0    99      5     *0      12   260|0     0.9   26.9       0  3.2G    1.8G   0|0   1|0   94k   420k  361 NameOfTheRS  PRI 10:57:46
     6    30     14      4      30   303|0     0.9   26.9       0  3.3G    1.8G   0|0   1|1  122k   204k  361 NameOfTheRS  PRI 10:57:47
     4   201     38      7      74   401|0     0.9   26.9       0  3.3G    1.8G   0|0   1|0  254k   754k  361 NameOfTheRS  PRI 10:57:48
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     5    92     26      2      42   249|0     0.9   26.9       0  3.3G    1.8G   0|0   1|0  162k   482k  361 NameOfTheRS  PRI 10:57:49
     6   160     49     12      88   468|0     0.9   26.9       0  3.3G    1.8G   0|0   1|0  299k   686k  361 NameOfTheRS  PRI 10:57:50
     2    60     11      4      24   226|0     0.9   26.9       0  3.3G    1.8G   0|0   1|0  104k   223k  361 NameOfTheRS  PRI 10:57:51
     8   111     23      4      53   304|0     0.9   26.9       0  3.3G    1.8G   0|0   1|0  203k   401k  361 NameOfTheRS  PRI 10:57:52
    *0    79      4     *0       8   185|0     0.9   26.9       0  3.3G    1.8G   0|0   1|0   64k   319k  361 NameOfTheRS  PRI 10:57:53
    *0    36      1     *0       4   188|0     0.2   26.9       1  3.2G    1.8G   0|0   1|0   50k   122k  361 NameOfTheRS  PRI 10:57:54
     2    34      6      2      12   165|0     0.2   26.9       0  3.2G    1.8G   0|1   1|0   71k   136k  361 NameOfTheRS  PRI 10:57:55
     1    59      3     *0       8   229|0     0.3   26.9       0  3.2G    1.8G   0|0   1|0   67k   220k  361 NameOfTheRS  PRI 10:57:56
     2    63     16      4      32   232|0     0.3   26.9       0  3.2G    1.8G   0|0   1|0  119k   286k  361 NameOfTheRS  PRI 10:57:57
     3   169     32      5      67   338|0     0.5   26.9       0  3.2G    1.8G   0|0   1|0  216k     1m  361 NameOfTheRS  PRI 10:57:58
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     4    40     11      6      27   214|0     0.6   26.9       0  3.2G    1.8G   0|0   1|0  103k   169k  361 NameOfTheRS  PRI 10:57:59
     8   157     49     16     106   428|0     0.6   26.9       0  3.2G    1.8G   0|0   1|0  309k   700k  361 NameOfTheRS  PRI 10:58:00
     1   129     16      3      31   252|0     0.6   26.9       0  3.2G    1.8G   0|0   1|0  141k   435k  361 NameOfTheRS  PRI 10:58:01
     4    94     18      9      40   285|0     0.6   26.9       0  3.2G    1.8G   0|1   1|0  139k   360k  361 NameOfTheRS  PRI 10:58:02
    13   392    109     22     181   694|0     0.6   27.0       0  3.2G    1.8G   0|0   1|0  564k     1m  361 NameOfTheRS  PRI 10:58:03
    26   415    148     32     249   838|0     0.6   27.2       0  3.2G    1.8G   0|0   1|0  740k     3m  361 NameOfTheRS  PRI 10:58:04
    31   267    131     55     265   749|0     0.6   27.2       0  3.2G    1.8G   0|0   1|0  748k     1m  361 NameOfTheRS  PRI 10:58:05
    17   568    111     27     194   721|0     0.7   27.3       0  3.3G    1.8G   0|0   2|0  637k     3m  361 NameOfTheRS  PRI 10:58:06
    34   627    181     43     325   957|0     0.7   27.5       0  3.3G    1.8G   0|0   1|0  974k     5m  361 NameOfTheRS  PRI 10:58:07
    39   643    231     56     410  1152|0     0.8   27.6       0  3.3G    1.8G   0|0   1|0    1m     4m  361 NameOfTheRS  PRI 10:58:08
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    42   560    188     68     318   958|0     0.8   28.0       0  3.3G    1.9G   8|6   2|3  961k     3m  361 NameOfTheRS  PRI 10:58:09
    70   582    288    119     448  1211|0     0.8   28.4       0  3.3G    1.9G   0|0   1|0    1m     4m  362 NameOfTheRS  PRI 10:58:10
    56   524    226     92     369  1045|0     0.9   29.5       0  3.4G    1.9G 21|16   3|0    1m     3m  362 NameOfTheRS  PRI 10:58:11
    55   540    225     70     404  1156|0     0.7   30.3       0  3.4G    2.0G 17|19   2|0    1m     4m  365 NameOfTheRS  PRI 10:58:12
    69   503    285    123     472  1292|0     0.8   30.6       0  3.4G    2.0G   0|0   1|0    1m     3m  366 NameOfTheRS  PRI 10:58:13
    68   523    281    109     457  1241|0     0.8   30.8       0  3.5G    2.0G   7|5   4|0    1m     3m  366 NameOfTheRS  PRI 10:58:14
    64   517    222    101     367  1098|0     0.8   31.4       0  3.5G    2.1G  11|4   2|0    1m     2m  366 NameOfTheRS  PRI 10:58:15
    66   555    246    109     416  1165|0     0.8   31.6       0  3.5G    2.1G   0|0   2|0    1m     3m  366 NameOfTheRS  PRI 10:58:16
    56   422    208     86     372  1173|0     0.8   32.1       0  3.5G    2.1G   0|2   3|0    1m     2m  366 NameOfTheRS  PRI 10:58:17
    54   521    183     78     296   935|0     0.8   32.2       0  3.5G    2.1G   0|1   1|1  978k     2m  366 NameOfTheRS  PRI 10:58:18
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    58   375    194    101     355   978|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0    1m     2m  366 NameOfTheRS  PRI 10:58:19
    33   152    110     49     236   727|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  646k     2m  367 NameOfTheRS  PRI 10:58:20
     9    25     17     10      38   275|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  142k   170k  365 NameOfTheRS  PRI 10:58:21
    *0    50     *0     *0       3   180|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0   45k   227k  363 NameOfTheRS  PRI 10:58:22
    *0    51     *0     *0       1   193|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0   46k   198k  362 NameOfTheRS  PRI 10:58:23
     1   142     18     *0      37   266|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  161k   676k  361 NameOfTheRS  PRI 10:58:24
     3    58      6      2      17   197|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0   86k   265k  360 NameOfTheRS  PRI 10:58:25
    *0    37      2     *0      10   199|0     0.9   32.3       0  3.5G    2.1G   0|1   1|0   63k   148k  360 NameOfTheRS  PRI 10:58:26
     3   222      9      4      21   215|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  112k   340k  360 NameOfTheRS  PRI 10:58:27
     3   115     21      4      47   290|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  158k   955k  360 NameOfTheRS  PRI 10:58:28
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     2    70     22      4      36   269|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  128k   303k  360 NameOfTheRS  PRI 10:58:29
     3    74     22      7      44   271|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  149k   268k  360 NameOfTheRS  PRI 10:58:30
     3    39     16      6      35   259|0     0.9   32.3       0  3.5G    2.1G   0|1   1|0  122k   213k  360 NameOfTheRS  PRI 10:58:31
     4   106     25      3      43   275|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  164k   466k  360 NameOfTheRS  PRI 10:58:32
     2    59     12      2      19   236|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0   86k   262k  360 NameOfTheRS  PRI 10:58:33
     3   204     32      3      63   320|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  252k   721k  360 NameOfTheRS  PRI 10:58:34
     3   154     16      4      37   316|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  156k   730k  360 NameOfTheRS  PRI 10:58:35
    *0    84      2     *0       6   200|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0   68k   409k  360 NameOfTheRS  PRI 10:58:36
    *0    25      3     *0       7   236|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0   63k   113k  360 NameOfTheRS  PRI 10:58:37
    *0    88      7     *0      15   214|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0   78k   431k  360 NameOfTheRS  PRI 10:58:38
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     2   119     16     *0      34   286|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  144k     1m  360 NameOfTheRS  PRI 10:58:39
     5    59     22      9      48   300|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  153k   363k  360 NameOfTheRS  PRI 10:58:40
    *0     6      1     *0       3   215|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0   45k    69k  360 NameOfTheRS  PRI 10:58:41
     1    72      4      2      16   212|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0   81k   316k  360 NameOfTheRS  PRI 10:58:42
     3   101     14     *0      38   263|0     0.9   32.3       0  3.5G    2.1G   0|0   1|0  119k     1m  360 NameOfTheRS  PRI 10:58:43
     3    85     20      4      41   275|0     0.9   32.4       0  3.5G    2.1G   0|1   1|0  148k   936k  360 NameOfTheRS  PRI 10:58:44
    11   253     58     19     115   475|0     0.9   32.4       0  3.5G    2.1G   0|0   1|0  372k     1m  360 NameOfTheRS  PRI 10:58:45
     5   105     35     12      69   373|0     0.9   32.4       0  3.6G    2.1G   0|0   1|0  213k   440k  360 NameOfTheRS  PRI 10:58:46
     2    49      6      4      13   250|0     0.9   32.4       0  3.6G    2.1G   0|0   1|0   83k   255k  361 NameOfTheRS  PRI 10:58:47
     2   103      4     *0      10   202|0     0.9   32.4       0  3.6G    2.1G   0|0   1|0   87k   472k  361 NameOfTheRS  PRI 10:58:48
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    *0    28      3     *0       6   214|0     0.9   32.4       0  3.6G    2.1G   0|0   1|0   59k    98k  361 NameOfTheRS  PRI 10:58:49
     2    67     11      4      24   227|0     0.9   32.4       0  3.6G    2.1G   0|0   1|0  101k   259k  361 NameOfTheRS  PRI 10:58:50
     1    25      9      2      20   233|0     0.9   32.4       0  3.6G    2.1G   0|0   1|0   82k   174k  361 NameOfTheRS  PRI 10:58:51
     3   129     18      6      41   273|0     0.9   32.4       0  3.6G    2.1G   0|0   1|0  158k   604k  361 NameOfTheRS  PRI 10:58:52
     3   197     25      6      52   334|0     0.9   32.4       0  3.6G    2.1G   0|0   1|0  220k   629k  361 NameOfTheRS  PRI 10:58:53
    *0    53      2     *0       7   174|0     0.3   32.4       1  3.6G    2.1G   0|0   1|0   66k   156k  361 NameOfTheRS  PRI 10:58:54
     2    89     23      2      43   297|0     0.3   32.4       0  3.6G    2.1G   0|0   1|0  133k   779k  361 NameOfTheRS  PRI 10:58:55
     8    96     46     13      93   361|0     0.5   32.4       0  3.6G    2.1G   0|0   1|0  274k   639k  361 NameOfTheRS  PRI 10:58:56
     3    78     23      7      46   267|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0  147k   428k  361 NameOfTheRS  PRI 10:58:57
     1    73      5      4      19   202|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0   81k   311k  361 NameOfTheRS  PRI 10:58:58
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     1    17      3      2       9   187|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0   54k    89k  361 NameOfTheRS  PRI 10:58:59
     5    43     15      8      33   229|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0  116k   243k  361 NameOfTheRS  PRI 10:59:00
     1    11     *0      1       0   196|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0   37k   129k  361 NameOfTheRS  PRI 10:59:01
     2    32      8      8      29   184|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0   86k   148k  361 NameOfTheRS  PRI 10:59:02
     1   189     42      4      75   412|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0  242k   576k  361 NameOfTheRS  PRI 10:59:03
    21   108     81     40     152   474|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0  439k   682k  361 NameOfTheRS  PRI 10:59:04
     8    64     32      4      51   302|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0  235k   515k  361 NameOfTheRS  PRI 10:59:05
    *0    28     *0     *0       2   182|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0   39k   102k  361 NameOfTheRS  PRI 10:59:06
     1    70     14     *0      20   270|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0   95k   541k  361 NameOfTheRS  PRI 10:59:07
    12    91     48     23      80   350|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0  258k   631k  361 NameOfTheRS  PRI 10:59:08
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     4    58     12     *0      27   276|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0  125k   286k  361 NameOfTheRS  PRI 10:59:10
     5   174     36      4      83   343|0     0.6   32.4       0  3.6G    2.1G   0|0   1|0  229k     2m  361 NameOfTheRS  PRI 10:59:11
    14   112     56     22     128   487|0     0.7   32.5       0  3.6G    2.1G   0|0   1|0  355k   737k  361 NameOfTheRS  PRI 10:59:12
     7    55     29      8      57   295|0     0.7   32.5       0  3.6G    2.1G   0|0   1|0  180k   521k  361 NameOfTheRS  PRI 10:59:13
     5   297     42      9      78   389|0     0.7   32.5       0  3.6G    2.1G   3|4   2|0  283k     1m  361 NameOfTheRS  PRI 10:59:14
    16   593    130     12     238   789|0     0.7   32.8       0  3.6G    2.1G   0|0   1|0  722k     4m  361 NameOfTheRS  PRI 10:59:15
    55   651    208     49     373  1080|0     0.8   32.9       0  3.6G    2.1G   0|0   2|0    1m     5m  361 NameOfTheRS  PRI 10:59:16
    52   404    191     81     354  1032|0     0.8   33.1       0  3.6G    2.2G  11|6   2|0    1m     2m  361 NameOfTheRS  PRI 10:59:17
    46   330    179     77     345   994|0     0.8   33.3       0  3.6G    2.2G   0|0   1|0  977k     2m  361 NameOfTheRS  PRI 10:59:18
    54   300    204     99     345   993|0     0.8   33.6       0  3.6G    2.2G   0|9   3|2    1m     2m  362 NameOfTheRS  PRI 10:59:19
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    54   319    199     92     345   969|0     0.8   33.7       0  3.6G    2.2G   0|0   1|0    1m     2m  363 NameOfTheRS  PRI 10:59:20
    50   191    176     48     256   737|0     0.8   33.7       0  3.6G    2.2G   0|0   1|0  970k     2m  362 NameOfTheRS  PRI 10:59:21
    10   101     38     21      75   355|0     0.8   33.7       0  3.6G    2.2G   0|0   1|0  247k   459k  361 NameOfTheRS  PRI 10:59:22
    11    49     44      8      67   330|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  269k   523k  361 NameOfTheRS  PRI 10:59:23
    11    93     38     10      71   323|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  270k   551k  361 NameOfTheRS  PRI 10:59:24
     5    34     18     *0      26   224|0     0.9   33.7       0  3.6G    2.2G   0|0   1|1  150k   320k  361 NameOfTheRS  PRI 10:59:25
     5    26     13     *0      26   210|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  131k   265k  360 NameOfTheRS  PRI 10:59:26
     5    53     25      6      50   277|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  170k   301k  360 NameOfTheRS  PRI 10:59:27
    *0    49     *0     *0       3   162|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0   43k   167k  360 NameOfTheRS  PRI 10:59:28
     1     4      5     *0      12   186|0     0.9   33.7       0  3.6G    2.2G   0|1   1|0   63k    59k  360 NameOfTheRS  PRI 10:59:29
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     5   146     23     *0      42   256|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  206k   885k  360 NameOfTheRS  PRI 10:59:30
     5    93     28     10      61   309|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  180k   440k  360 NameOfTheRS  PRI 10:59:31
     2    36     12      2      20   228|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0   97k   163k  360 NameOfTheRS  PRI 10:59:32
     4    25     11      2      20   192|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  106k   196k  360 NameOfTheRS  PRI 10:59:33
     6    18     18     *0      27   204|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  150k   253k  360 NameOfTheRS  PRI 10:59:34
    11    32     29     *0      44   251|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  220k   403k  360 NameOfTheRS  PRI 10:59:35
    12    16     38     *0      59   272|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  280k   422k  360 NameOfTheRS  PRI 10:59:36
    13    83     55      2      77   335|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  359k   939k  360 NameOfTheRS  PRI 10:59:37
    17   162     58     *0     106   395|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  417k     2m  360 NameOfTheRS  PRI 10:59:38
     3    40     15      6      33   251|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  118k   152k  360 NameOfTheRS  PRI 10:59:39
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     4    50     16      8      34   254|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  117k   228k  360 NameOfTheRS  PRI 10:59:40
     3    92     15      2      37   283|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  129k   342k  360 NameOfTheRS  PRI 10:59:41
     6    38     16      5      38   278|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  134k   226k  360 NameOfTheRS  PRI 10:59:42
     2    26      2     *0       6   197|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0   52k   120k  360 NameOfTheRS  PRI 10:59:43
    *0    13     *0     *0       1   180|0     0.9   33.7       0  3.6G    2.2G   0|0   1|1   36k    70k  360 NameOfTheRS  PRI 10:59:44
     2   111     13     *0      24   247|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  138k   469k  360 NameOfTheRS  PRI 10:59:45
    13    82     55     *0      81   332|0     0.9   33.7       0  3.6G    2.2G   0|0   1|0  343k   989k  360 NameOfTheRS  PRI 10:59:46
    61    68    187      7     240   685|0     1.0   33.8       0  3.6G    2.2G   0|0   1|3    1m     2m  360 NameOfTheRS  PRI 10:59:47
    49   110    161      2     210   615|0     1.0   33.8       0  3.6G    2.2G   0|0   1|1  995k     2m  360 NameOfTheRS  PRI 10:59:48
    32    55     92      6     121   408|0     1.0   33.8       0  3.6G    2.2G   0|0   1|0  581k   915k  360 NameOfTheRS  PRI 10:59:49
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     6    75     23     *0      40   294|0     1.0   33.8       0  3.6G    2.2G   0|0   1|0  180k   401k  360 NameOfTheRS  PRI 10:59:50
     5   122     26      5      60   307|0     1.0   33.8       0  3.6G    2.2G   0|0   1|1  209k   603k  360 NameOfTheRS  PRI 10:59:51
     4    76     25      8      55   291|0     1.0   33.8       0  3.6G    2.2G   0|0   1|0  175k   494k  360 NameOfTheRS  PRI 10:59:52
    10    91     41      3      81   356|0     1.0   33.8       0  3.6G    2.2G   0|0   1|0  298k   785k  360 NameOfTheRS  PRI 10:59:53
     1    51      5     *0      12   228|0     1.0   33.8       0  3.6G    2.2G   0|0   1|0   81k   277k  360 NameOfTheRS  PRI 10:59:54
     1    52      3      2       8   155|0     1.0   33.8       0  3.6G    2.2G   0|0   1|0   60k   167k  360 NameOfTheRS  PRI 10:59:55
    *0    52      6     *0      11   226|0     0.2   33.8       1  3.7G    2.2G   0|0   1|0   80k   179k  360 NameOfTheRS  PRI 10:59:56
     4   117     19     *0      37   267|0     0.3   33.8       0  3.7G    2.2G   0|0   2|0  158k   706k  360 NameOfTheRS  PRI 10:59:57
     6   140     40      9      79   370|0     0.7   33.8       0  3.7G    2.2G   0|0   1|0  253k   836k  360 NameOfTheRS  PRI 10:59:58
    *0   101      5     *0      16   233|0     0.7   33.8       0  3.7G    2.2G   0|0   1|0  100k   461k  360 NameOfTheRS  PRI 10:59:59
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    *0    71      5      1      13   222|0     0.7   33.8       0  3.7G    2.2G   0|0   1|0   85k   210k  360 NameOfTheRS  PRI 11:00:00
     4    66     21      6      42   254|0     0.7   33.9       0  3.7G    2.2G   0|0   1|0  147k   238k  361 NameOfTheRS  PRI 11:00:01
     3    74     12      5      41   268|0     0.7   33.9       0  3.7G    2.2G   0|0   1|0  139k   352k  362 NameOfTheRS  PRI 11:00:02
     7    95     50      8      95   430|0     0.7   34.0       0  3.7G    2.2G   0|0   2|0  272k   750k  365 NameOfTheRS  PRI 11:00:03
     9   115    140     23     554   891|0     1.1   34.5       0  3.7G    2.2G   0|0   3|3  837k     2m  365 NameOfTheRS  PRI 11:00:04
     8   289    101     18     537   476|0     1.7   35.1       0  3.7G    2.3G   5|4   1|2  338k     8m  366 NameOfTheRS  PRI 11:00:05
    25   399    244     35     452   964|0     1.7   35.4       0  3.8G    2.3G   0|1   2|0  898k    10m  367 NameOfTheRS  PRI 11:00:06
    33   270    366     59     527  1341|0     1.6   35.4       0  3.8G    2.3G   0|0   4|1    1m     7m  367 NameOfTheRS  PRI 11:00:07
    19   286    401     40     555  1396|0     1.6   35.4       0  3.8G    2.3G   1|3   4|1    2m     6m  366 NameOfTheRS  PRI 11:00:08
    25   554    174     31     598   878|0     1.8   35.5       0  3.8G    2.3G   0|1   2|1  914k     6m  365 NameOfTheRS  PRI 11:00:09
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    30   541    187     44     363   863|0     1.9   35.7       0  3.8G    2.3G   9|8   2|0  835k     4m  364 NameOfTheRS  PRI 11:00:10
    40   523    200     65     340   961|0     1.9   36.3       0  3.8G    2.4G  13|9   2|0  984k     4m  364 NameOfTheRS  PRI 11:00:11
    48   461    227     76     389  1094|0     1.9   36.5       0  3.8G    2.4G   0|0   2|0    1m     4m  364 NameOfTheRS  PRI 11:00:12
    62   584    265    105     416  1144|0     2.0   36.5       0  3.8G    2.4G   0|0   2|0    1m     4m  364 NameOfTheRS  PRI 11:00:13
    65   453    259    103     421  1151|0     2.0   36.5       0  3.8G    2.4G   0|0   2|0    1m     4m  365 NameOfTheRS  PRI 11:00:14
    59   403    232    102     387  1080|0     2.0   36.6       0  3.8G    2.4G   0|0   2|0    1m     2m  365 NameOfTheRS  PRI 11:00:15
    59   268    203    112     331   945|0     2.0   36.6       0  3.8G    2.4G   0|0   1|0  997k     2m  365 NameOfTheRS  PRI 11:00:16
    15   211     91     24     180   659|0     2.0   36.6       0  3.8G    2.4G   0|0   2|1  525k     1m  365 NameOfTheRS  PRI 11:00:17
    22   152     98     45     180   650|0     2.1   36.6       0  3.8G    2.4G   0|0   1|0  531k   852k  365 NameOfTheRS  PRI 11:00:18
    16   120     62     32     137   527|0     2.1   36.6       0  3.8G    2.4G   0|2   2|0  392k   531k  364 NameOfTheRS  PRI 11:00:19
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     9   132     49     18      92   419|0     2.1   36.7       0  3.8G    2.4G   0|0   1|0  285k   704k  364 NameOfTheRS  PRI 11:00:20
     6   122     46     12     110   451|0     2.1   36.7       0  3.8G    2.4G   0|0   1|0  319k   544k  364 NameOfTheRS  PRI 11:00:21
    14   125     73     30     152   535|0     2.1   36.7       0  3.8G    2.4G   0|0   1|0  435k   656k  364 NameOfTheRS  PRI 11:00:22
    14   169     69     28     151   544|0     2.1   36.7       0  3.8G    2.4G   0|0   1|0  430k   674k  364 NameOfTheRS  PRI 11:00:23
     8   105     45     18      96   443|0     2.1   36.7       0  3.8G    2.4G   0|0   1|0  284k   486k  364 NameOfTheRS  PRI 11:00:24
    13   112     63     30     130   477|0     2.1   36.7       0  3.8G    2.4G   0|0   1|0  376k   577k  364 NameOfTheRS  PRI 11:00:25
    11   132     54     22     113   450|0     2.1   36.7       0  3.8G    2.4G   0|0   2|0  348k   550k  364 NameOfTheRS  PRI 11:00:26
     5    89     24      8      56   315|0     2.1   36.7       0  3.8G    2.4G   0|0   1|0  187k   383k  364 NameOfTheRS  PRI 11:00:27
     9   164     64     14     143   535|0     2.1   36.8       0  3.8G    2.4G   0|0   1|0  394k     1m  364 NameOfTheRS  PRI 11:00:28
    13   178     58     22     130   494|0     2.1   36.8       0  3.8G    2.4G   0|0   1|0  384k   630k  364 NameOfTheRS  PRI 11:00:29
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    18   119     86     40     173   583|0     2.1   36.8       0  3.8G    2.4G   0|0   1|0  467k   508k  364 NameOfTheRS  PRI 11:00:30
     6   142     49     12     114   464|0     2.1   36.8       0  3.8G    2.4G   0|0   1|0  319k   584k  364 NameOfTheRS  PRI 11:00:31
     6   159     50     13     100   439|0     2.1   36.8       0  3.8G    2.4G   0|0   1|1  309k   562k  364 NameOfTheRS  PRI 11:00:32
    14   217     66     28     144   533|0     2.1   36.8       0  3.8G    2.4G   0|0   1|0  434k     1m  364 NameOfTheRS  PRI 11:00:33
    10   168     54     20     130   488|0     2.0   36.6       0  3.8G    2.4G   0|0   1|0  377k   596k  364 NameOfTheRS  PRI 11:00:34
     7   167     49     14     106   479|0     2.0   36.6       0  3.8G    2.4G   0|0   1|0  322k   561k  364 NameOfTheRS  PRI 11:00:35
     6   132     41      8      93   409|0     2.0   36.6       0  3.8G    2.4G   0|0   1|0  266k   465k  364 NameOfTheRS  PRI 11:00:36
    10   106     53     18     120   480|0     2.0   36.6       0  3.8G    2.4G   0|0   1|0  338k   416k  364 NameOfTheRS  PRI 11:00:37
    19    99     69     32     133   511|0     2.0   36.6       0  3.8G    2.4G   0|0   1|0  388k   419k  364 NameOfTheRS  PRI 11:00:38
    11   159     60     16     142   531|0     2.0   36.6       0  3.8G    2.4G   0|0   1|0  416k   703k  364 NameOfTheRS  PRI 11:00:39
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    15   138     54     20     109   446|0     2.0   36.7       0  3.8G    2.4G   0|0   2|0  356k   596k  364 NameOfTheRS  PRI 11:00:40
     9    23     29     14      64   319|0     2.0   36.7       0  3.8G    2.4G   0|0   2|0  211k   221k  364 NameOfTheRS  PRI 11:00:41
     8   143     58     10     116   440|0     2.0   36.7       0  3.8G    2.4G   0|0   1|0  341k   998k  364 NameOfTheRS  PRI 11:00:42
    26   169     83     21     167   644|0     2.0   37.7       0  3.9G    2.4G   0|0   2|0  519k     1m  364 NameOfTheRS  PRI 11:00:43
    20   160     51     17     103   566|0     2.0   37.7       0  3.9G    2.4G   0|0   2|0  350k   714k  364 NameOfTheRS  PRI 11:00:44
     2   151     52      3     101   515|0     2.1   37.7       0  3.9G    2.4G   0|0   1|0  319k   905k  364 NameOfTheRS  PRI 11:00:45
     3   149     32      2      64   407|0     2.1   37.8       0  3.9G    2.4G   0|0   1|0  233k     1m  364 NameOfTheRS  PRI 11:00:46
     9   144     54      7     115   581|0     2.1   37.8       0  3.9G    2.4G   0|0   1|0  378k   594k  364 NameOfTheRS  PRI 11:00:47
     6   178     62     13     129   519|0     2.1   37.8       0  3.9G    2.4G   0|0   1|0  369k     1m  364 NameOfTheRS  PRI 11:00:48
    10   151     54      6     104   531|0     2.1   37.8       0  3.9G    2.4G   0|0   1|0  358k   550k  364 NameOfTheRS  PRI 11:00:49
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     7   150     42     13     105   436|0     2.1   37.8       0  3.9G    2.4G   0|0   1|0  336k   616k  362 NameOfTheRS  PRI 11:00:50
     9   120     23     10      56   301|0     2.1   37.8       0  3.9G    2.4G   0|0   1|0  205k   488k  362 NameOfTheRS  PRI 11:00:51
     9    59     28      6      78   337|0     2.1   37.8       0  3.9G    2.4G   0|0   1|0  233k   330k  362 NameOfTheRS  PRI 11:00:52
    11   109     37     11      67   354|0     2.1   37.8       0  3.9G    2.4G   0|0   1|0  228k   558k  362 NameOfTheRS  PRI 11:00:53
     2    33     11      3      23   204|0     2.1   37.8       0  3.9G    2.4G   0|0   1|0  100k   184k  362 NameOfTheRS  PRI 11:00:54
     6   130     22      4      48   283|0     2.1   37.8       0  3.9G    2.4G   0|0   1|0  172k     1m  362 NameOfTheRS  PRI 11:00:55
     5   149     33     10      62   311|0     0.6   37.7       1  3.9G    2.4G   0|0   1|0  219k   543k  362 NameOfTheRS  PRI 11:00:56
    10    51     36     16      95   361|0     0.9   37.7       0  3.9G    2.4G   0|0   1|0  259k   238k  362 NameOfTheRS  PRI 11:00:57
     2    80     15      2      35   236|0     0.8   37.7       0  3.9G    2.4G   0|0   1|0  126k   703k  362 NameOfTheRS  PRI 11:00:58
     3    67     15      2      27   264|0     0.7   37.7       0  3.9G    2.4G   0|0   1|0  131k   232k  362 NameOfTheRS  PRI 11:00:59
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
     2   114     21      3      42   287|0     0.5   37.7       0  3.9G    2.4G   0|0   1|0  157k     1m  362 NameOfTheRS  PRI 11:01:00
     6    79     32     10      73   322|0     0.5   37.7       0  3.9G    2.4G   0|0   2|0  206k     1m  362 NameOfTheRS  PRI 11:01:01
     4    54     19     10      60   292|0     0.5   37.7       0  3.9G    2.4G   0|0   1|0  171k   256k  362 NameOfTheRS  PRI 11:01:02
     5   176     51      5      90   431|0     0.5   37.7       0  3.9G    2.4G   0|0   1|1  293k   652k  362 NameOfTheRS  PRI 11:01:03
    34   376    172     44     291   894|0     0.5   37.7       0  3.9G    2.4G   0|0   1|0  859k     2m  362 NameOfTheRS  PRI 11:01:04
    15    98     41     30      75   330|0     0.5   37.7       0  3.9G    2.4G   0|0   1|0  261k   451k  362 NameOfTheRS  PRI 11:01:05
     2   302     25      2      51   337|0     0.5   38.0       0  3.9G    2.5G   7|9   3|0  214k     2m  362 NameOfTheRS  PRI 11:01:06
    22   417    146     19     264   781|0     0.5   38.5       0  3.9G    2.5G   0|0   1|0  736k     5m  362 NameOfTheRS  PRI 11:01:07
    40   305    170     71     297   837|0     0.6   38.5       0  3.9G    2.5G   0|0   1|0  852k     2m  362 NameOfTheRS  PRI 11:01:08
    34   248    151     59     267   775|0     0.6   38.6       0  3.9G    2.5G   0|0   1|0  764k     2m  362 NameOfTheRS  PRI 11:01:09
insert query update delete getmore command % dirty % used flushes vsize     res qr|qw ar|aw netIn netOut conn      set repl     time
    46   261    179     76     316   885|0     0.6   38.6       0  3.9G    2.5G   0|0   1|0  912k     2m  362 NameOfTheRS  PRI 11:01:10
    25   249    100     38     194   623|0     0.6   38.6       0  3.9G    2.5G   0|0   1|0  587k     1m  362 NameOfTheRS  PRI 11:01:11
    18   247     82     29     166   570|0     0.6   38.6       0  3.9G    2.5G   0|0   1|0  509k     1m  362 NameOfTheRS  PRI 11:01:12
    10   123     32     14      55   316|0     0.6   38.6       0  3.9G    2.5G   0|1   1|0  228k   578k  362 NameOfTheRS  PRI 11:01:13
    13    43     31     14      66   329|0     0.6   38.6       0  3.9G    2.5G   0|0   1|0  212k   218k  362 NameOfTheRS  PRI 11:01:14
     4    89     14      8      23   249|0     0.6   38.6       0  3.9G    2.5G   0|0   1|1  120k   310k  362 NameOfTheRS  PRI 11:01:15
     8   161     29      8      67   316|0     0.6   38.6       0  3.9G    2.5G   0|0   1|0  236k   575k  362 NameOfTheRS  PRI 11:01:16
     3    37     12      6      22   292|0     0.6   38.6       0  3.9G    2.5G   0|0   1|0  113k   168k  362 NameOfTheRS  PRI 11:01:17
     1   100     10      2      30   262|0     0.6   38.6       0  3.9G    2.5G   0|0   1|0  125k   309k  362 NameOfTheRS  PRI 11:01:18
     9    31     28     10      62   328|0     0.6   38.6       0  3.9G    2.5G   0|0   1|0  191k   204k  362 NameOfTheRS  PRI 11:01:19

In the attachments you can find some graphs of the CPU and a specific zoom on the iowait (which, as you can see it is not a factor).



 Comments   
Comment by Ramon Fernandez Marina [ 25/Aug/15 ]

Hi MirkoBonadei,

I'm going to close this ticket for now since we haven't heard back from you in a while. Please note we released MongoDB 3.0.6 earlier this week, so if after upgrading to 3.0.6 the behavior you describe still persists then collect the data above and let us know so we can reopen this ticket and investigate further.

Thanks,
Ramón.

Comment by Ramon Fernandez Marina [ 10/Aug/15 ]

Thanks for getting back to us MirkoBonadei; I'll keep this ticket in the "waiting for user input" state until you come back and have a chance to collect data. You may want to watch SERVER-19485 and SERVER-19522 for updates.

Regards,
Ramón.

Comment by Mirko Bonadei [X] [ 10/Aug/15 ]

Hi Ramon, thank you for the detailed answer.

In these days we are upgrading all our servers to the version 3.0.5 since we have seen this bugfix SERVER-18875.
In the meantime, after the removal from our codebase of all the evals, the performance issue is less insistent.

I will be far from the office for some days, but when I will be back I will collect the data you have required.

I agree that SERVER-19485 is really similar to our issue and that SERVER-19522 smells like a possible fix.

Thank you,

Mirko

Comment by Ramon Fernandez Marina [ 10/Aug/15 ]

By the way, SERVER-19485 looks very similar to this ticket. As mentioned by Michael, the root cause could be capped collection performance issues as described in SERVER-19522, for which a fix is in the works.

Comment by Ramon Fernandez Marina [ 10/Aug/15 ]

Hi MirkoBonadei, apologies for the late reply. From the additional information is difficult to understand how much of the original issue was addressed by 3.0.4 and what's remaining – or whether 3.0.4 introduced a different performance problem. In these cases we ask users to collect timeseries data as follows:

mongo --eval "while(true) {print(JSON.stringify(db.serverStatus({tcmalloc:1}))); sleep(10000)}" > ss-10s.log &
iostat -k -t -x 10 > iostat-10s.log &

These commands will collect data about mongod and your system at 10-second intervals and store it in the files ss.log and iostat.log. Since you mention the high CPU peaks happen 100-150 hours apart, increasing the interval may allow you to run these commands continuously since restart, and this may provide an indication of the CPU usage trend over time.

In addition, it would be very useful to see a higher-resolution data capture when the problem appears, for which I'd like to ask you to re-run these commands when the high CPU usage peak starts to appear:

mongo --eval "while(true) {print(JSON.stringify(db.serverStatus({tcmalloc:1}))); sleep(1000)}" > ss-1s.log &
iostat -k -t -x 1 >iostat-1s.log &

Can you please run the commands above and send us the resulting logs? The output of dbServerStatus as collected above should help us determine if eval is indeed to blame; this data should also help us understand if this is one of the performance issues we're already investigating or if you've found a new issue.

Thanks,
Ramón.

Comment by Mirko Bonadei [X] [ 13/Jul/15 ]

Hi Ramon, after a couple of weeks of testing 3.0.4 on production I can update you.

The problem persists and we have also upgraded the server to an EC2 R3 xlarge instance (4 cores and 30 GB of RAM). I can tell you that the problem happens less often but it is still there. An interesting thing is that with the 2 cores instance the server was knocked out with a "%CPU" from the `top -c` command of 200%, while now, with 4 cores it is 100%.
It seems that the issue happens but the server cannot exploit the other 2 cores.

Another important information is that we have a library which uses the `eval` command, which is deprecated. I am working to remove it, do you think that the `eval` command which takes the global lock can be part of the problem?

Thanks,
Mirko

Comment by Ramon Fernandez Marina [ 01/Jul/15 ]

MirkoBonadei, have you had a chance to re-test with 3.0.4 and see if the high CPU usage issue has been resolved or still persists? Please let us know either way so we can determine the next step on this ticket.

Thanks,
Ramón.

Comment by Mirko Bonadei [X] [ 24/Jun/15 ]

Hi Ramon, we are upgrading our nodes in this moment. I think we can have some good data on Monday.

Here is another chunk of information from this night issue (we were still on 3.0.2 but it can be valuable to annotate):

insert query update delete getmore command % dirty % used flushes vsize  res  qr|qw ar|aw netIn netOut conn      set repl     time
    42   501    234    117      57   428|0    43.7   98.4       0  9.1G 6.3G 69|100   1|8  458k     4m  443 OnebipRS  PRI 00:51:04
    18   295    102     44      43   331|0    43.8   98.4       0  9.1G 6.3G 152|231  1|18  223k     2m  442 OnebipRS  PRI 00:51:05
    43   366    202     78      40   439|0    43.8   98.4       0  9.1G 6.3G 113|213   1|0  434k     3m  441 OnebipRS  PRI 00:51:06
    43   415    225     66      58   456|0    43.8   98.3       0  9.1G 6.3G  75|204  7|10  508k     3m  441 OnebipRS  PRI 00:51:07
    35   399    140     44      35   421|0    43.6   98.3       0  9.1G 6.3G 135|151  1|23  393k     2m  440 OnebipRS  PRI 00:51:08
    38   382    192     75      41   438|0    43.6   98.2       0  9.1G 6.3G 133|298   1|1  404k     2m  439 OnebipRS  PRI 00:51:09
    68   470    295     86      55   488|0    43.7   98.2       0  9.1G 6.3G  77|117  2|17  692k     3m  439 OnebipRS  PRI 00:51:10
q    43   285    157     75      36   300|0    43.4   97.9       0  9.1G 6.3G 119|226  2|16  352k     2m  438 OnebipRS  PRI 00:51:11
    50   349    254     81      45   496|0    43.1   97.7       0  9.1G 6.3G  99|257   1|0  524k     3m  438 OnebipRS  PRI 00:51:12
    60   310    208     98      44   348|0    43.2   97.7       0  9.1G 6.3G  84|107  1|32  449k     3m  436 OnebipRS  PRI 00:51:13

Comment by Ramon Fernandez Marina [ 22/Jun/15 ]

Thanks MirkoBonadei; just in case you're not familiar with the upgrade process, you can do a rolling upgrade without downtime. Look forward to hearing from you when the upgrade is done.

Comment by Mirko Bonadei [X] [ 22/Jun/15 ]

Hi Ramon Fernandez, sure. We start the upgrade procedure on our servers. It will take some days. I will be back to you as soon as I have some good data.

Comment by Ramon Fernandez Marina [ 22/Jun/15 ]

MirkoBonadei, the first step is to upgrade your nodes to 3.0.4, which contains numerous fixes related to performance since 3.0.2. Can you please upgrade to 3.0.4 and let us know if the problem persists? If it does we'll move on to the next step.

Thanks,
Ramón.

Comment by Mirko Bonadei [X] [ 22/Jun/15 ]

Operating System is: Ubuntu 12.04.4 LTS

Generated at Thu Feb 08 03:49:41 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.