Priority: Major - P3
Resolution: Gone away
Affects Version/s: 3.6.10, 3.6.11
Fix Version/s: None
Comparing v3.4.17 and v3.6.11
As our team is planning to upgrade mongodb from v3.4 to v3.6, we ran performance test to compare behavior between the two versions. We have 2 mongodb clusters in v3.4.17 and 2 mongodb clusters in v3.6.11, running the same workload across the 4 mongodb clusters. (Our workload is consist of only background jobs, processing same amount of data and operations)
**From our comparisons, we see significant regression in # of open file descriptors. There seems to be a clear trend, rapid leak rate of file descriptor in v3.6.11. (See comparison below - for # open file descriptors on mongodb primaries)
We are paying extra attention to file descriptor because it has been one of the main issues in our mongodb clusters. We had been having slow rate of file descriptor leak in v3.4, which results in memory leak, causing cache to go over 80% after long period of time, and performance degrades over time. With the help from mongodb onsite support, we found that we had file descriptor leak because our workload drop collections and create new collections often, causing the leak in session cache. We requested https://jira.mongodb.org/browse/SERVER-38779 to be backport-ed to v3.6.11. However, even with this fix, we are still seeing significantly higher rate of file descriptor leak in v3.6.11 comparing to v3.4.17 on the same workload. We are suspecting that other bugs are causing file descriptor leak in mongodb v3.6.