Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-76986

config server restart ( Out of memory) continuously after upgrading to mongodb-sharded:6.0.5

    • Type: Icon: Bug Bug
    • Resolution: Won't Do
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • ALL

      Hi , 

       

      We have sharded cluster using bitnami helm chart deployment  : 

      https://github.com/bitnami/charts/tree/main/bitnami/mongodb-sharded 

       

      We just upgrade our cluster to 6.0.5 ( previous version is mongodb-sharded:4.4.1 ) .

       

      before the upgrade : 

      1- config server was stable with 2Gi memory 

       

      After the upgrade ( create a new cluster and restore the dump to the new cluster )  :

      1- the config server keeps consuming the memory then hitting the limit of memory capacity => config server pod ( deployed on k8s ) restart :

      dmesg -T : 

      [Wed May 10 10:34:28 2023] Memory cgroup out of memory: Kill process 29734 (conn2890) score 1615 or sacrifice child
      [Wed May 10 10:34:28 2023] Killed process 186708 (mongod), UID 1001, total-vm:12369392kB, anon-rss:9388828kB, file-rss:33772kB, shmem-rss:0kB

      mongo sys info : 
      {
        system:

      {     currentTime: ISODate("2023-05-10T10:55:30.141Z"),     hostname: 'mongo-distrib-prod-configsvr-0',     cpuAddrSize: 64,     memSizeMB: Long("23912"),     memLimitMB: Long("9216"),     numCores: 16,     numPhysicalCores: 16,     numCpuSockets: 8,     cpuArch: 'x86_64',     numaEnabled: false,     numNumaNodes: 1   }

      ,

      2- increased from 2 Gi to 5Gi => 9Gi ( without success ) .

      3- the same DB ( same version and helm chart )   is deployed on different ENV ( different workload ) and is working well 

      Any suggestion please ?

       

       

      Thank you 

       

            Assignee:
            Unassigned Unassigned
            Reporter:
            achraf.bouaouda.cdg.capital@gmail.com achraf-CDG-CAPITAL bouaouda
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: