Uploaded image for project: 'Evergreen'
  1. Evergreen
  2. EVG-352

Duplicate agent processes

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v1
    • Component/s: None
    • Labels:
      None

      Description

      So far only seen on OS X VM's and seeming to correlate with timeout failures.

      I'm running this on all os x machines to grab threaddumps and kill extra agents:

      for pid in $(ps auwx | grep main | sort -r -n -k 1 | grep -v grep | awk '{print $2}'  | tail -n +2 ); do current_lines=$(wc -l < /data/mci/agent.log | tr -d \ ); kill -3 $pid; sleep 5; ps -wwwww $pid > $(hostname)-$pid-threaddump.txt ; tail -n +$current_lines /data/mci/agent.log >> $(hostname)-$pid-threaddump.txt; echo $(hostname)-$pid-threaddump.txt; kill $pid ; ps -www $pid ; done
      

        Attachments

        1. bs-osx108-1-53156-threaddump.txt
          34 kB
        2. bs-osx108-1-54701-threaddump.txt
          9 kB
        3. bs-osx108-1-65243-threaddump.txt
          84 kB
        4. bs-osx108-2-10097-threaddump.txt
          9 kB
        5. bs-osx108-2-6144-threaddump.txt
          76 kB
        6. bs-osx108-3-23263-threaddump.txt
          157 kB
        7. bs-osx108-3-39305-threaddump.txt
          43 kB
        8. bs-osx108-4-61813-threaddump.txt
          9 kB
        9. bs-osx108-4-72337-threaddump.txt
          34 kB
        10. bs-osx108-4-82608-threaddump.txt
          204 kB
        11. bs-osx108-5-30127-threaddump.txt
          9 kB
        12. bs-osx108-5-34612-threaddump.txt
          9 kB
        13. bs-osx108-5-7587-threaddump.txt
          9 kB
        14. bs-osx108-5-8100-threaddump.txt
          161 kB
        15. bs-osx108-6-49676-threaddump.txt
          18 kB
        16. bs-osx108-7-10076-threaddump.txt
          75 kB
        17. bs-osx108-7-48128-threaddump.txt
          9 kB
        18. bs-osx108-7-48960-threaddump.txt
          26 kB
        19. bs-osx108-7-51657-threaddump.txt
          59 kB
        20. bs-osx108-7-56233-threaddump.txt
          17 kB
        21. bs-osx108-7-65532-threaddump.txt
          19 kB
        22. bs-osx108-7-74178-threaddump.txt
          52 kB
        23. bs-osx108-8-10111-threaddump.txt
          33 kB
        24. bs-osx108-8-30874-threaddump.txt
          61 kB
        25. mci-osx108-11.build.10gen.cc-65041-threaddump.txt
          18 kB
        26. mci-osx108-2.build.10gen.cc-78241-threaddump.txt
          85 kB
        27. mci-osx108-3.build.10gen.cc-15516-threaddump.txt
          18 kB
        28. mci-osx108-3.build.10gen.cc-57802-threaddump.txt
          18 kB
        29. mci-osx108-3.build.10gen.cc-59540-threaddump.txt
          26 kB
        30. mci-osx108-5.build.10gen.cc-16083-threaddump.txt
          9 kB
        31. mci-osx108-5.build.10gen.cc-28470-threaddump.txt
          9 kB
        32. mci-osx108-5.build.10gen.cc-29403-threaddump.txt
          45 kB
        33. mci-osx108-5.build.10gen.cc-41563-threaddump.txt
          9 kB
        34. mci-osx108-5.build.10gen.cc-51477-threaddump.txt
          109 kB
        35. mci-osx108-7.build.10gen.cc-83341-threaddump.txt
          9 kB
        36. mci-osx108-8.build.10gen.cc-90220-threaddump.txt
          44 kB
        37. mci-osx108-9.build.10gen.cc-116-threaddump.txt
          42 kB
        38. mci-osx108-9.build.10gen.cc-14629-threaddump.txt
          9 kB
        39. mci-osx108-9.build.10gen.cc-21266-threaddump.txt
          43 kB
        40. mci-osx108-9.build.10gen.cc-22499-threaddump.txt
          43 kB
        41. mci-osx108-9.build.10gen.cc-46682-threaddump.txt
          26 kB
        42. ny-osx-2-2203-stacktrace.txt
          513 kB
        43. stacktrace.log
          1.64 MB

          Issue Links

            Activity

              People

              Assignee:
              shraya.ramani Shraya Ramani
              Reporter:
              ernie.hershey Ernie Hershey
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: