Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v2017.02.01
    • Component/s: amboy, greenbay
    • Labels:
      None
    • Sprint:
      Evergreen 2017-01-23

      Description

      Amboy recently has added support for a REST interface to queues, with tools for building servers and clients in applications. This ticket covers exploring the use of existing implementation and tools (e.g. amboy, greenbay, etc.) to power a distributed monitoring data collection tool.

      A greenbay daemon would run on hosts, listening for requests over HTTP (https?) using Amboy's remote queue service. A client would then generate and submit jobs and to each queue, and then, later, check back and collect results.

      For a proof of concept, I think we would just need to implement:

      • a command line entry point in greenbay that would start a job service.
      • a method on greenbay's "App" type that would submit jobs to a remote queue at a specified location
      • a command line entry point to submit jobs to the remote host and wait for the response.

      The above accounts for a very small amount of code, using existing and well tested components. I think to "productionize" this I think we just need to:

      • decouple job-submission and response collection
      • devise some method for the client that's submitting jobs to collect and report results
      • integrate, in some way, to nagios.

        Activity

        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {'email': 'garen@tychoish.com', 'username': 'tychoish', 'name': 'tycho garen'}

        Message: MAKE-131 MAKE-137: improvements to wait handlers and rest interface
        Branch: master
        https://github.com/mongodb/amboy/commit/1b24013b1ee9d31e1acde9720c104db4f0f2e258

        Show
        xgen-internal-githook Githook User added a comment - Author: {'email': 'garen@tychoish.com', 'username': 'tychoish', 'name': 'tycho garen'} Message: MAKE-131 MAKE-137 : improvements to wait handlers and rest interface Branch: master https://github.com/mongodb/amboy/commit/1b24013b1ee9d31e1acde9720c104db4f0f2e258
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {'name': 'tycho garen', 'username': 'tychoish', 'email': 'garen@tychoish.com'}

        Message: MAKE-131: update vendoring
        Branch: master
        https://github.com/mongodb/amboy/commit/fef06792a99996cdf558314a510b7c683b8f933a

        Show
        xgen-internal-githook Githook User added a comment - Author: {'name': 'tycho garen', 'username': 'tychoish', 'email': 'garen@tychoish.com'} Message: MAKE-131 : update vendoring Branch: master https://github.com/mongodb/amboy/commit/fef06792a99996cdf558314a510b7c683b8f933a
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {'name': 'tycho garen', 'email': 'garen@tychoish.com', 'username': 'tychoish'}

        Message: MAKE-131: greenbay service and client
        Branch: master
        https://github.com/mongodb/greenbay/commit/45c06aa86e74bb6a5922535dfeed7098675597cd

        Show
        xgen-internal-githook Githook User added a comment - Author: {'name': 'tycho garen', 'email': 'garen@tychoish.com', 'username': 'tychoish'} Message: MAKE-131 : greenbay service and client Branch: master https://github.com/mongodb/greenbay/commit/45c06aa86e74bb6a5922535dfeed7098675597cd
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {'name': 'tycho garen', 'email': 'garen@tychoish.com', 'username': 'tychoish'}

        Message: MAKE-131: update vendoring
        Branch: master
        https://github.com/mongodb/greenbay/commit/2a86464dcebfda839889469b92e7175a68847129

        Show
        xgen-internal-githook Githook User added a comment - Author: {'name': 'tycho garen', 'email': 'garen@tychoish.com', 'username': 'tychoish'} Message: MAKE-131 : update vendoring Branch: master https://github.com/mongodb/greenbay/commit/2a86464dcebfda839889469b92e7175a68847129
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {'name': 'tycho garen', 'email': 'garen@tychoish.com', 'username': 'tychoish'}

        Message: MAKE-131: host should be configurable
        Branch: master
        https://github.com/mongodb/greenbay/commit/302e5c4f05bbc060cf9d8f4a059a841c7e2bd7be

        Show
        xgen-internal-githook Githook User added a comment - Author: {'name': 'tycho garen', 'email': 'garen@tychoish.com', 'username': 'tychoish'} Message: MAKE-131 : host should be configurable Branch: master https://github.com/mongodb/greenbay/commit/302e5c4f05bbc060cf9d8f4a059a841c7e2bd7be
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {'name': 'Sam Kleinman', 'email': 'sam@10gen.com', 'username': 'tychoish'}

        Message: MAKE-131: fix to compile and lint
        Branch: master
        https://github.com/mongodb/greenbay/commit/206b41644ab11577e1e9d486ab9cde070e8f2013

        Show
        xgen-internal-githook Githook User added a comment - Author: {'name': 'Sam Kleinman', 'email': 'sam@10gen.com', 'username': 'tychoish'} Message: MAKE-131 : fix to compile and lint Branch: master https://github.com/mongodb/greenbay/commit/206b41644ab11577e1e9d486ab9cde070e8f2013

          People

          • Assignee:
            sam.kleinman Sam Kleinman
            Reporter:
            sam.kleinman Sam Kleinman
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

                Agile