[MAKE-131] Remote Operated Greenbay Created: 11/Dec/16  Updated: 03/Jan/17  Resolved: 03/Jan/17

Status: Resolved
Project: Make
Component/s: amboy, greenbay
Affects Version/s: None
Fix Version/s: v2017.02.01

Type: New Feature Priority: Major - P3
Reporter: Sam Kleinman Assignee: Sam Kleinman
Resolution: Fixed Votes: 0
Labels: None

Sprint: Evergreen 2017-01-23

 Description   

Amboy recently has added support for a REST interface to queues, with tools for building servers and clients in applications. This ticket covers exploring the use of existing implementation and tools (e.g. amboy, greenbay, etc.) to power a distributed monitoring data collection tool.

A greenbay daemon would run on hosts, listening for requests over HTTP (https?) using Amboy's remote queue service. A client would then generate and submit jobs and to each queue, and then, later, check back and collect results.

For a proof of concept, I think we would just need to implement:

  • a command line entry point in greenbay that would start a job service.
  • a method on greenbay's "App" type that would submit jobs to a remote queue at a specified location
  • a command line entry point to submit jobs to the remote host and wait for the response.

The above accounts for a very small amount of code, using existing and well tested components. I think to "productionize" this I think we just need to:

  • decouple job-submission and response collection
  • devise some method for the client that's submitting jobs to collect and report results
  • integrate, in some way, to nagios.


 Comments   
Comment by Githook User [ 29/Dec/16 ]

Author:

{'email': 'garen@tychoish.com', 'username': 'tychoish', 'name': 'tycho garen'}

Message: MAKE-131 MAKE-137: improvements to wait handlers and rest interface
Branch: master
https://github.com/mongodb/amboy/commit/1b24013b1ee9d31e1acde9720c104db4f0f2e258

Comment by Githook User [ 03/Jan/17 ]

Author:

{'name': 'tycho garen', 'username': 'tychoish', 'email': 'garen@tychoish.com'}

Message: MAKE-131: update vendoring
Branch: master
https://github.com/mongodb/amboy/commit/fef06792a99996cdf558314a510b7c683b8f933a

Comment by Githook User [ 03/Jan/17 ]

Author:

{'name': 'tycho garen', 'email': 'garen@tychoish.com', 'username': 'tychoish'}

Message: MAKE-131: greenbay service and client
Branch: master
https://github.com/mongodb/greenbay/commit/45c06aa86e74bb6a5922535dfeed7098675597cd

Comment by Githook User [ 03/Jan/17 ]

Author:

{'name': 'tycho garen', 'email': 'garen@tychoish.com', 'username': 'tychoish'}

Message: MAKE-131: update vendoring
Branch: master
https://github.com/mongodb/greenbay/commit/2a86464dcebfda839889469b92e7175a68847129

Comment by Githook User [ 03/Jan/17 ]

Author:

{'name': 'tycho garen', 'email': 'garen@tychoish.com', 'username': 'tychoish'}

Message: MAKE-131: host should be configurable
Branch: master
https://github.com/mongodb/greenbay/commit/302e5c4f05bbc060cf9d8f4a059a841c7e2bd7be

Comment by Githook User [ 03/Jan/17 ]

Author:

{'name': 'Sam Kleinman', 'email': 'sam@10gen.com', 'username': 'tychoish'}

Message: MAKE-131: fix to compile and lint
Branch: master
https://github.com/mongodb/greenbay/commit/206b41644ab11577e1e9d486ab9cde070e8f2013

Generated at Mon Nov 19 02:48:03 UTC 2018 using Jira 7.12.1#712002-sha1:609a50578ba6bc73dbf8b05dddd7c04a04b6807c.