Gracefully exit the Compass Assistant tool call evaluation suite

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Unresolved
    • Priority: Minor - P4
    • None
    • Affects Version/s: None
    • Component/s: None
    • Environment:
      OS:
      node.js / npm versions:
      Additional info:
    • None
    • None
    • Developer Tools

      currently, the Compass Tool Call eval suite exits with process.exit(0) in the finally block at the end of the eval. this is because the process hangs if this isn't included.

      the relevant code is toward the end of the tool-calls.eval.ts file. there is a FIXME comment that references this ticket there.

      when building out the initial suite, i wasn't able to figure out what was hanging and how to fix it. we should investigate and address whatever is hanging so that we can exit the process without the manual process.exit(0). removing process.exit(0) allows Node to shut down gracefully, ensuring all async handles, open connections, and cleanup callbacks complete naturally rather than being forcibly terminated.

            Assignee:
            Unassigned
            Reporter:
            Ben Perlmutter
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: