Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-58408

Improve diagnostics for networking reactors

    XMLWordPrintable

    Details

    • Linked BF Score:
      37
    • Story Points:
      4

      Description

      The transport layer utilizes ASIO reactors to perform networking operations. Such operations include but are not limited to DNS resolution and connection establishment.

      Below is an example of using the reactors to perform asynchronous DNS resolution, where _resolver, which is an instance of resolver::async_resolve, schedules a request to resolve peer.host() on a networking reactor:

      Future<EndpointVector> _asyncResolve(const HostAndPort& peer, Flags flags, bool enableIPv6) {
          auto port = std::to_string(peer.port());
          Future<Results> ret;
          if (enableIPv6) {
              ret = _resolver.async_resolve(peer.host(), port, flags, UseFuture{});
          } else {
              ret = _resolver.async_resolve(asio::ip::tcp::v4(), peer.host(), port, flags, UseFuture{});
          }
          return std::move(ret).onError([this, peer](Status status) {
              return _checkResults(status, peer);
          }).then([this, peer](Results results) {
              return _makeFuture(results, peer);
          });
      }
      

      The goal is to collect more information on tasks ran by the reactor threads. At a minimum, we'd want to collect the duration of tasks ran by the reactor. It'd also be useful to measure the cost of running the continuations chained to tasks scheduled on reactor threads (e.g., see here).

      Reporting these metrics in serverStatus (and FTDC) can help with diagnosing slow DNS resolutions and large delays in connection establishment.

       

      Acceptance criteria: Report a histogram of each stage in connection establishment and success and failure statistics for each stage.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              backlog-server-servicearch Backlog - Service Architecture
              Reporter:
              amirsaman.memaripour Amirsaman Memaripour
              Participants:
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated: