Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-278

Spark Metrics value zero

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Open
    • Priority: Major - P3
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Hello guys, the mongo-spark connector does not write the metrics of records and bytes (Read and Written). I tried to override the MongoRDD class in the compute method and set the metrics value but they are not accessible for writing.
      Do you have any workaround for that?

      I am using SparkListener to capture metrics.

      Thank you!

       

        Attachments

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            rockeric15@hotmail.com Eric Silva
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated: