Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-278

Spark Metrics value zero

    • Type: Icon: Task Task
    • Resolution: Unresolved
    • Priority: Icon: Minor - P4 Minor - P4
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None

      Hello guys, the mongo-spark connector does not write the metrics of records and bytes (Read and Written). I tried to override the MongoRDD class in the compute method and set the metrics value but they are not accessible for writing.
      Do you have any workaround for that?

      I am using SparkListener to capture metrics.

      Thank you!

       

            Assignee:
            Unassigned Unassigned
            Reporter:
            rockeric15@hotmail.com Eric Silva
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: