Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-134

Provide library support for streams and structured streams

      Hi, is it possible that MongoDB Spark Connector supports Spark Structured Streaming?

      At the moment MongoDB Spark Connector 2.2.0 supports Spark Streaming but I can't find info about supporting Structured Streaming.

      Alternatively, as a workaround can you tell me how can I write the "Starting Streaming Queries" code in order to save the Streaming Dataframe?

      At the moment I have correctly inserted Structured Dataframes into MongoDB, but with no streaming.
      I think I should use foreach method, but at the moment I don't know how to implement it.

      Here's a little code examples inserting a Dataframe (done correctly) and Structured Streaming (I can't do it) into MongoDB :
      https://gist.github.com/rvilla87/4ff36b9b78dd65947ed761ebb54a7bb6

      Thanks in advance!

            Assignee:
            Unassigned Unassigned
            Reporter:
            rvilla Ruben Villacreces
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: