Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-305

Overwritting a database after reading from it does not work

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker - P1
    • Resolution: Works as Designed
    • Affects Version/s: 3.0.1
    • Fix Version/s: None
    • Component/s: Writes
    • Labels:

      Description

      The following does not work:

      1. Reading from a database into a pyspark df
      2. Performing some modifications on df
      3. Overwriting that same database with df

      In the end, the databse whould contain the updated version of df, but it is always blank, as the attached code snippet illustrates.

       

        Attachments

          Activity

            People

            Assignee:
            ross.lawley Ross Lawley
            Reporter:
            bernardo.cortez@datafordeals.com Bernardo Cortez
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: