Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-3454

Mongodump/mongorestore passthrough tests

    • Type: Icon: Epic Epic
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Mongodump/mongorestore passthrough tests
    • Not Needed
    • In Progress
    • No Alignment
    • 0
    • 3.4
    • 6
    • 0
    • 100
    • Hide

      2025-01-30:

      It was hard to maintain a hand-crafted suite.yml, so I made initial hacks to the suite-generator code to generate suite.yml files for jscore_passthrough tests using the MongodumpReplicator. Have to learn the idioms of evergreen tasks/funcs as I go, so moving slowly, but that's useful knowledge for the future.

      I got to look at logfiles, and found I was trying to launch a copy of a MacOS mongodump executable on a RHEL-8 evergreen worker, so obviously that wouldn't work.

      Currently working on changing the mongo-tools/common.yml and shell scripts to be able to build both mongo-tools and mongosync on the evergreen worker. I hoped to reach milestone 1 without tackling that, but I spent a while trying some simpler kludges and couldn't get them to work.

      2025-01-17:

      REP-5481 MongodumpReplicatorFixture is about 95% coded, I'm doing some ugly temporary hacks to drive it from a slightly-modified mongosync passthrough task .yml,
      and I think it's being set up but so far it fails too early to get a logfile.

      2025-01-08:

      Technical design approved
      5 Jira tickets created for the milestone 1 work (get one test to run)
      mongodump --internalOnlySourceWritesDoneBarrier code complete, not yet tested
      mongodump_replicator.py coding in progress

      2024-12-06:

      The engineers working on the project had been focused on correctness and longer term initiatives for some of the last month. The technical design is close to being approved.

      2024-10-24:

      The technical design is in progress.

      Show
      2025-01-30: It was hard to maintain a hand-crafted suite.yml, so I made initial hacks to the suite-generator code to generate suite.yml files for jscore_passthrough tests using the MongodumpReplicator. Have to learn the idioms of evergreen tasks/funcs as I go, so moving slowly, but that's useful knowledge for the future. I got to look at logfiles, and found I was trying to launch a copy of a MacOS mongodump executable on a RHEL-8 evergreen worker, so obviously that wouldn't work. Currently working on changing the mongo-tools/common.yml and shell scripts to be able to build both mongo-tools and mongosync on the evergreen worker. I hoped to reach milestone 1 without tackling that, but I spent a while trying some simpler kludges and couldn't get them to work. 2025-01-17: REP-5481 MongodumpReplicatorFixture is about 95% coded, I'm doing some ugly temporary hacks to drive it from a slightly-modified mongosync passthrough task .yml, and I think it's being set up but so far it fails too early to get a logfile. 2025-01-08: Technical design approved 5 Jira tickets created for the milestone 1 work (get one test to run) mongodump --internalOnlySourceWritesDoneBarrier code complete, not yet tested mongodump_replicator.py coding in progress 2024-12-06: The engineers working on the project had been focused on correctness and longer term initiatives for some of the last month. The technical design is close to being approved. 2024-10-24: The technical design is in progress.

      Summary:
      Mongodump/mongorestore passthrough tests

            Assignee:
            jason.flax@mongodb.com Jason Flax
            Reporter:
            martin.bajana@mongodb.com Martin Bajana
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              22 weeks, 4 days
              None