Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-43049

Test failure file archiving can miss files.

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 4.2.0, 4.3.1
    • Component/s: Testing Infrastructure
    • Labels:
      None
    • Server Tooling & Methods
    • ALL
    • v4.2
    • 15

      I suspect the failure to add a file to the archive (because it was deleted after showing up in the list of files, presumably benign) aborts the remainder of the process.

      [2019/08/14 20:11:41.659] [executor:js_test:job0] 2019-08-14T19:11:41.644+0000 Archive succeeded for jstestfuzz-94f4-ent_fb4b-qa_a6ce-1565809840034-08:CheckReplDBHash: Tar/gzip Data files jstestfuzz-94f4-ent_fb4b-qa_a6ce-1565809840034-08:CheckReplDBHash - Execution 0 Repetition 0 files: ['/data/db/job0/resmoke']; Unable to add /data/db/job0/resmoke to archive file: [Errno 2] No such file or directory: '/data/db/job0/resmoke/node0/collection-188--1419834514067471100.wt'
      [2019/08/14 20:11:41.659] [executor:js_test:job0] 2019-08-14T19:11:41.644+0000 JSTest jstestfuzz/out/jstestfuzz-94f4-ent_fb4b-qa_a6ce-1565809840034-08.js marked as a failure by a hook's after_test.
      [2019/08/14 20:11:41.659] Traceback (most recent call last):
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/hooks/interface.py", line 72, in run_dynamic_test
      [2019/08/14 20:11:41.659]     self.run_test()
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/hooks/jsfile.py", line 86, in run_test
      [2019/08/14 20:11:41.659]     self._js_test.run_test()
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 237, in run_test
      [2019/08/14 20:11:41.659]     self._run_single_copy()
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 192, in _run_single_copy
      [2019/08/14 20:11:41.659]     test_case.run_test()
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/testcases/interface.py", line 119, in run_test
      [2019/08/14 20:11:41.659]     self._execute(shell)
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/testcases/interface.py", line 140, in _execute
      [2019/08/14 20:11:41.659]     raise self.failureException("%s failed" % (self.short_description()))
      [2019/08/14 20:11:41.659] AssertionError: JSTest jstests/hooks/run_check_repl_dbhash.js failed
      [2019/08/14 20:11:41.659] During handling of the above exception, another exception occurred:
      [2019/08/14 20:11:41.659] Traceback (most recent call last):
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/hooks/jsfile.py", line 53, in after_test
      [2019/08/14 20:11:41.659]     JSHook.after_test(self, test, test_report)
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/hooks/jsfile.py", line 37, in after_test
      [2019/08/14 20:11:41.659]     hook_test_case.run_dynamic_test(test_report)
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/hooks/interface.py", line 77, in run_dynamic_test
      [2019/08/14 20:11:41.659]     raise errors.TestFailure(err.args[0])
      [2019/08/14 20:11:41.659] buildscripts.resmokelib.errors.TestFailure: JSTest jstests/hooks/run_check_repl_dbhash.js failed
      [2019/08/14 20:11:41.659] During handling of the above exception, another exception occurred:
      [2019/08/14 20:11:41.659] Traceback (most recent call last):
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/job.py", line 274, in _run_hooks_after_tests
      [2019/08/14 20:11:41.659]     self._run_hook(hook, hook.after_test, test)
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/job.py", line 227, in _run_hook
      [2019/08/14 20:11:41.659]     hook_function(test, self.report)
      [2019/08/14 20:11:41.659]   File "/data/mci/e4693cd76d49b3f1588ee74afd52ddac/src/buildscripts/resmokelib/testing/hooks/jsfile.py", line 55, in after_test
      [2019/08/14 20:11:41.659]     raise errors.ServerFailure(err.args[0])
      [2019/08/14 20:11:41.659] buildscripts.resmokelib.errors.ServerFailure: JSTest jstests/hooks/run_check_repl_dbhash.js failed
      [2019/08/14 20:11:41.659] [executor] 2019-08-14T19:11:41.644+0000 Uploading to S3 /data/mci/e4693cd76d49b3f1588ee74afd52ddac/tmp/tmp23fdeabw.tgz to bucket mongodatafiles path mongodb-mongo-v4.2/enterprise-rhel-62-64-bit-flow-control-off/5706e608e514786deaae3f4fa7916fc7e6371dfe/datafiles/mongo-data-mongodb_mongo_v4.2_enterprise_rhel_62_64_bit_flow_control_off_jstestfuzz_replication_2_enterprise_rhel_62_64_bit_flow_control_off_5706e608e514786deaae3f4fa7916fc7e6371dfe_19_08_14_17_50_41-jstestfuzz-94f4-ent_fb4b-qa_a6ce-1565809840034-08_CheckReplDBHash-0-0.tgz
      

            Assignee:
            backlog-server-stm Backlog - Server Tooling and Methods (STM) (Inactive)
            Reporter:
            daniel.gottlieb@mongodb.com Daniel Gottlieb (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated:
              Resolved: