Uploaded image for project: 'MongoDB ETL Tools'
  1. MongoDB ETL Tools
  2. TOOLS-1910

data race detected in mongoimport

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      https://evergreen.mongodb.com/task/mongo_tools_ubuntu_race_integration_918cb1d9f7691d157e28a5d78b8059bdd5f40b48_17_11_10_21_29_18

      ==================
       
       [2017/11/11 15:09:41.757] WARNING: DATA RACE
       
       [2017/11/11 15:09:41.757] Write at 0x00c4202c52e0 by goroutine 33:
       
       [2017/11/11 15:09:41.757]   os.(*file).close()
       
       [2017/11/11 15:09:41.757]       /opt/go/src/os/file_unix.go:143 +0x124
       
       [2017/11/11 15:09:41.757]   os.(*File).Close()
       
       [2017/11/11 15:09:41.757]       /opt/go/src/os/file_unix.go:132 +0x55
       
       [2017/11/11 15:09:41.757]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.(*MongoImport).ImportDocuments()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/mongoimport.go:335 +0x63e
       
       [2017/11/11 15:09:41.757]   github.com/mongodb/mongo-tools/common/db.BuildWriteConcern()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/.gopath/src/github.com/mongodb/mongo-tools/common/db/write_concern.go:147 +0x9a
       
       [2017/11/11 15:09:41.757]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.(*MongoImport).configureSession()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/mongoimport.go:451 +0x131
       
       [2017/11/11 15:09:41.757]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.(*MongoImport).importDocuments()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/mongoimport.go:368 +0x77d
       
       [2017/11/11 15:09:41.757]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.(*MongoImport).ImportDocuments()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/mongoimport.go:335 +0x616
       
       [2017/11/11 15:09:41.757]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.TestImportDocuments.func1.16()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/mongoimport_test.go:761 +0x143
       
       [2017/11/11 15:09:41.757]   github.com/smartystreets/goconvey/convey.parseAction.func1()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/discovery.go:80 +0x3d
       
       [2017/11/11 15:09:41.757]   github.com/smartystreets/goconvey/convey.(*context).conveyInner()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/context.go:261 +0x1bd
       
       [2017/11/11 15:09:41.757]   github.com/smartystreets/goconvey/convey.(*context).Convey.func1()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/context.go:163 +0x95
       
       [2017/11/11 15:09:41.757]   github.com/jtolds/gls._m()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/jtolds/gls/stack_tags.go:39 +0x42
       
       [2017/11/11 15:09:41.757]   github.com/jtolds/gls.mark1()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/jtolds/gls/stack_tags.go:18 +0x42
       
       [2017/11/11 15:09:41.757]   github.com/jtolds/gls._m()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/jtolds/gls/stack_tags.go:41 +0x9d
       
       [2017/11/11 15:09:41.757]   github.com/jtolds/gls.markS()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/jtolds/gls/stack_tags.go:16 +0x42
       
       [2017/11/11 15:09:41.757]   github.com/jtolds/gls.addStackTag()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/jtolds/gls/stack_tags.go:13 +0x47
       
       [2017/11/11 15:09:41.757]   github.com/jtolds/gls.(*ContextManager).SetValues()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/jtolds/gls/context.go:92 +0x549
       
       [2017/11/11 15:09:41.757]   github.com/smartystreets/goconvey/convey.(*context).Convey()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/context.go:164 +0x377
       
       [2017/11/11 15:09:41.757]   github.com/smartystreets/goconvey/convey.Convey()
       
       [2017/11/11 15:09:41.757]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/doc.go:77 +0x63
       
       [2017/11/11 15:09:41.757]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.TestImportDocuments.func1()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/mongoimport_test.go:763 +0x1006
       
       [2017/11/11 15:09:41.758]   github.com/smartystreets/goconvey/convey.parseAction.func1()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/discovery.go:80 +0x3d
       
       [2017/11/11 15:09:41.758]   github.com/smartystreets/goconvey/convey.(*context).conveyInner()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/context.go:261 +0x1bd
       
       [2017/11/11 15:09:41.758]   github.com/smartystreets/goconvey/convey.rootConvey.func1()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/context.go:110 +0x194
       
       [2017/11/11 15:09:41.758]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.TestImportDocuments.func1()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/mongoimport_test.go:754 +0xf0a
       
       [2017/11/11 15:09:41.758]   github.com/smartystreets/goconvey/convey.parseAction.func1()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/discovery.go:80 +0x3d
       
       [2017/11/11 15:09:41.758]   github.com/smartystreets/goconvey/convey.(*context).conveyInner()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/context.go:261 +0x1bd
       
       [2017/11/11 15:09:41.758]   github.com/smartystreets/goconvey/convey.rootConvey.func1()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/context.go:110 +0x194
       
       [2017/11/11 15:09:41.758]   github.com/jtolds/gls._m()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/jtolds/gls/stack_tags.go:39 +0x42
       
       [2017/11/11 15:09:41.758]   github.com/jtolds/gls.markS()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/jtolds/gls/stack_tags.go:16 +0x42
       
       [2017/11/11 15:09:41.758]   github.com/jtolds/gls.addStackTag()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/jtolds/gls/stack_tags.go:13 +0x47
       
       [2017/11/11 15:09:41.758]   github.com/jtolds/gls.(*ContextManager).SetValues()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/jtolds/gls/context.go:92 +0x549
       
       [2017/11/11 15:09:41.758]   github.com/smartystreets/goconvey/convey.rootConvey()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/context.go:113 +0x4c7
       
       [2017/11/11 15:09:41.758]   github.com/smartystreets/goconvey/convey.Convey()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/vendor/src/github.com/smartystreets/goconvey/convey/doc.go:75 +0x94
       
       [2017/11/11 15:09:41.758]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.TestImportDocuments()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/mongoimport_test.go:784 +0x1cc
       
       [2017/11/11 15:09:41.758]   testing.tRunner()
       
       [2017/11/11 15:09:41.758]       /opt/go/src/testing/testing.go:610 +0xc9
       
       [2017/11/11 15:09:41.758] Previous read at 0x00c4202c52e0 by goroutine 163:
       
       [2017/11/11 15:09:41.758]   os.(*File).read()
       
       [2017/11/11 15:09:41.758]       /opt/go/src/os/file_unix.go:228 +0x50
       
       [2017/11/11 15:09:41.758]   os.(*File).Read()
       
       [2017/11/11 15:09:41.758]       /opt/go/src/os/file.go:101 +0x6f
       
       [2017/11/11 15:09:41.758]   bufio.(*Reader).fill()
       
       [2017/11/11 15:09:41.758]       /opt/go/src/bufio/bufio.go:97 +0x196
       
       [2017/11/11 15:09:41.758]   bufio.(*Reader).Read()
       
       [2017/11/11 15:09:41.758]       /opt/go/src/bufio/bufio.go:209 +0x6ab
       
       [2017/11/11 15:09:41.758]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.(*bomDiscardingReader).Read()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/common.go:129 +0xb7
       
       [2017/11/11 15:09:41.758]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.(*sizeTrackingReader).Read()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/common.go:99 +0x75
       
       [2017/11/11 15:09:41.758]   github.com/mongodb/mongo-tools/common/json.(*Decoder).readValue()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/.gopath/src/github.com/mongodb/mongo-tools/common/json/stream.go:171 +0x499
       
       [2017/11/11 15:09:41.758]   github.com/mongodb/mongo-tools/common/json.(*Decoder).ScanObject()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/.gopath/src/github.com/mongodb/mongo-tools/common/json/stream.go:72 +0x113
       
       [2017/11/11 15:09:41.758]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.(*JSONInputReader).StreamDocument.func1()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/json.go:124 +0xae
       
       [2017/11/11 15:09:41.758] Goroutine 33 (running) created at:
       
       [2017/11/11 15:09:41.758]   testing.(*T).Run()
       
       [2017/11/11 15:09:41.758]       /opt/go/src/testing/testing.go:646 +0x52f
       
       [2017/11/11 15:09:41.758]   testing.RunTests.func1()
       
       [2017/11/11 15:09:41.758]       /opt/go/src/testing/testing.go:793 +0xb9
       
       [2017/11/11 15:09:41.758]   testing.tRunner()
       
       [2017/11/11 15:09:41.758]       /opt/go/src/testing/testing.go:610 +0xc9
       
       [2017/11/11 15:09:41.758]   testing.RunTests()
       
       [2017/11/11 15:09:41.758]       /opt/go/src/testing/testing.go:799 +0x4ba
       
       [2017/11/11 15:09:41.758]   testing.(*M).Run()
       
       [2017/11/11 15:09:41.758]       /opt/go/src/testing/testing.go:743 +0x12f
       
       [2017/11/11 15:09:41.758]   main.main()
       
       [2017/11/11 15:09:41.758]       _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/_test/_testmain.go:114 +0x1b8
       
       [2017/11/11 15:09:41.758] Goroutine 163 (running) created at:
       
       [2017/11/11 15:09:41.758]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.(*JSONInputReader).StreamDocument()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/json.go:141 +0xbc
       
       [2017/11/11 15:09:41.758]   _/data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport.(*MongoImport).importDocuments.func1()
       
       [2017/11/11 15:09:41.758]       /data/mci/66a16a7ec5005f903d6a385d6b693274/src/mongoimport/mongoimport.go:392 +0x55
       
       [2017/11/11 15:09:41.758] ==================
      

        Attachments

          Activity

            People

            • Assignee:
              backlog-server-tools Backlog - Server Tools Team
              Reporter:
              gabriel.russell Gabriel Russell
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: