Loading...

Type: New Feature
Resolution: Done
Priority: Major - P3
Fix Version/s: 3.2.10
Affects Version/s: 3.2.9
Component/s: mongoimport
Labels:
- fvok
Environment:

Hide
MacOS Sierra 10.12 (general release, not a beta) running on a MacBook Pro Retina

$ mongod --version
db version v3.2.9
git version: 22ec9e93b40c85fc7cae7d56e7d6a02fd811088c
OpenSSL version: OpenSSL 0.9.8zh 14 Jan 2016
allocator: system
modules: none
build environment:
    distarch: x86_64
    target_arch: x86_64

$ mongoimport --version
mongoimport version: r3.2.9
git version: 4a4e7d30773b28cf66f75e45bc289a5d3ca49ddd
Go version: go1.6.2
   os: darwin
   arch: amd64
   compiler: gc
OpenSSL version: OpenSSL 0.9.8zc 19 Mar 2015

Show
MacOS Sierra 10.12 (general release, not a beta) running on a MacBook Pro Retina $ mongod --version db version v3.2.9 git version: 22ec9e93b40c85fc7cae7d56e7d6a02fd811088c OpenSSL version: OpenSSL 0.9.8zh 14 Jan 2016 allocator: system modules: none build environment:     distarch: x86_64     target_arch: x86_64 $ mongoimport --version mongoimport version: r3.2.9 git version: 4a4e7d30773b28cf66f75e45bc289a5d3ca49ddd Go version: go1.6.2    os: darwin    arch: amd64    compiler: gc OpenSSL version: OpenSSL 0.9.8zc 19 Mar 2015

Sprint:
Platforms 2016-10-10

mongoimport gets stuck during import.

First, let's remove everything from the database

$ sudo /bin/rm -rf /data/db/*
Password:
$ mongod

Now let's import one collection.
$ mongoimport --drop -d bq_content -c definition

/tmp/bqContent/definition.batch.json
2016-09-22T08:53:53.512-0500	connected to: localhost
2016-09-22T08:53:53.513-0500	dropping: bq_content.definition

Now it's hung. It will sit in this spot indefinitely. Ctrl+C will not stop the process.

Did ctrl+\ for a dump:

^\SIGQUIT: quit
PC=0x406006b m=0

goroutine 0 [idle]:
runtime.mach_semaphore_wait(0xc000001103, 0x4013fc4, 0xc820001b00, 0x40522e4, 0xc820001b30, 0x48422c0, 0x4053889, 0xffffffffffffffff, 0xc820001b30, 0x7fff5fbff2bc, ...)
	/usr/local/go/src/runtime/sys_darwin_amd64.s:411 +0xb
runtime.semasleep1(0xffffffffffffffff, 0xc820001b30)
	/usr/local/go/src/runtime/os1_darwin.go:423 +0xdf
runtime.semasleep.func1()
	/usr/local/go/src/runtime/os1_darwin.go:439 +0x29
runtime.systemstack(0x7fff5fbff2c0)
	/usr/local/go/src/runtime/asm_amd64.s:307 +0xab
runtime.semasleep(0xffffffffffffffff, 0xc8201f3801)
	/usr/local/go/src/runtime/os1_darwin.go:440 +0x36
runtime.lock(0x483aef8)
	/usr/local/go/src/runtime/lock_sema.go:85 +0x220
runtime.printlock()
	/usr/local/go/src/runtime/print.go:37 +0x60
runtime.throw(0x464a9e0, 0x2a)
	/usr/local/go/src/runtime/panic.go:541 +0x9
runtime.sigpanic()
	/usr/local/go/src/runtime/sigpanic_unix.go:12 +0x5a
runtime/internal/atomic.Load64(0x376c4d8, 0x376c4df4aa9)
	/usr/local/go/src/runtime/internal/atomic/atomic_amd64x.go:26 +0x5
runtime.lfstackpop(0x4842168, 0x40521b0)
	/usr/local/go/src/runtime/lfstack.go:38 +0x6d
runtime.getempty(0x65, 0xc800000000)
	/usr/local/go/src/runtime/mgcwork.go:341 +0x3b
runtime.(*gcWork).init(0xc820026720)
	/usr/local/go/src/runtime/mgcwork.go:97 +0x20
runtime.(*gcWork).tryGet(0xc820026720, 0x9d4d0)
	/usr/local/go/src/runtime/mgcwork.go:141 +0x38
runtime.gcDrainN(0xc820026720, 0x40e7f, 0xc8fffffffc)
	/usr/local/go/src/runtime/mgcmark.go:896 +0xb6
runtime.gcAssistAlloc.func1()
	/usr/local/go/src/runtime/mgcmark.go:388 +0x16d
runtime.systemstack(0x4842300)
	/usr/local/go/src/runtime/asm_amd64.s:291 +0x79
runtime.mstart()
	/usr/local/go/src/runtime/proc.go:1051

goroutine 7 [running]:
runtime.systemstack_switch()
	/usr/local/go/src/runtime/asm_amd64.s:245 fp=0xc8202e7900 sp=0xc8202e78f8
runtime.gcAssistAlloc(0xc820001e00)
	/usr/local/go/src/runtime/mgcmark.go:425 +0x180 fp=0xc8202e7980 sp=0xc8202e7900
runtime.mallocgc(0x80, 0x4502700, 0x0, 0x44104e0)
	/usr/local/go/src/runtime/malloc.go:537 +0x184 fp=0xc8202e7a58 sp=0xc8202e7980
runtime.newarray(0x4502700, 0x4, 0xc82023df80)
	/usr/local/go/src/runtime/malloc.go:798 +0xc9 fp=0xc8202e7a98 sp=0xc8202e7a58
runtime.growslice(0x44e28e0, 0xc820195640, 0x2, 0x2, 0x3, 0x0, 0x0, 0x0)
	/usr/local/go/src/runtime/slice.go:100 +0x2c1 fp=0xc8202e7b08 sp=0xc8202e7a98
github.com/mongodb/mongo-tools/common/json.(*decodeState).bsonDInterface(0xc82029d600, 0x0, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/common/json/decode.go:1026 +0x381 fp=0xc8202e7bd0 sp=0xc8202e7b08
github.com/mongodb/mongo-tools/common/json.(*decodeState).bsonDocument(0xc82029d600, 0x0, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/common/json/decode.go:359 +0x58 fp=0xc8202e7bf8 sp=0xc8202e7bd0
github.com/mongodb/mongo-tools/common/json.(*decodeState).unmarshalBsonD(0xc82029d600, 0x0, 0x0, 0x0, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/common/json/decode.go:191 +0xe5 fp=0xc8202e7c28 sp=0xc8202e7bf8
github.com/mongodb/mongo-tools/common/json.UnmarshalBsonD(0xc820342200, 0x78, 0x78, 0x0, 0x0, 0x0, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/common/json/decode.go:108 +0x145 fp=0xc8202e7c98 sp=0xc8202e7c28
github.com/mongodb/mongo-tools/mongoimport.JSONConverter.Convert(0xc820342200, 0x78, 0x78, 0xc11a, 0x0, 0x0, 0x0, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/json.go:142 +0x71 fp=0xc8202e7da0 sp=0xc8202e7c98
github.com/mongodb/mongo-tools/mongoimport.(*JSONConverter).Convert(0xc82023d520, 0x0, 0x0, 0x0, 0x0, 0x0)
	<autogenerated>:8 +0xb3 fp=0xc8202e7df0 sp=0xc8202e7da0
github.com/mongodb/mongo-tools/mongoimport.(*importWorker).processDocuments(0xc8202e7f88, 0x468f000, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:423 +0x15e fp=0xc8202e7f30 sp=0xc8202e7df0
github.com/mongodb/mongo-tools/mongoimport.streamDocuments.func1(0xc8200122f0, 0x0, 0xc8200122d8, 0xc8200122e0, 0xc82013e180, 0xc8201ae060, 0xc820016360)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:311 +0x59 fp=0xc8202e7f68 sp=0xc8202e7f30
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1998 +0x1 fp=0xc8202e7f70 sp=0xc8202e7f68
created by github.com/mongodb/mongo-tools/mongoimport.streamDocuments
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:318 +0x2bf

goroutine 1 [chan receive, 2 minutes]:
github.com/mongodb/mongo-tools/mongoimport.channelQuorumError(0xc8201ae0c0, 0x2, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:108 +0x66
github.com/mongodb/mongo-tools/mongoimport.(*MongoImport).importDocuments(0xc820108300, 0x4f40378, 0xc82010c120, 0x0, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/mongoimport.go:347 +0xd17
github.com/mongodb/mongo-tools/mongoimport.(*MongoImport).ImportDocuments(0xc820108300, 0x0, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/mongoimport.go:282 +0x624
main.main()
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/mongoimport/main/mongoimport.go:71 +0x789

goroutine 17 [syscall, 2 minutes, locked to thread]:
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1998 +0x1

goroutine 20 [syscall, 2 minutes]:
os/signal.signal_recv(0x0)
	/usr/local/go/src/runtime/sigqueue.go:116 +0x132
os/signal.loop()
	/usr/local/go/src/os/signal/signal_unix.go:22 +0x18
created by os/signal.init.1
	/usr/local/go/src/os/signal/signal_unix.go:28 +0x37

goroutine 35 [running]:
	goroutine running on other thread; stack unavailable
created by github.com/mongodb/mongo-tools/common/progress.(*Bar).Start
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/common/progress/progress_bar.go:111 +0x11a

goroutine 34 [chan receive, 2 minutes]:
github.com/mongodb/mongo-tools/common/signals.Handle()
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/common/signals/signals_unix.go:16 +0x27c
created by main.main
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/mongoimport/main/mongoimport.go:16 +0x4a

goroutine 3 [select, 2 minutes, locked to thread]:
runtime.gopark(0x468f020, 0xc82002cf28, 0x45a1a78, 0x6, 0x18, 0x2)
	/usr/local/go/src/runtime/proc.go:262 +0x163
runtime.selectgoImpl(0xc82002cf28, 0x0, 0x18)
	/usr/local/go/src/runtime/select.go:392 +0xa67
runtime.selectgo(0xc82002cf28)
	/usr/local/go/src/runtime/select.go:215 +0x12
runtime.ensureSigM.func1()
	/usr/local/go/src/runtime/signal1_unix.go:279 +0x32c
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1998 +0x1

goroutine 36 [select, 2 minutes]:
gopkg.in/mgo%2ev2.(*mongoCluster).syncServersLoop(0xc820152000)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/vendor/src/gopkg.in/mgo.v2/cluster.go:394 +0x617
created by gopkg.in/mgo%2ev2.newCluster
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/vendor/src/gopkg.in/mgo.v2/cluster.go:78 +0x1d5

goroutine 50 [chan receive, 2 minutes]:
github.com/mongodb/mongo-tools/mongoimport.channelQuorumError(0xc82013e1e0, 0x2, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:108 +0x66
github.com/mongodb/mongo-tools/mongoimport.(*JSONInputReader).StreamDocument(0xc82010c120, 0x0, 0xc8201ae060, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/json.go:136 +0x101
github.com/mongodb/mongo-tools/mongoimport.(*MongoImport).importDocuments.func1(0xc8201ae0c0, 0x4f40378, 0xc82010c120, 0x7fff5fbff700, 0xc8201ae060)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/mongoimport.go:339 +0x3a
created by github.com/mongodb/mongo-tools/mongoimport.(*MongoImport).importDocuments
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/mongoimport.go:340 +0xcc7

goroutine 42 [sleep, 2 minutes]:
time.Sleep(0x37e11d600)
	/usr/local/go/src/runtime/time.go:59 +0xf9
gopkg.in/mgo%2ev2.(*mongoServer).pinger(0xc8201362a0, 0x1)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/vendor/src/gopkg.in/mgo.v2/server.go:296 +0x1a6
created by gopkg.in/mgo%2ev2.newServer
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/vendor/src/gopkg.in/mgo.v2/server.go:89 +0x165

goroutine 51 [semacquire, 2 minutes]:
sync.runtime_Semacquire(0xc820172ddc)
	/usr/local/go/src/runtime/sema.go:47 +0x26
sync.(*WaitGroup).Wait(0xc820172dd0)
	/usr/local/go/src/sync/waitgroup.go:127 +0xb4
github.com/mongodb/mongo-tools/mongoimport.(*MongoImport).ingestDocuments(0xc820108300, 0xc8201ae060, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/mongoimport.go:385 +0x139
github.com/mongodb/mongo-tools/mongoimport.(*MongoImport).importDocuments.func2(0xc8201ae0c0, 0xc820108300, 0xc8201ae060)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/mongoimport.go:344 +0x2b
created by github.com/mongodb/mongo-tools/mongoimport.(*MongoImport).importDocuments
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/mongoimport.go:345 +0xd00

goroutine 4 [IO wait, 2 minutes]:
net.runtime_pollWait(0x4f414d0, 0x72, 0xc820016330)
	/usr/local/go/src/runtime/netpoll.go:160 +0x60
net.(*pollDesc).Wait(0xc82010fb80, 0x72, 0x0, 0x0)
	/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a
net.(*pollDesc).WaitRead(0xc82010fb80, 0x0, 0x0)
	/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36
net.(*netFD).Read(0xc82010fb20, 0xc820016330, 0x24, 0x24, 0x0, 0x4f040f8, 0xc8200760a0)
	/usr/local/go/src/net/fd_unix.go:250 +0x23a
net.(*conn).Read(0xc820030008, 0xc820016330, 0x24, 0x24, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:172 +0xe4
gopkg.in/mgo%2ev2.fill(0x4f415c0, 0xc820030008, 0xc820016330, 0x24, 0x24, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/vendor/src/gopkg.in/mgo.v2/socket.go:530 +0x6c
gopkg.in/mgo%2ev2.(*mongoSocket).readLoop(0xc82017e000)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/vendor/src/gopkg.in/mgo.v2/socket.go:547 +0x133
created by gopkg.in/mgo%2ev2.newSocket
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/vendor/src/gopkg.in/mgo.v2/socket.go:194 +0x407

goroutine 52 [runnable]:
github.com/mongodb/mongo-tools/mongoimport.(*MongoImport).runInsertionWorker(0xc820108300, 0xc8201ae060, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/mongoimport.go:440 +0x9fa
github.com/mongodb/mongo-tools/mongoimport.(*MongoImport).ingestDocuments.func1(0xc820172dd0, 0xc820108300, 0xc8201ae060, 0xc820172de0, 0xc820172dc0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/mongoimport.go:376 +0x5a
created by github.com/mongodb/mongo-tools/mongoimport.(*MongoImport).ingestDocuments
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/mongoimport.go:383 +0x114

goroutine 5 [runnable]:
github.com/mongodb/mongo-tools/mongoimport.(*JSONInputReader).StreamDocument.func1(0xc82010c120, 0xc82013e180, 0xc82013e1e0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/json.go:126 +0x66f
created by github.com/mongodb/mongo-tools/mongoimport.(*JSONInputReader).StreamDocument
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/json.go:129 +0xa1

goroutine 6 [semacquire, 2 minutes]:
sync.runtime_Semacquire(0xc8200122fc)
	/usr/local/go/src/runtime/sema.go:47 +0x26
sync.(*WaitGroup).Wait(0xc8200122f0)
	/usr/local/go/src/sync/waitgroup.go:127 +0xb4
github.com/mongodb/mongo-tools/mongoimport.streamDocuments(0x0, 0x8, 0xc82013e180, 0xc8201ae060, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:326 +0x33a
github.com/mongodb/mongo-tools/mongoimport.(*JSONInputReader).StreamDocument.func2(0xc82013e1e0, 0xc82013e100, 0xc82010c120, 0xc82013e180, 0xc8201ae060)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/json.go:133 +0x42
created by github.com/mongodb/mongo-tools/mongoimport.(*JSONInputReader).StreamDocument
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/json.go:134 +0xea

goroutine 8 [running]:
	goroutine running on other thread; stack unavailable
created by github.com/mongodb/mongo-tools/mongoimport.streamDocuments
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:318 +0x2bf

goroutine 9 [runnable]:
github.com/mongodb/mongo-tools/mongoimport.(*importWorker).processDocuments(0xc8202ebf88, 0x468f000, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:418 +0x26c
github.com/mongodb/mongo-tools/mongoimport.streamDocuments.func1(0xc8200122f0, 0x0, 0xc8200122d8, 0xc8200122e0, 0xc82013e180, 0xc8201ae060, 0xc820016360)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:311 +0x59
created by github.com/mongodb/mongo-tools/mongoimport.streamDocuments
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:318 +0x2bf

goroutine 10 [running]:
	goroutine running on other thread; stack unavailable
created by github.com/mongodb/mongo-tools/mongoimport.streamDocuments
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:318 +0x2bf

goroutine 11 [runnable]:
github.com/mongodb/mongo-tools/mongoimport.(*importWorker).processDocuments(0xc820221f88, 0x468f000, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:418 +0x26c
github.com/mongodb/mongo-tools/mongoimport.streamDocuments.func1(0xc8200122f0, 0x0, 0xc8200122d8, 0xc8200122e0, 0xc82013e180, 0xc8201ae060, 0xc820016360)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:311 +0x59
created by github.com/mongodb/mongo-tools/mongoimport.streamDocuments
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:318 +0x2bf

goroutine 12 [running]:
	goroutine running on other thread; stack unavailable
created by github.com/mongodb/mongo-tools/mongoimport.streamDocuments
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:318 +0x2bf

goroutine 13 [runnable]:
github.com/mongodb/mongo-tools/mongoimport.(*importWorker).processDocuments(0xc820211f88, 0x468f000, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:418 +0x26c
github.com/mongodb/mongo-tools/mongoimport.streamDocuments.func1(0xc8200122f0, 0x0, 0xc8200122d8, 0xc8200122e0, 0xc82013e180, 0xc8201ae060, 0xc820016360)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:311 +0x59
created by github.com/mongodb/mongo-tools/mongoimport.streamDocuments
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:318 +0x2bf

goroutine 14 [running]:
	goroutine running on other thread; stack unavailable
created by github.com/mongodb/mongo-tools/mongoimport.streamDocuments
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/.gopath/src/github.com/mongodb/mongo-tools/mongoimport/common.go:318 +0x2bf

goroutine 16 [IO wait, 2 minutes]:
net.runtime_pollWait(0x4f41410, 0x72, 0xc82031a180)
	/usr/local/go/src/runtime/netpoll.go:160 +0x60
net.(*pollDesc).Wait(0xc820272530, 0x72, 0x0, 0x0)
	/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a
net.(*pollDesc).WaitRead(0xc820272530, 0x0, 0x0)
	/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36
net.(*netFD).Read(0xc8202724d0, 0xc82031a180, 0x24, 0x24, 0x0, 0x4f040f8, 0xc8200760a0)
	/usr/local/go/src/net/fd_unix.go:250 +0x23a
net.(*conn).Read(0xc82017c000, 0xc82031a180, 0x24, 0x24, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:172 +0xe4
gopkg.in/mgo%2ev2.fill(0x4f415c0, 0xc82017c000, 0xc82031a180, 0x24, 0x24, 0x0, 0x0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/vendor/src/gopkg.in/mgo.v2/socket.go:530 +0x6c
gopkg.in/mgo%2ev2.(*mongoSocket).readLoop(0xc82017e2a0)
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/vendor/src/gopkg.in/mgo.v2/socket.go:547 +0x133
created by gopkg.in/mgo%2ev2.newSocket
	/data/mci/01893fdc507b614dc0a9ac9f61894498/src/mongo-tools/vendor/src/gopkg.in/mgo.v2/socket.go:194 +0x407

rax    0xe
rbx    0x4842a80
rcx    0x7fff5fbff248
rdx    0x7fff5fbff2c0
rdi    0x1103
rsi    0x0
rbp    0x1103
rsp    0x7fff5fbff248
r8     0x7fff5fbff2b8
r9     0x2
r10    0x0
r11    0x286
r12    0x2
r13    0x468cc90
r14    0x1
r15    0x8
rip    0x406006b
rflags 0x286
cs     0x7
fs     0x0
gs     0x0

I've also seen it start the import and then hang; so it will do:

$ mongoimport -d bq_content -c definition /tmp/bqContent/definition.batch.json
2016-09-22T08:28:06.096-0500    connected to: localhost
2016-09-22T08:28:09.096-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:12.093-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:15.093-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:18.096-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:21.096-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:24.094-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:27.095-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:30.093-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:33.093-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:36.097-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:39.093-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:42.095-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:45.096-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:48.093-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)
2016-09-22T08:28:51.093-0500    [###########.............] bq_content.definition    11.2MB/22.8MB (48.9%)

and it will continue printing the same percentage until the end of time.

is duplicated by

TOOLS-1609 mongoexport fails on mac os 10.12.3

Closed

TOOLS-1617 error during mongodump

Closed

TOOLS-1646 mongorestore fails

Closed

Details

Description

Attachments

Issue Links

Activity

People

Dates