[SERVER-2717] --fastsync broken with RS Created: 09/Mar/11  Updated: 12/Jul/16  Resolved: 11/Mar/11

Status: Closed
Project: Core Server
Component/s: Replication
Affects Version/s: None
Fix Version/s: 1.8.0

Type: Bug Priority: Critical - P2
Reporter: Mathias Stearn Assignee: Kristina Chodorow (Inactive)
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
is duplicated by SERVER-2718 Can't add replica to set when it is n... Closed
Operating System: ALL
Participants:

 Description   

Even restarting without --fastsync didnt fix this (it used to)

[root@mathias1-256 ~]# mongod --fastsync --replSet rs
Wed Mar 9 01:36:56 [initandlisten] MongoDB starting : pid=656 port=27017 dbpath=/data/db/ 64-bit

    • NOTE: This is a development version (1.9.0-pre-) of MongoDB.
    • Not recommended for production.

Wed Mar 9 01:36:56 [initandlisten] db version v1.9.0-pre-, pdfile version 4.5
Wed Mar 9 01:36:56 [initandlisten] git version: f4f39d2ea14774a5e11a356882fb1b6c1a86bf55
Wed Mar 9 01:36:56 [initandlisten] build sys info: Linux bs-linux64.10gen.cc 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41

                            • old lock file: /data/db/mongod.lock. probably means unclean shutdown
                              recommend removing file and running --repair
                              see: http://dochub.mongodb.org/core/repair for more information
                              *************
                              Wed Mar 9 01:36:56 [initandlisten] exception in initAndListen std::exception: old lock file, terminating
                              Wed Mar 9 01:36:56 dbexit:
                              Wed Mar 9 01:36:56 [initandlisten] shutdown: going to close listening sockets...
                              Wed Mar 9 01:36:56 [initandlisten] shutdown: going to flush diaglog...
                              Wed Mar 9 01:36:56 [initandlisten] shutdown: going to close sockets...
                              Wed Mar 9 01:36:56 [initandlisten] shutdown: waiting for fs preallocator...
                              Wed Mar 9 01:36:56 [initandlisten] shutdown: closing all files...
                              Wed Mar 9 01:36:56 closeAllFiles() finished
                              Wed Mar 9 01:36:56 dbexit: really exiting now
                              [root@mathias1-256 ~]# rm /data/db/mongod.lock
                              [root@mathias1-256 ~]# mongod --fastsync --replSet rs
                              Wed Mar 9 01:37:06 [initandlisten] MongoDB starting : pid=661 port=27017 dbpath=/data/db/ 64-bit

    • NOTE: This is a development version (1.9.0-pre-) of MongoDB.
    • Not recommended for production.

Wed Mar 9 01:37:06 [initandlisten] db version v1.9.0-pre-, pdfile version 4.5
Wed Mar 9 01:37:06 [initandlisten] git version: f4f39d2ea14774a5e11a356882fb1b6c1a86bf55
Wed Mar 9 01:37:06 [initandlisten] build sys info: Linux bs-linux64.10gen.cc 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41
Wed Mar 9 01:37:07 [initandlisten] waiting for connections on port 27017
Wed Mar 9 01:37:07 [websvr] web admin interface listening on port 28017
Wed Mar 9 01:37:07 [initandlisten] connection accepted from 127.0.0.1:42327 #1
Wed Mar 9 01:37:07 [startReplSets] replSet error self not present in the repl set configuration:
Wed Mar 9 01:37:07 [startReplSets] { _id: "rs", version: 1, members: [

{ _id: 0, host: "50.56.91.235" }

,

{ _id: 1, host: "50.56.91.254" }

,

{ _id: 2, host: "50.56.91.222", priority: 0.0, hidden: true }

] }
Wed Mar 9 01:37:07 [startReplSets] replSet error loading configurations 13497 replSet error self not present in the configuration
Wed Mar 9 01:37:07 [startReplSets] replSet error replication will not start
Wed Mar 9 01:37:07 [startReplSets] replSet error loading set config
Wed Mar 9 01:37:07 [startReplSets] replSet error fatal, stopping replication
Wed Mar 9 01:37:07 [startReplSets] replSet ~RSBase called
Wed Mar 9 01:37:07 [startReplSets] replSet caught exception in startReplSets thread: replSet error self not present in the configuration

ran rs.add("10.181.166.204") against master at this point

Wed Mar 9 01:38:01 [initandlisten] connection accepted from 10.181.166.206:55692 #2
Wed Mar 9 01:38:01 [conn2] end connection 10.181.166.206:55692
Wed Mar 9 01:38:01 [initandlisten] connection accepted from 10.181.166.206:55693 #3
Wed Mar 9 01:38:02 [initandlisten] connection accepted from 10.181.166.207:53379 #4
Wed Mar 9 01:38:02 [conn4] end connection 10.181.166.207:53379
Wed Mar 9 01:38:02 [initandlisten] connection accepted from 10.181.166.207:53380 #5
Wed Mar 9 01:38:02 [initandlisten] connection accepted from 10.181.166.205:32774 #6
Wed Mar 9 01:38:02 [conn6] end connection 10.181.166.205:32774
Wed Mar 9 01:38:02 [initandlisten] connection accepted from 10.181.166.205:32775 #7
^CWed Mar 9 01:38:54 got kill or ctrl c or hup signal 2 (Interrupt), will terminate after current cmd ends
Wed Mar 9 01:38:54 [interruptThread] now exiting
Wed Mar 9 01:38:54 dbexit:
Wed Mar 9 01:38:54 [interruptThread] shutdown: going to close listening sockets...
Wed Mar 9 01:38:54 [interruptThread] closing listening socket: 5
Wed Mar 9 01:38:54 [interruptThread] closing listening socket: 6
Wed Mar 9 01:38:54 [interruptThread] closing listening socket: 7
Wed Mar 9 01:38:54 [interruptThread] closing listening socket: 8
Wed Mar 9 01:38:54 [interruptThread] removing socket file: /tmp/mongodb-27017.sock
Wed Mar 9 01:38:54 [interruptThread] removing socket file: /tmp/mongodb-28017.sock
Wed Mar 9 01:38:54 [interruptThread] shutdown: going to flush diaglog...
Wed Mar 9 01:38:54 [interruptThread] shutdown: going to close sockets...
Wed Mar 9 01:38:54 [interruptThread] shutdown: waiting for fs preallocator...
Wed Mar 9 01:38:54 [interruptThread] shutdown: closing all files...
Wed Mar 9 01:38:54 [conn1] end connection 127.0.0.1:42327
Wed Mar 9 01:38:54 closeAllFiles() finished
Wed Mar 9 01:38:54 [interruptThread] shutdown: removing fs lock...
Wed Mar 9 01:38:54 dbexit: really exiting now
[root@mathias1-256 ~]# mongod --fastsync --replSet rs
Wed Mar 9 01:39:06 [initandlisten] MongoDB starting : pid=692 port=27017 dbpath=/data/db/ 64-bit

    • NOTE: This is a development version (1.9.0-pre-) of MongoDB.
    • Not recommended for production.

Wed Mar 9 01:39:06 [initandlisten] db version v1.9.0-pre-, pdfile version 4.5
Wed Mar 9 01:39:06 [initandlisten] git version: f4f39d2ea14774a5e11a356882fb1b6c1a86bf55
Wed Mar 9 01:39:06 [initandlisten] build sys info: Linux bs-linux64.10gen.cc 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41
Wed Mar 9 01:39:06 [initandlisten] waiting for connections on port 27017
Wed Mar 9 01:39:06 [websvr] web admin interface listening on port 28017
Wed Mar 9 01:39:06 [initandlisten] connection accepted from 127.0.0.1:42334 #1
Wed Mar 9 01:39:06 [startReplSets] replSet error self not present in the repl set configuration:
Wed Mar 9 01:39:06 [startReplSets] { _id: "rs", version: 1, members: [

{ _id: 0, host: "50.56.91.235" }

,

{ _id: 1, host: "50.56.91.254" }

,

{ _id: 2, host: "50.56.91.222", priority: 0.0, hidden: true }

] }
Wed Mar 9 01:39:06 [startReplSets] replSet error loading configurations 13497 replSet error self not present in the configuration
Wed Mar 9 01:39:06 [startReplSets] replSet error replication will not start
Wed Mar 9 01:39:06 [startReplSets] replSet error loading set config
Wed Mar 9 01:39:06 [startReplSets] replSet error fatal, stopping replication
Wed Mar 9 01:39:06 [startReplSets] replSet ~RSBase called
Wed Mar 9 01:39:06 [startReplSets] replSet caught exception in startReplSets thread: replSet error self not present in the configuration
Wed Mar 9 01:39:06 [initandlisten] connection accepted from 10.181.166.207:53386 #2
Wed Mar 9 01:39:06 [initandlisten] connection accepted from 10.181.166.205:32781 #3
Wed Mar 9 01:39:07 [initandlisten] connection accepted from 10.181.166.206:55699 #4
^CWed Mar 9 01:39:16 got kill or ctrl c or hup signal 2 (Interrupt), will terminate after current cmd ends
Wed Mar 9 01:39:16 [interruptThread] now exiting
Wed Mar 9 01:39:16 dbexit:
Wed Mar 9 01:39:16 [interruptThread] shutdown: going to close listening sockets...
Wed Mar 9 01:39:16 [interruptThread] closing listening socket: 5
Wed Mar 9 01:39:16 [interruptThread] closing listening socket: 6
Wed Mar 9 01:39:16 [interruptThread] closing listening socket: 8
Wed Mar 9 01:39:16 [interruptThread] closing listening socket: 9
Wed Mar 9 01:39:16 [interruptThread] removing socket file: /tmp/mongodb-27017.sock
Wed Mar 9 01:39:16 [interruptThread] removing socket file: /tmp/mongodb-28017.sock
Wed Mar 9 01:39:16 [interruptThread] shutdown: going to flush diaglog...
Wed Mar 9 01:39:16 [interruptThread] shutdown: going to close sockets...
Wed Mar 9 01:39:16 [interruptThread] shutdown: waiting for fs preallocator...
Wed Mar 9 01:39:16 [interruptThread] shutdown: closing all files...
Wed Mar 9 01:39:16 [conn1] end connection 127.0.0.1:42334
Wed Mar 9 01:39:16 closeAllFiles() finished
Wed Mar 9 01:39:16 [interruptThread] shutdown: removing fs lock...
Wed Mar 9 01:39:16 dbexit: really exiting now
[root@mathias1-256 ~]# mongod --replSet rs
Wed Mar 9 01:39:21 [initandlisten] MongoDB starting : pid=712 port=27017 dbpath=/data/db/ 64-bit

    • NOTE: This is a development version (1.9.0-pre-) of MongoDB.
    • Not recommended for production.

Wed Mar 9 01:39:21 [initandlisten] db version v1.9.0-pre-, pdfile version 4.5
Wed Mar 9 01:39:21 [initandlisten] git version: f4f39d2ea14774a5e11a356882fb1b6c1a86bf55
Wed Mar 9 01:39:21 [initandlisten] build sys info: Linux bs-linux64.10gen.cc 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41
Wed Mar 9 01:39:21 [initandlisten] waiting for connections on port 27017
Wed Mar 9 01:39:21 [websvr] web admin interface listening on port 28017
Wed Mar 9 01:39:21 [initandlisten] connection accepted from 127.0.0.1:42341 #1
Wed Mar 9 01:39:21 [startReplSets] replSet error self not present in the repl set configuration:
Wed Mar 9 01:39:21 [startReplSets] { _id: "rs", version: 1, members: [

{ _id: 0, host: "50.56.91.235" }

,

{ _id: 1, host: "50.56.91.254" }

,

{ _id: 2, host: "50.56.91.222", priority: 0.0, hidden: true }

] }
Wed Mar 9 01:39:21 [startReplSets] replSet error loading configurations 13497 replSet error self not present in the configuration
Wed Mar 9 01:39:21 [startReplSets] replSet error replication will not start
Wed Mar 9 01:39:21 [startReplSets] replSet error loading set config
Wed Mar 9 01:39:21 [startReplSets] replSet error fatal, stopping replication
Wed Mar 9 01:39:21 [startReplSets] replSet ~RSBase called
Wed Mar 9 01:39:21 [startReplSets] replSet caught exception in startReplSets thread: replSet error self not present in the configuration
Wed Mar 9 01:39:22 [initandlisten] connection accepted from 10.181.166.207:53389 #2
Wed Mar 9 01:39:22 [initandlisten] connection accepted from 10.181.166.205:32784 #3
Wed Mar 9 01:39:23 [initandlisten] connection accepted from 10.181.166.206:55702 #4
Wed Mar 9 01:40:45 [initandlisten] connection accepted from 50.56.91.254:47895 #5
Wed Mar 9 01:40:45 [conn5] end connection 50.56.91.254:47895
Wed Mar 9 01:40:45 [initandlisten] connection accepted from 50.56.91.254:47896 #6
Wed Mar 9 01:40:46 [initandlisten] connection accepted from 50.56.91.235:37995 #7
Wed Mar 9 01:40:46 [initandlisten] connection accepted from 50.56.91.222:43453 #8
Wed Mar 9 01:40:46 [conn7] end connection 50.56.91.235:37995
Wed Mar 9 01:40:46 [conn8] end connection 50.56.91.222:43453
Wed Mar 9 01:40:46 [initandlisten] connection accepted from 50.56.91.235:37996 #9
Wed Mar 9 01:40:46 [initandlisten] connection accepted from 50.56.91.222:43454 #10
^[[A
^[[A
^[[A
^CWed Mar 9 01:40:56 got kill or ctrl c or hup signal 2 (Interrupt), will terminate after current cmd ends
Wed Mar 9 01:40:56 [interruptThread] now exiting
Wed Mar 9 01:40:56 dbexit:
Wed Mar 9 01:40:56 [interruptThread] shutdown: going to close listening sockets...
Wed Mar 9 01:40:56 [interruptThread] closing listening socket: 5
Wed Mar 9 01:40:56 [interruptThread] closing listening socket: 6
Wed Mar 9 01:40:56 [interruptThread] closing listening socket: 7
Wed Mar 9 01:40:56 [interruptThread] closing listening socket: 9
Wed Mar 9 01:40:56 [interruptThread] removing socket file: /tmp/mongodb-27017.sock
Wed Mar 9 01:40:56 [interruptThread] removing socket file: /tmp/mongodb-28017.sock
Wed Mar 9 01:40:56 [interruptThread] shutdown: going to flush diaglog...
Wed Mar 9 01:40:56 [interruptThread] shutdown: going to close sockets...
Wed Mar 9 01:40:56 [interruptThread] shutdown: waiting for fs preallocator...
Wed Mar 9 01:40:56 [interruptThread] shutdown: closing all files...
Wed Mar 9 01:40:56 [conn1] end connection 127.0.0.1:42341
Wed Mar 9 01:40:56 closeAllFiles() finished
Wed Mar 9 01:40:56 [interruptThread] shutdown: removing fs lock...
Wed Mar 9 01:40:56 dbexit: really exiting now



 Comments   
Comment by auto [ 13/Mar/11 ]

Author:

{u'login': u'kchodorow', u'name': u'Kristina', u'email': u'kristina@10gen.com'}

Message: fix fastsync to not be confused on new members SERVER-2717
https://github.com/mongodb/mongo/commit/2ad98fd1fa41b51f89e14c3c3b655f788564b09a

Comment by auto [ 11/Mar/11 ]

Author:

{u'login': u'kchodorow', u'name': u'Kristina', u'email': u'kristina@10gen.com'}

Message: fix fastsync to not be confused on new members SERVER-2717
https://github.com/mongodb/mongo/commit/6bb9cfc64b8ffb9ecd73728580d248af1ed7ba54

Generated at Thu Feb 08 03:00:59 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.