Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-2717

--fastsync broken with RS

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Critical - P2 Critical - P2
    • 1.8.0
    • Affects Version/s: None
    • Component/s: Replication
    • Labels:
      None
    • ALL

      Even restarting without --fastsync didnt fix this (it used to)

      [root@mathias1-256 ~]# mongod --fastsync --replSet rs
      Wed Mar 9 01:36:56 [initandlisten] MongoDB starting : pid=656 port=27017 dbpath=/data/db/ 64-bit

        • NOTE: This is a development version (1.9.0-pre-) of MongoDB.
        • Not recommended for production.

      Wed Mar 9 01:36:56 [initandlisten] db version v1.9.0-pre-, pdfile version 4.5
      Wed Mar 9 01:36:56 [initandlisten] git version: f4f39d2ea14774a5e11a356882fb1b6c1a86bf55
      Wed Mar 9 01:36:56 [initandlisten] build sys info: Linux bs-linux64.10gen.cc 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41

                                • old lock file: /data/db/mongod.lock. probably means unclean shutdown
                                  recommend removing file and running --repair
                                  see: http://dochub.mongodb.org/core/repair for more information
                                  *************
                                  Wed Mar 9 01:36:56 [initandlisten] exception in initAndListen std::exception: old lock file, terminating
                                  Wed Mar 9 01:36:56 dbexit:
                                  Wed Mar 9 01:36:56 [initandlisten] shutdown: going to close listening sockets...
                                  Wed Mar 9 01:36:56 [initandlisten] shutdown: going to flush diaglog...
                                  Wed Mar 9 01:36:56 [initandlisten] shutdown: going to close sockets...
                                  Wed Mar 9 01:36:56 [initandlisten] shutdown: waiting for fs preallocator...
                                  Wed Mar 9 01:36:56 [initandlisten] shutdown: closing all files...
                                  Wed Mar 9 01:36:56 closeAllFiles() finished
                                  Wed Mar 9 01:36:56 dbexit: really exiting now
                                  [root@mathias1-256 ~]# rm /data/db/mongod.lock
                                  [root@mathias1-256 ~]# mongod --fastsync --replSet rs
                                  Wed Mar 9 01:37:06 [initandlisten] MongoDB starting : pid=661 port=27017 dbpath=/data/db/ 64-bit

        • NOTE: This is a development version (1.9.0-pre-) of MongoDB.
        • Not recommended for production.

      Wed Mar 9 01:37:06 [initandlisten] db version v1.9.0-pre-, pdfile version 4.5
      Wed Mar 9 01:37:06 [initandlisten] git version: f4f39d2ea14774a5e11a356882fb1b6c1a86bf55
      Wed Mar 9 01:37:06 [initandlisten] build sys info: Linux bs-linux64.10gen.cc 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41
      Wed Mar 9 01:37:07 [initandlisten] waiting for connections on port 27017
      Wed Mar 9 01:37:07 [websvr] web admin interface listening on port 28017
      Wed Mar 9 01:37:07 [initandlisten] connection accepted from 127.0.0.1:42327 #1
      Wed Mar 9 01:37:07 [startReplSets] replSet error self not present in the repl set configuration:
      Wed Mar 9 01:37:07 [startReplSets] { _id: "rs", version: 1, members: [

      { _id: 0, host: "50.56.91.235" }

      ,

      { _id: 1, host: "50.56.91.254" }

      ,

      { _id: 2, host: "50.56.91.222", priority: 0.0, hidden: true }

      ] }
      Wed Mar 9 01:37:07 [startReplSets] replSet error loading configurations 13497 replSet error self not present in the configuration
      Wed Mar 9 01:37:07 [startReplSets] replSet error replication will not start
      Wed Mar 9 01:37:07 [startReplSets] replSet error loading set config
      Wed Mar 9 01:37:07 [startReplSets] replSet error fatal, stopping replication
      Wed Mar 9 01:37:07 [startReplSets] replSet ~RSBase called
      Wed Mar 9 01:37:07 [startReplSets] replSet caught exception in startReplSets thread: replSet error self not present in the configuration

      ran rs.add("10.181.166.204") against master at this point

      Wed Mar 9 01:38:01 [initandlisten] connection accepted from 10.181.166.206:55692 #2
      Wed Mar 9 01:38:01 [conn2] end connection 10.181.166.206:55692
      Wed Mar 9 01:38:01 [initandlisten] connection accepted from 10.181.166.206:55693 #3
      Wed Mar 9 01:38:02 [initandlisten] connection accepted from 10.181.166.207:53379 #4
      Wed Mar 9 01:38:02 [conn4] end connection 10.181.166.207:53379
      Wed Mar 9 01:38:02 [initandlisten] connection accepted from 10.181.166.207:53380 #5
      Wed Mar 9 01:38:02 [initandlisten] connection accepted from 10.181.166.205:32774 #6
      Wed Mar 9 01:38:02 [conn6] end connection 10.181.166.205:32774
      Wed Mar 9 01:38:02 [initandlisten] connection accepted from 10.181.166.205:32775 #7
      ^CWed Mar 9 01:38:54 got kill or ctrl c or hup signal 2 (Interrupt), will terminate after current cmd ends
      Wed Mar 9 01:38:54 [interruptThread] now exiting
      Wed Mar 9 01:38:54 dbexit:
      Wed Mar 9 01:38:54 [interruptThread] shutdown: going to close listening sockets...
      Wed Mar 9 01:38:54 [interruptThread] closing listening socket: 5
      Wed Mar 9 01:38:54 [interruptThread] closing listening socket: 6
      Wed Mar 9 01:38:54 [interruptThread] closing listening socket: 7
      Wed Mar 9 01:38:54 [interruptThread] closing listening socket: 8
      Wed Mar 9 01:38:54 [interruptThread] removing socket file: /tmp/mongodb-27017.sock
      Wed Mar 9 01:38:54 [interruptThread] removing socket file: /tmp/mongodb-28017.sock
      Wed Mar 9 01:38:54 [interruptThread] shutdown: going to flush diaglog...
      Wed Mar 9 01:38:54 [interruptThread] shutdown: going to close sockets...
      Wed Mar 9 01:38:54 [interruptThread] shutdown: waiting for fs preallocator...
      Wed Mar 9 01:38:54 [interruptThread] shutdown: closing all files...
      Wed Mar 9 01:38:54 [conn1] end connection 127.0.0.1:42327
      Wed Mar 9 01:38:54 closeAllFiles() finished
      Wed Mar 9 01:38:54 [interruptThread] shutdown: removing fs lock...
      Wed Mar 9 01:38:54 dbexit: really exiting now
      [root@mathias1-256 ~]# mongod --fastsync --replSet rs
      Wed Mar 9 01:39:06 [initandlisten] MongoDB starting : pid=692 port=27017 dbpath=/data/db/ 64-bit

        • NOTE: This is a development version (1.9.0-pre-) of MongoDB.
        • Not recommended for production.

      Wed Mar 9 01:39:06 [initandlisten] db version v1.9.0-pre-, pdfile version 4.5
      Wed Mar 9 01:39:06 [initandlisten] git version: f4f39d2ea14774a5e11a356882fb1b6c1a86bf55
      Wed Mar 9 01:39:06 [initandlisten] build sys info: Linux bs-linux64.10gen.cc 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41
      Wed Mar 9 01:39:06 [initandlisten] waiting for connections on port 27017
      Wed Mar 9 01:39:06 [websvr] web admin interface listening on port 28017
      Wed Mar 9 01:39:06 [initandlisten] connection accepted from 127.0.0.1:42334 #1
      Wed Mar 9 01:39:06 [startReplSets] replSet error self not present in the repl set configuration:
      Wed Mar 9 01:39:06 [startReplSets] { _id: "rs", version: 1, members: [

      { _id: 0, host: "50.56.91.235" }

      ,

      { _id: 1, host: "50.56.91.254" }

      ,

      { _id: 2, host: "50.56.91.222", priority: 0.0, hidden: true }

      ] }
      Wed Mar 9 01:39:06 [startReplSets] replSet error loading configurations 13497 replSet error self not present in the configuration
      Wed Mar 9 01:39:06 [startReplSets] replSet error replication will not start
      Wed Mar 9 01:39:06 [startReplSets] replSet error loading set config
      Wed Mar 9 01:39:06 [startReplSets] replSet error fatal, stopping replication
      Wed Mar 9 01:39:06 [startReplSets] replSet ~RSBase called
      Wed Mar 9 01:39:06 [startReplSets] replSet caught exception in startReplSets thread: replSet error self not present in the configuration
      Wed Mar 9 01:39:06 [initandlisten] connection accepted from 10.181.166.207:53386 #2
      Wed Mar 9 01:39:06 [initandlisten] connection accepted from 10.181.166.205:32781 #3
      Wed Mar 9 01:39:07 [initandlisten] connection accepted from 10.181.166.206:55699 #4
      ^CWed Mar 9 01:39:16 got kill or ctrl c or hup signal 2 (Interrupt), will terminate after current cmd ends
      Wed Mar 9 01:39:16 [interruptThread] now exiting
      Wed Mar 9 01:39:16 dbexit:
      Wed Mar 9 01:39:16 [interruptThread] shutdown: going to close listening sockets...
      Wed Mar 9 01:39:16 [interruptThread] closing listening socket: 5
      Wed Mar 9 01:39:16 [interruptThread] closing listening socket: 6
      Wed Mar 9 01:39:16 [interruptThread] closing listening socket: 8
      Wed Mar 9 01:39:16 [interruptThread] closing listening socket: 9
      Wed Mar 9 01:39:16 [interruptThread] removing socket file: /tmp/mongodb-27017.sock
      Wed Mar 9 01:39:16 [interruptThread] removing socket file: /tmp/mongodb-28017.sock
      Wed Mar 9 01:39:16 [interruptThread] shutdown: going to flush diaglog...
      Wed Mar 9 01:39:16 [interruptThread] shutdown: going to close sockets...
      Wed Mar 9 01:39:16 [interruptThread] shutdown: waiting for fs preallocator...
      Wed Mar 9 01:39:16 [interruptThread] shutdown: closing all files...
      Wed Mar 9 01:39:16 [conn1] end connection 127.0.0.1:42334
      Wed Mar 9 01:39:16 closeAllFiles() finished
      Wed Mar 9 01:39:16 [interruptThread] shutdown: removing fs lock...
      Wed Mar 9 01:39:16 dbexit: really exiting now
      [root@mathias1-256 ~]# mongod --replSet rs
      Wed Mar 9 01:39:21 [initandlisten] MongoDB starting : pid=712 port=27017 dbpath=/data/db/ 64-bit

        • NOTE: This is a development version (1.9.0-pre-) of MongoDB.
        • Not recommended for production.

      Wed Mar 9 01:39:21 [initandlisten] db version v1.9.0-pre-, pdfile version 4.5
      Wed Mar 9 01:39:21 [initandlisten] git version: f4f39d2ea14774a5e11a356882fb1b6c1a86bf55
      Wed Mar 9 01:39:21 [initandlisten] build sys info: Linux bs-linux64.10gen.cc 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41
      Wed Mar 9 01:39:21 [initandlisten] waiting for connections on port 27017
      Wed Mar 9 01:39:21 [websvr] web admin interface listening on port 28017
      Wed Mar 9 01:39:21 [initandlisten] connection accepted from 127.0.0.1:42341 #1
      Wed Mar 9 01:39:21 [startReplSets] replSet error self not present in the repl set configuration:
      Wed Mar 9 01:39:21 [startReplSets] { _id: "rs", version: 1, members: [

      { _id: 0, host: "50.56.91.235" }

      ,

      { _id: 1, host: "50.56.91.254" }

      ,

      { _id: 2, host: "50.56.91.222", priority: 0.0, hidden: true }

      ] }
      Wed Mar 9 01:39:21 [startReplSets] replSet error loading configurations 13497 replSet error self not present in the configuration
      Wed Mar 9 01:39:21 [startReplSets] replSet error replication will not start
      Wed Mar 9 01:39:21 [startReplSets] replSet error loading set config
      Wed Mar 9 01:39:21 [startReplSets] replSet error fatal, stopping replication
      Wed Mar 9 01:39:21 [startReplSets] replSet ~RSBase called
      Wed Mar 9 01:39:21 [startReplSets] replSet caught exception in startReplSets thread: replSet error self not present in the configuration
      Wed Mar 9 01:39:22 [initandlisten] connection accepted from 10.181.166.207:53389 #2
      Wed Mar 9 01:39:22 [initandlisten] connection accepted from 10.181.166.205:32784 #3
      Wed Mar 9 01:39:23 [initandlisten] connection accepted from 10.181.166.206:55702 #4
      Wed Mar 9 01:40:45 [initandlisten] connection accepted from 50.56.91.254:47895 #5
      Wed Mar 9 01:40:45 [conn5] end connection 50.56.91.254:47895
      Wed Mar 9 01:40:45 [initandlisten] connection accepted from 50.56.91.254:47896 #6
      Wed Mar 9 01:40:46 [initandlisten] connection accepted from 50.56.91.235:37995 #7
      Wed Mar 9 01:40:46 [initandlisten] connection accepted from 50.56.91.222:43453 #8
      Wed Mar 9 01:40:46 [conn7] end connection 50.56.91.235:37995
      Wed Mar 9 01:40:46 [conn8] end connection 50.56.91.222:43453
      Wed Mar 9 01:40:46 [initandlisten] connection accepted from 50.56.91.235:37996 #9
      Wed Mar 9 01:40:46 [initandlisten] connection accepted from 50.56.91.222:43454 #10
      ^[[A
      ^[[A
      ^[[A
      ^CWed Mar 9 01:40:56 got kill or ctrl c or hup signal 2 (Interrupt), will terminate after current cmd ends
      Wed Mar 9 01:40:56 [interruptThread] now exiting
      Wed Mar 9 01:40:56 dbexit:
      Wed Mar 9 01:40:56 [interruptThread] shutdown: going to close listening sockets...
      Wed Mar 9 01:40:56 [interruptThread] closing listening socket: 5
      Wed Mar 9 01:40:56 [interruptThread] closing listening socket: 6
      Wed Mar 9 01:40:56 [interruptThread] closing listening socket: 7
      Wed Mar 9 01:40:56 [interruptThread] closing listening socket: 9
      Wed Mar 9 01:40:56 [interruptThread] removing socket file: /tmp/mongodb-27017.sock
      Wed Mar 9 01:40:56 [interruptThread] removing socket file: /tmp/mongodb-28017.sock
      Wed Mar 9 01:40:56 [interruptThread] shutdown: going to flush diaglog...
      Wed Mar 9 01:40:56 [interruptThread] shutdown: going to close sockets...
      Wed Mar 9 01:40:56 [interruptThread] shutdown: waiting for fs preallocator...
      Wed Mar 9 01:40:56 [interruptThread] shutdown: closing all files...
      Wed Mar 9 01:40:56 [conn1] end connection 127.0.0.1:42341
      Wed Mar 9 01:40:56 closeAllFiles() finished
      Wed Mar 9 01:40:56 [interruptThread] shutdown: removing fs lock...
      Wed Mar 9 01:40:56 dbexit: really exiting now

            Assignee:
            kristina Kristina Chodorow (Inactive)
            Reporter:
            mathias@mongodb.com Mathias Stearn
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: