Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-7810

Replication lag when updates handled by database.

    • Type: Icon: Question Question
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 2.2.2
    • Component/s: Replication
    • Labels:
      None
    • Environment:
      version: 2.2.2-rc1
      git version: nogitversion

      I have next configuration:
      server1 - (mongos, mongod cfg, mongod --replSet first, application server[write] )
      server2 - (mongod arbiter, mongod --replSet first)
      server3 - (mongod cfg, mongod arbiter, mongod --replSet second)
      server4 - (mongos, mongod cfg, mongod --replSet second, application server[read] )

      All requests for insert/update going to server1/application server.
      All requetss for find going to server4/application server.

      There was about 20 concurrent updates. (collection that handle updates have 819 366 177 documents, and it is capped. I don't change object size in update.)
      Update was handled using indexes for where condition.

      But there is next interesting behavior:

      • If I set master for replset first, to server2 - it handle updates normally, but server1 has replication lag, and it grow up to 1 hour.
      • Then I reject updates for some time, and when replication lag equal to zero, I set master to server1.
      • And server1 also handle updates normally, but server2 now has replication lag, and it grows.

      Why SECONDARY can't handle operations like PRIMARY in this case?

        1. buffers-memory.png
          buffers-memory.png
          30 kB
        2. cached-memory.png
          cached-memory.png
          29 kB
        3. complex-load.png
          complex-load.png
          42 kB
        4. connections.png
          connections.png
          19 kB
        5. connections-more-long-period.png
          connections-more-long-period.png
          37 kB
        6. database-operations.png
          database-operations.png
          35 kB
        7. free-memory.png
          free-memory.png
          27 kB
        8. hdd.png
          hdd.png
          41 kB
        9. memory-footprints.png
          memory-footprints.png
          27 kB
        10. memory-footprints-2.png
          memory-footprints-2.png
          30 kB
        11. operations-counters.png
          operations-counters.png
          52 kB
        12. page-faults-minute.png
          page-faults-minute.png
          38 kB
        13. replication-lag.png
          replication-lag.png
          34 kB
        14. total-background-flus-time-ms-in-last-1-minute.png
          total-background-flus-time-ms-in-last-1-minute.png
          36 kB

            Assignee:
            david.hows David Hows
            Reporter:
            azat Azat Khuzhin
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: