|
Here is most recent client log snippet:
2018-01-09 03:35:37,791 INFO org.mongodb.driver.cluster - Cluster created with settings {hosts=[10.0.0.131:27017, 10.0.0.87:27017, 10.0.0.94:27017], mode=MULTIPLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500}
|
2018-01-09 03:35:37,793 INFO org.mongodb.driver.cluster - Adding discovered server 10.0.0.131:27017 to client view of cluster
|
2018-01-09 03:35:37,831 INFO org.mongodb.driver.cluster - Adding discovered server 10.0.0.87:27017 to client view of cluster
|
2018-01-09 03:35:37,834 INFO org.mongodb.driver.cluster - Adding discovered server 10.0.0.94:27017 to client view of cluster
|
[INFO] [01/09/2018 03:35:37.858] [warehouse-connector-akka.actor.default-dispatcher-4] [akka://warehouse-connector/user/oplog-consumer] starting tail from: TS time:Tue Jan 09 03:25:37 UTC 2018 inc:0
|
2018-01-09 03:35:37,896 INFO org.mongodb.driver.connection - Opened connection [connectionId{localValue:3, serverValue:29125}] to 10.0.0.94:27017
|
2018-01-09 03:35:37,899 INFO org.mongodb.driver.connection - Opened connection [connectionId{localValue:1, serverValue:17292}] to 10.0.0.131:27017
|
2018-01-09 03:35:37,903 INFO org.mongodb.driver.connection - Opened connection [connectionId{localValue:2, serverValue:16546}] to 10.0.0.87:27017
|
2018-01-09 03:35:37,911 INFO org.mongodb.driver.cluster - Monitor thread successfully connected to server with description ServerDescription{address=10.0.0.131:27017, type=REPLICA_SET_SECONDARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 1]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=null, roundTripTimeNanos=8313019, setName='repl-emagine', canonicalAddress=ip-10-0-0-131:27017, hosts=[ip-10-0-0-131:27017, ip-10-0-0-87:27017, ip-10-0-0-94:27017], passives=[], arbiters=[], primary='ip-10-0-0-94:27017', tagSet=TagSet{[Tag{name='prefer', value='2'}]}, electionId=null, setVersion=56, lastWriteDate=Tue Jan 09 03:35:33 UTC 2018, lastUpdateTimeNanos=518102448359437}
|
2018-01-09 03:35:37,912 INFO org.mongodb.driver.cluster - Discovered cluster type of REPLICA_SET
|
2018-01-09 03:35:37,912 INFO org.mongodb.driver.cluster - Adding discovered server ip-10-0-0-131:27017 to client view of cluster
|
2018-01-09 03:35:37,915 INFO org.mongodb.driver.cluster - Monitor thread successfully connected to server with description ServerDescription{address=10.0.0.87:27017, type=REPLICA_SET_SECONDARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 1]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=null, roundTripTimeNanos=11698765, setName='repl-emagine', canonicalAddress=ip-10-0-0-87:27017, hosts=[ip-10-0-0-131:27017, ip-10-0-0-87:27017, ip-10-0-0-94:27017], passives=[], arbiters=[], primary='ip-10-0-0-94:27017', tagSet=TagSet{[Tag{name='prefer', value='3'}]}, electionId=null, setVersion=56, lastWriteDate=Tue Jan 09 03:35:33 UTC 2018, lastUpdateTimeNanos=518102452352058}
|
2018-01-09 03:35:37,917 INFO org.mongodb.driver.cluster - Monitor thread successfully connected to server with description ServerDescription{address=10.0.0.94:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 1]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=null, roundTripTimeNanos=16390944, setName='repl-emagine', canonicalAddress=ip-10-0-0-94:27017, hosts=[ip-10-0-0-131:27017, ip-10-0-0-87:27017, ip-10-0-0-94:27017], passives=[], arbiters=[], primary='ip-10-0-0-94:27017', tagSet=TagSet{[Tag{name='prefer', value='1'}]}, electionId=7fffffff0000000000000001, setVersion=56, lastWriteDate=Tue Jan 09 03:35:33 UTC 2018, lastUpdateTimeNanos=518102454391234}
|
2018-01-09 03:35:37,917 INFO org.mongodb.driver.cluster - Adding discovered server ip-10-0-0-87:27017 to client view of cluster
|
2018-01-09 03:35:37,919 INFO org.mongodb.driver.cluster - Adding discovered server ip-10-0-0-94:27017 to client view of cluster
|
2018-01-09 03:35:37,920 INFO org.mongodb.driver.cluster - Canonical address ip-10-0-0-131:27017 does not match server address. Removing 10.0.0.131:27017 from client view of cluster
|
2018-01-09 03:35:37,923 INFO org.mongodb.driver.cluster - Server 10.0.0.94:27017 is no longer a member of the replica set. Removing from client view of cluster.
|
2018-01-09 03:35:37,923 INFO org.mongodb.driver.cluster - Server 10.0.0.87:27017 is no longer a member of the replica set. Removing from client view of cluster.
|
2018-01-09 03:35:37,923 INFO org.mongodb.driver.cluster - Canonical address ip-10-0-0-94:27017 does not match server address. Removing 10.0.0.94:27017 from client view of cluster
|
2018-01-09 03:35:37,945 INFO org.mongodb.driver.connection - Opened connection [connectionId{localValue:5, serverValue:16547}] to ip-10-0-0-87:27017
|
2018-01-09 03:35:37,946 INFO org.mongodb.driver.connection - Opened connection [connectionId{localValue:6, serverValue:29126}] to ip-10-0-0-94:27017
|
2018-01-09 03:35:37,947 INFO org.mongodb.driver.connection - Opened connection [connectionId{localValue:4, serverValue:17293}] to ip-10-0-0-131:27017
|
2018-01-09 03:35:37,949 INFO org.mongodb.driver.cluster - Monitor thread successfully connected to server with description ServerDescription{address=ip-10-0-0-87:27017, type=REPLICA_SET_SECONDARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 1]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=null, roundTripTimeNanos=3068935, setName='repl-emagine', canonicalAddress=ip-10-0-0-87:27017, hosts=[ip-10-0-0-131:27017, ip-10-0-0-87:27017, ip-10-0-0-94:27017], passives=[], arbiters=[], primary='ip-10-0-0-94:27017', tagSet=TagSet{[Tag{name='prefer', value='3'}]}, electionId=null, setVersion=56, lastWriteDate=Tue Jan 09 03:35:33 UTC 2018, lastUpdateTimeNanos=518102486236106}
|
2018-01-09 03:35:37,950 INFO org.mongodb.driver.cluster - Monitor thread successfully connected to server with description ServerDescription{address=ip-10-0-0-94:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 1]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=null, roundTripTimeNanos=2963627, setName='repl-emagine', canonicalAddress=ip-10-0-0-94:27017, hosts=[ip-10-0-0-131:27017, ip-10-0-0-87:27017, ip-10-0-0-94:27017], passives=[], arbiters=[], primary='ip-10-0-0-94:27017', tagSet=TagSet{[Tag{name='prefer', value='1'}]}, electionId=7fffffff0000000000000001, setVersion=56, lastWriteDate=Tue Jan 09 03:35:33 UTC 2018, lastUpdateTimeNanos=518102487544878}
|
2018-01-09 03:35:37,950 INFO org.mongodb.driver.cluster - Setting max election id to 7fffffff0000000000000001 from replica set primary ip-10-0-0-94:27017
|
2018-01-09 03:35:37,951 INFO org.mongodb.driver.cluster - Monitor thread successfully connected to server with description ServerDescription{address=ip-10-0-0-131:27017, type=REPLICA_SET_SECONDARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 1]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=null, roundTripTimeNanos=4039335, setName='repl-emagine', canonicalAddress=ip-10-0-0-131:27017, hosts=[ip-10-0-0-131:27017, ip-10-0-0-87:27017, ip-10-0-0-94:27017], passives=[], arbiters=[], primary='ip-10-0-0-94:27017', tagSet=TagSet{[Tag{name='prefer', value='2'}]}, electionId=null, setVersion=56, lastWriteDate=Tue Jan 09 03:35:33 UTC 2018, lastUpdateTimeNanos=518102489009718}
|
2018-01-09 03:35:37,951 INFO org.mongodb.driver.cluster - Setting max set version to 56 from replica set primary ip-10-0-0-94:27017
|
2018-01-09 03:35:37,952 INFO org.mongodb.driver.cluster - Discovered replica set primary ip-10-0-0-94:27017
|
2018-01-09 03:35:38,054 INFO org.mongodb.driver.connection - Opened connection [connectionId{localValue:7, serverValue:17294}] to ip-10-0-0-131:27017
|
2018-01-09 03:40:35,860 INFO metrics - type=HISTOGRAM, name=emaginepos.connector.transform.Transformer.oplog-lag, count=0, min=0, max=0, mean=0.0, stddev=0.0, median=0.0, p75=0.0, p95=0.0, p98=0.0, p99=0.0, p999=0.0
|
2018-01-09 03:40:35,861 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.BatchReportTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,862 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.BatchReportTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,862 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.CustomerTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,862 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.CustomerTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,862 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.DiscountTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,862 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.DiscountTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,862 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.EmployeeRoleTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.EmployeeRoleTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.EmployeeTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.EmployeeTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.LocationTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.LocationTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.MenuItemTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.MenuItemTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupItemLocationTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupItemLocationTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupItemTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupItemTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierOptionTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierOptionTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrderTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrderTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrderTypeTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrderTypeTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrganizationTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrganizationTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.PaymentMethodTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.PaymentMethodTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.PriceLevelTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.PriceLevelTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ReasonTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ReasonTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.StationTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.StationTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.SurchargeTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,867 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.SurchargeTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,867 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TaxTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,867 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TaxTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,867 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TeamTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,867 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TeamTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,867 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TimesheetTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,867 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TimesheetTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,868 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.UniqueModifierTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:40:35,868 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.UniqueModifierTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
[INFO] [01/09/2018 03:43:08.068] [warehouse-connector-akka.actor.default-dispatcher-9] [akka://warehouse-connector/user/oplog-consumer] started reading from cursor
|
2018-01-09 03:43:08,228 INFO org.mongodb.driver.connection - Opened connection [connectionId{localValue:8, serverValue:17299}] to ip-10-0-0-131:27017
|
2018-01-09 03:43:16,064 INFO org.mongodb.driver.connection - Opened connection [connectionId{localValue:9, serverValue:17300}] to ip-10-0-0-131:27017
|
2018-01-09 03:43:21,452 INFO org.mongodb.driver.connection - Opened connection [connectionId{localValue:10, serverValue:17301}] to ip-10-0-0-131:27017
|
[WARN] [01/09/2018 03:43:41.232] [warehouse-connector-akka.actor.default-dispatcher-7] [akka://warehouse-connector/user/oplog-consumer] MongoException: Query failed with error code 175 and error message 'PlanExecutor killed: CappedPositionLost: CollectionScan died due to failure to restore tailable cursor position. Last seen record id: RecordId(6508891584103186443)' on server ip-10-0-0-131:27017, restarting after 1311572 reads.
|
[INFO] [01/09/2018 03:43:56.246] [warehouse-connector-akka.actor.default-dispatcher-4] [akka://warehouse-connector/user/oplog-consumer] starting tail from: TS time:Tue Jan 09 03:43:37 UTC 2018 inc:11
|
2018-01-09 03:45:35,859 INFO metrics - type=HISTOGRAM, name=emaginepos.connector.transform.Transformer.oplog-lag, count=9649, min=4, max=1051, mean=490.0414499369277, stddev=304.0537832436827, median=481.0, p75=739.0, p95=986.0, p98=1016.0, p99=1034.0, p999=1048.0
|
2018-01-09 03:45:35,860 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.BatchReportTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,861 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.BatchReportTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,861 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.CustomerTransformer.insert, count=4, mean_rate=0.40142760419240786, m1=0.4595960410195186, m5=0.5187358076928581, m15=0.23080377163097426, rate_unit=events/minute
|
2018-01-09 03:45:35,861 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.CustomerTransformer.update, count=2, mean_rate=0.20071379869874875, m1=0.2198308663397613, m5=0.2571885451136742, m15=0.11508043541086072, rate_unit=events/minute
|
2018-01-09 03:45:35,861 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.DiscountTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,861 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.DiscountTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,861 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.EmployeeRoleTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,862 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.EmployeeRoleTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,862 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.EmployeeTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,862 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.EmployeeTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,862 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.LocationTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.LocationTransformer.update, count=1, mean_rate=0.10035870815585483, m1=0.10991543316988064, m5=0.1285942725568371, m15=0.05754021770543036, rate_unit=events/minute
|
2018-01-09 03:45:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.MenuItemTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.MenuItemTransformer.update, count=1, mean_rate=0.1003588329745165, m1=0.10112708036951136, m5=0.12646879618460594, m15=0.057221436153510934, rate_unit=events/minute
|
2018-01-09 03:45:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupItemLocationTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupItemLocationTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupItemTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupItemTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,863 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierGroupTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierOptionTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ModifierOptionTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrderTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrderTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrderTypeTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrderTypeTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrganizationTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.OrganizationTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.PaymentMethodTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,864 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.PaymentMethodTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.PriceLevelTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.PriceLevelTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ReasonTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.ReasonTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.StationTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.StationTransformer.update, count=25, mean_rate=2.509044211526626, m1=2.7901120486662663, m5=3.2236820135729944, m15=1.439796581959679, rate_unit=events/minute
|
2018-01-09 03:45:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.SurchargeTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.SurchargeTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TaxTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,865 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TaxTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TeamTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TeamTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TimesheetTransformer.insert, count=7, mean_rate=0.7025498575011336, m1=0.7187859490647415, m5=0.8875124427675815, m15=0.4008741329212487, rate_unit=events/minute
|
2018-01-09 03:45:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.TimesheetTransformer.update, count=195, mean_rate=19.571030242593437, m1=22.088706153427285, m5=25.209293562799097, m15=11.239760985782377, rate_unit=events/minute
|
2018-01-09 03:45:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.UniqueModifierTransformer.insert, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
2018-01-09 03:45:35,866 INFO metrics - type=METER, name=emaginepos.connector.transform.collection.UniqueModifierTransformer.update, count=0, mean_rate=0.0, m1=0.0, m5=0.0, m15=0.0, rate_unit=events/minute
|
[INFO] [01/09/2018 03:46:06.283] [warehouse-connector-akka.actor.default-dispatcher-7] [akka://warehouse-connector/user/oplog-consumer] started reading from cursor
|
[WARN] [01/09/2018 03:46:29.146] [warehouse-connector-akka.actor.default-dispatcher-7] [akka://warehouse-connector/user/oplog-consumer] MongoException: Query failed with error code 175 and error message 'PlanExecutor killed: CappedPositionLost: CollectionScan died due to failure to restore tailable cursor position. Last seen record id: RecordId(6508892305657692169)' on server ip-10-0-0-131:27017, restarting after 4011 reads.
|
[INFO] [01/09/2018 03:46:44.167] [warehouse-connector-akka.actor.default-dispatcher-6] [akka://warehouse-connector/user/oplog-consumer] starting tail from: TS time:Tue Jan 09 03:46:25 UTC 2018 inc:9
|
[INFO] [01/09/2018 03:47:33.420] [warehouse-connector-akka.actor.default-dispatcher-8] [akka://warehouse-connector/user/oplog-consumer] started reading from cursor
|
[WARN] [01/09/2018 03:47:43.741] [warehouse-connector-akka.actor.default-dispatcher-5] [akka://warehouse-connector/user/oplog-consumer] MongoException: Query failed with error code 175 and error message 'PlanExecutor killed: CappedPositionLost: CollectionScan died due to failure to restore tailable cursor position. Last seen record id: RecordId(6508892623485272343)' on server ip-10-0-0-131:27017, restarting after 1817 reads.
|
[INFO] [01/09/2018 03:47:58.756] [warehouse-connector-akka.actor.default-dispatcher-3] [akka://warehouse-connector/user/oplog-consumer] starting tail from: TS time:Tue Jan 09 03:47:39 UTC 2018 inc:279
|
The important lines are the ones with this message/error from the client:
[WARN] [01/09/2018 03:46:29.146] [warehouse-connector-akka.actor.default-dispatcher-7] [akka://warehouse-connector/user/oplog-consumer] MongoException: Query failed with error code 175 and error message 'PlanExecutor killed: CappedPositionLost: CollectionScan died due to failure to restore tailable cursor position. Last seen record id: RecordId(6508892305657692169)' on server ip-10-0-0-131:27017, restarting after 4011 reads.
|
|