2021-06-10T13:01:06.299+0000 I NETWORK [conn218917] end connection 10.27.0.12:47374 (23 connections now open) 2021-06-10T13:01:06.346+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47414 #218933 (24 connections now open) 2021-06-10T13:01:06.346+0000 I NETWORK [conn218933] received client metadata from 10.27.0.12:47414 conn218933: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:01:06.355+0000 I ACCESS [conn218933] Successfully authenticated as principal __system on local from client 10.27.0.12:47414 2021-06-10T13:01:45.967+0000 I NETWORK [listener] connection accepted from 10.27.0.16:59810 #218934 (25 connections now open) 2021-06-10T13:01:45.967+0000 I NETWORK [conn218934] received client metadata from 10.27.0.16:59810 conn218934: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:01:45.980+0000 I ACCESS [conn218934] Successfully authenticated as principal __system on local from client 10.27.0.16:59810 2021-06-10T13:02:56.006+0000 I NETWORK [conn218847] end connection 10.27.0.16:59472 (24 connections now open) 2021-06-10T13:03:18.820+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37712 #218935 (25 connections now open) 2021-06-10T13:03:18.820+0000 I NETWORK [conn218935] received client metadata from 10.27.0.14:37712 conn218935: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:03:18.828+0000 I ACCESS [conn218935] Successfully authenticated as principal __system on local from client 10.27.0.14:37712 2021-06-10T13:04:33.484+0000 I NETWORK [conn218925] end connection 10.27.0.14:37680 (24 connections now open) 2021-06-10T13:04:46.360+0000 I NETWORK [conn218932] end connection 10.27.0.12:47410 (23 connections now open) 2021-06-10T13:06:03.528+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37730 #218936 (24 connections now open) 2021-06-10T13:06:03.528+0000 I NETWORK [conn218936] received client metadata from 10.27.0.14:37730 conn218936: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:06:03.536+0000 I ACCESS [conn218936] Successfully authenticated as principal __system on local from client 10.27.0.14:37730 2021-06-10T13:06:06.356+0000 I NETWORK [conn218933] end connection 10.27.0.12:47414 (23 connections now open) 2021-06-10T13:06:46.413+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47490 #218937 (24 connections now open) 2021-06-10T13:06:46.413+0000 I NETWORK [conn218937] received client metadata from 10.27.0.12:47490 conn218937: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:06:46.422+0000 I ACCESS [conn218937] Successfully authenticated as principal __system on local from client 10.27.0.12:47490 2021-06-10T13:08:06.391+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47494 #218938 (25 connections now open) 2021-06-10T13:08:06.391+0000 I NETWORK [conn218938] received client metadata from 10.27.0.12:47494 conn218938: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:08:06.400+0000 I ACCESS [conn218938] Successfully authenticated as principal __system on local from client 10.27.0.12:47494 2021-06-10T13:08:18.829+0000 I NETWORK [conn218935] end connection 10.27.0.14:37712 (24 connections now open) 2021-06-10T13:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T13:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T13:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T13:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T13:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T13:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T13:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T13:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T13:09:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T13:09:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T13:09:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T13:09:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T13:09:48.839+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37738 #218945 (25 connections now open) 2021-06-10T13:09:48.839+0000 I NETWORK [conn218945] received client metadata from 10.27.0.14:37738 conn218945: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:09:48.847+0000 I ACCESS [conn218945] Successfully authenticated as principal __system on local from client 10.27.0.14:37738 2021-06-10T13:14:36.684+0000 I NETWORK [listener] connection accepted from 10.27.0.16:59906 #218946 (26 connections now open) 2021-06-10T13:14:36.685+0000 I NETWORK [conn218946] received client metadata from 10.27.0.16:59906 conn218946: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:14:36.696+0000 I ACCESS [conn218946] Successfully authenticated as principal __system on local from client 10.27.0.16:59906 2021-06-10T13:15:16.431+0000 I NETWORK [conn218937] end connection 10.27.0.12:47490 (25 connections now open) 2021-06-10T13:15:36.685+0000 I NETWORK [conn218934] end connection 10.27.0.16:59810 (24 connections now open) 2021-06-10T13:19:16.468+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47518 #218947 (25 connections now open) 2021-06-10T13:19:16.468+0000 I NETWORK [conn218947] received client metadata from 10.27.0.12:47518 conn218947: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:19:16.477+0000 I ACCESS [conn218947] Successfully authenticated as principal __system on local from client 10.27.0.12:47518 2021-06-10T13:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T13:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T13:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T13:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T13:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T13:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T13:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T13:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T13:19:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T13:19:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T13:19:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T13:19:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T13:19:33.583+0000 I NETWORK [conn218936] end connection 10.27.0.14:37730 (24 connections now open) 2021-06-10T13:20:18.873+0000 I NETWORK [conn218945] end connection 10.27.0.14:37738 (23 connections now open) 2021-06-10T13:20:36.993+0000 I NETWORK [listener] connection accepted from 10.27.0.16:59924 #218954 (24 connections now open) 2021-06-10T13:20:36.994+0000 I NETWORK [conn218954] received client metadata from 10.27.0.16:59924 conn218954: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:20:37.006+0000 I ACCESS [conn218954] Successfully authenticated as principal __system on local from client 10.27.0.16:59924 2021-06-10T13:21:33.616+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37836 #218955 (25 connections now open) 2021-06-10T13:21:33.616+0000 I NETWORK [conn218955] received client metadata from 10.27.0.14:37836 conn218955: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:21:33.624+0000 I ACCESS [conn218955] Successfully authenticated as principal __system on local from client 10.27.0.14:37836 2021-06-10T13:21:36.993+0000 I NETWORK [conn218946] end connection 10.27.0.16:59906 (24 connections now open) 2021-06-10T13:21:48.892+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37838 #218956 (25 connections now open) 2021-06-10T13:21:48.892+0000 I NETWORK [conn218956] received client metadata from 10.27.0.14:37838 conn218956: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:21:48.901+0000 I ACCESS [conn218956] Successfully authenticated as principal __system on local from client 10.27.0.14:37838 2021-06-10T13:25:06.446+0000 I NETWORK [conn218938] end connection 10.27.0.12:47494 (24 connections now open) 2021-06-10T13:27:06.482+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47542 #218957 (25 connections now open) 2021-06-10T13:27:06.482+0000 I NETWORK [conn218957] received client metadata from 10.27.0.12:47542 conn218957: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:27:06.491+0000 I ACCESS [conn218957] Successfully authenticated as principal __system on local from client 10.27.0.12:47542 2021-06-10T13:27:48.901+0000 I NETWORK [conn218956] end connection 10.27.0.14:37838 (24 connections now open) 2021-06-10T13:29:18.927+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37852 #218958 (25 connections now open) 2021-06-10T13:29:18.927+0000 I NETWORK [conn218958] received client metadata from 10.27.0.14:37852 conn218958: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:29:18.935+0000 I ACCESS [conn218958] Successfully authenticated as principal __system on local from client 10.27.0.14:37852 2021-06-10T13:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T13:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T13:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T13:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T13:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T13:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T13:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T13:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T13:29:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T13:29:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T13:29:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T13:29:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T13:33:03.637+0000 I NETWORK [conn218955] end connection 10.27.0.14:37836 (24 connections now open) 2021-06-10T13:34:18.936+0000 I NETWORK [conn218958] end connection 10.27.0.14:37852 (23 connections now open) 2021-06-10T13:34:29.407+0000 I NETWORK [conn28] end connection 10.27.0.16:48286 (22 connections now open) 2021-06-10T13:34:29.408+0000 I NETWORK [conn218954] end connection 10.27.0.16:59924 (21 connections now open) 2021-06-10T13:34:33.670+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37870 #218965 (22 connections now open) 2021-06-10T13:34:33.670+0000 I NETWORK [conn218965] received client metadata from 10.27.0.14:37870 conn218965: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:34:33.678+0000 I ACCESS [conn218965] Successfully authenticated as principal __system on local from client 10.27.0.14:37870 2021-06-10T13:34:42.164+0000 I NETWORK [listener] connection accepted from 10.27.0.16:59980 #218966 (23 connections now open) 2021-06-10T13:34:42.164+0000 I NETWORK [conn218966] received client metadata from 10.27.0.16:59980 conn218966: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:34:42.298+0000 I ACCESS [conn218966] Successfully authenticated as principal __system on local from client 10.27.0.16:59980 2021-06-10T13:34:42.300+0000 I NETWORK [listener] connection accepted from 10.27.0.16:59982 #218967 (24 connections now open) 2021-06-10T13:34:42.300+0000 I NETWORK [listener] connection accepted from 10.27.0.16:59986 #218968 (25 connections now open) 2021-06-10T13:34:42.300+0000 I NETWORK [conn218967] received client metadata from 10.27.0.16:59982 conn218967: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:34:42.300+0000 I NETWORK [conn218968] received client metadata from 10.27.0.16:59986 conn218968: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:34:42.339+0000 I ACCESS [conn218967] Successfully authenticated as principal __system on local from client 10.27.0.16:59982 2021-06-10T13:34:42.339+0000 I ACCESS [conn218968] Successfully authenticated as principal __system on local from client 10.27.0.16:59986 2021-06-10T13:34:48.945+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37872 #218969 (26 connections now open) 2021-06-10T13:34:48.945+0000 I NETWORK [conn218969] received client metadata from 10.27.0.14:37872 conn218969: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:34:48.953+0000 I ACCESS [conn218969] Successfully authenticated as principal __system on local from client 10.27.0.14:37872 2021-06-10T13:35:06.491+0000 I NETWORK [conn218957] end connection 10.27.0.12:47542 (25 connections now open) 2021-06-10T13:35:42.379+0000 I NETWORK [conn218968] end connection 10.27.0.16:59986 (24 connections now open) 2021-06-10T13:37:02.647+0000 I NETWORK [conn218966] end connection 10.27.0.16:59980 (23 connections now open) 2021-06-10T13:37:02.647+0000 I NETWORK [conn218967] end connection 10.27.0.16:59982 (22 connections now open) 2021-06-10T13:37:59.296+0000 I NETWORK [listener] connection accepted from 10.27.0.16:60044 #218970 (23 connections now open) 2021-06-10T13:37:59.296+0000 I NETWORK [conn218970] received client metadata from 10.27.0.16:60044 conn218970: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:37:59.432+0000 I ACCESS [conn218970] Successfully authenticated as principal __system on local from client 10.27.0.16:60044 2021-06-10T13:37:59.595+0000 I NETWORK [listener] connection accepted from 10.27.0.16:60068 #218971 (24 connections now open) 2021-06-10T13:37:59.595+0000 I NETWORK [conn218971] received client metadata from 10.27.0.16:60068 conn218971: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:37:59.616+0000 I ACCESS [conn218971] Successfully authenticated as principal __system on local from client 10.27.0.16:60068 2021-06-10T13:38:06.527+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47566 #218972 (25 connections now open) 2021-06-10T13:38:06.527+0000 I NETWORK [conn218972] received client metadata from 10.27.0.12:47566 conn218972: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:38:06.536+0000 I ACCESS [conn218972] Successfully authenticated as principal __system on local from client 10.27.0.12:47566 2021-06-10T13:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T13:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T13:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T13:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T13:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T13:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T13:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T13:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T13:39:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T13:39:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T13:39:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T13:39:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T13:39:33.679+0000 I NETWORK [conn218965] end connection 10.27.0.14:37870 (24 connections now open) 2021-06-10T13:39:48.954+0000 I NETWORK [conn218969] end connection 10.27.0.14:37872 (23 connections now open) 2021-06-10T13:43:06.536+0000 I NETWORK [conn218972] end connection 10.27.0.12:47566 (22 connections now open) 2021-06-10T13:43:48.991+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37898 #218979 (23 connections now open) 2021-06-10T13:43:48.991+0000 I NETWORK [conn218979] received client metadata from 10.27.0.14:37898 conn218979: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:43:49.000+0000 I ACCESS [conn218979] Successfully authenticated as principal __system on local from client 10.27.0.14:37898 2021-06-10T13:46:33.724+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37904 #218980 (24 connections now open) 2021-06-10T13:46:33.724+0000 I NETWORK [conn218980] received client metadata from 10.27.0.14:37904 conn218980: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:46:33.732+0000 I ACCESS [conn218980] Successfully authenticated as principal __system on local from client 10.27.0.14:37904 2021-06-10T13:47:36.548+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47586 #218981 (25 connections now open) 2021-06-10T13:47:36.548+0000 I NETWORK [conn218981] received client metadata from 10.27.0.12:47586 conn218981: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:47:36.557+0000 I ACCESS [conn218981] Successfully authenticated as principal __system on local from client 10.27.0.12:47586 2021-06-10T13:48:49.000+0000 I NETWORK [conn218979] end connection 10.27.0.14:37898 (24 connections now open) 2021-06-10T13:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T13:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T13:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T13:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T13:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T13:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T13:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T13:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T13:49:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T13:49:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T13:49:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T13:49:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T13:50:46.616+0000 I NETWORK [conn218947] end connection 10.27.0.12:47518 (23 connections now open) 2021-06-10T13:51:46.652+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47598 #218988 (24 connections now open) 2021-06-10T13:51:46.652+0000 I NETWORK [conn218988] received client metadata from 10.27.0.12:47598 conn218988: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:51:46.661+0000 I ACCESS [conn218988] Successfully authenticated as principal __system on local from client 10.27.0.12:47598 2021-06-10T13:51:49.037+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37924 #218989 (25 connections now open) 2021-06-10T13:51:49.037+0000 I NETWORK [conn218989] received client metadata from 10.27.0.14:37924 conn218989: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:51:49.045+0000 I ACCESS [conn218989] Successfully authenticated as principal __system on local from client 10.27.0.14:37924 2021-06-10T13:52:36.557+0000 I NETWORK [conn218981] end connection 10.27.0.12:47586 (24 connections now open) 2021-06-10T13:55:36.595+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47606 #218990 (25 connections now open) 2021-06-10T13:55:36.595+0000 I NETWORK [conn218990] received client metadata from 10.27.0.12:47606 conn218990: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:55:36.604+0000 I ACCESS [conn218990] Successfully authenticated as principal __system on local from client 10.27.0.12:47606 2021-06-10T13:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T13:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T13:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T13:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T13:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T13:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T13:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T13:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T13:59:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T13:59:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T13:59:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T13:59:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T13:59:49.071+0000 I NETWORK [conn218989] end connection 10.27.0.14:37924 (24 connections now open) 2021-06-10T13:59:49.080+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37948 #218997 (25 connections now open) 2021-06-10T13:59:49.080+0000 I NETWORK [conn218997] received client metadata from 10.27.0.14:37948 conn218997: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T13:59:49.088+0000 I ACCESS [conn218997] Successfully authenticated as principal __system on local from client 10.27.0.14:37948 2021-06-10T14:00:36.604+0000 I NETWORK [conn218990] end connection 10.27.0.12:47606 (24 connections now open) 2021-06-10T14:01:33.775+0000 I NETWORK [conn218980] end connection 10.27.0.14:37904 (23 connections now open) 2021-06-10T14:01:36.651+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47622 #218998 (24 connections now open) 2021-06-10T14:01:36.651+0000 I NETWORK [conn218998] received client metadata from 10.27.0.12:47622 conn218998: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:01:36.660+0000 I ACCESS [conn218998] Successfully authenticated as principal __system on local from client 10.27.0.12:47622 2021-06-10T14:02:03.835+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37966 #218999 (25 connections now open) 2021-06-10T14:02:03.835+0000 I NETWORK [conn218999] received client metadata from 10.27.0.14:37966 conn218999: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:02:03.843+0000 I ACCESS [conn218999] Successfully authenticated as principal __system on local from client 10.27.0.14:37966 2021-06-10T14:04:49.089+0000 I NETWORK [conn218997] end connection 10.27.0.14:37948 (24 connections now open) 2021-06-10T14:06:19.125+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37974 #219000 (25 connections now open) 2021-06-10T14:06:19.126+0000 I NETWORK [conn219000] received client metadata from 10.27.0.14:37974 conn219000: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:06:19.134+0000 I ACCESS [conn219000] Successfully authenticated as principal __system on local from client 10.27.0.14:37974 2021-06-10T14:07:03.844+0000 I NETWORK [conn218999] end connection 10.27.0.14:37966 (24 connections now open) 2021-06-10T14:07:03.845+0000 I NETWORK [listener] connection accepted from 10.27.0.14:37976 #219001 (25 connections now open) 2021-06-10T14:07:03.845+0000 I NETWORK [conn219001] received client metadata from 10.27.0.14:37976 conn219001: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:07:03.853+0000 I ACCESS [conn219001] Successfully authenticated as principal __system on local from client 10.27.0.14:37976 2021-06-10T14:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T14:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T14:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T14:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T14:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T14:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T14:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T14:09:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T14:09:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T14:09:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T14:09:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T14:09:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T14:11:06.687+0000 I NETWORK [conn218998] end connection 10.27.0.12:47622 (24 connections now open) 2021-06-10T14:11:06.697+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47700 #219008 (25 connections now open) 2021-06-10T14:11:06.697+0000 I NETWORK [conn219008] received client metadata from 10.27.0.12:47700 conn219008: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:11:06.706+0000 I ACCESS [conn219008] Successfully authenticated as principal __system on local from client 10.27.0.12:47700 2021-06-10T14:12:03.854+0000 I NETWORK [conn219001] end connection 10.27.0.14:37976 (24 connections now open) 2021-06-10T14:13:03.890+0000 I NETWORK [listener] connection accepted from 10.27.0.14:38064 #219009 (25 connections now open) 2021-06-10T14:13:03.890+0000 I NETWORK [conn219009] received client metadata from 10.27.0.14:38064 conn219009: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:13:03.898+0000 I ACCESS [conn219009] Successfully authenticated as principal __system on local from client 10.27.0.14:38064 2021-06-10T14:13:27.862+0000 I NETWORK [conn201830] end connection 10.27.0.15:44212 (24 connections now open) 2021-06-10T14:13:27.865+0000 I NETWORK [conn32] end connection 10.27.0.15:39528 (23 connections now open) 2021-06-10T14:13:28.567+0000 I CONNPOOL [replexec-232272] dropping unhealthy pooled connection to 10.27.0.15:23002 2021-06-10T14:13:28.567+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:13:28.567+0000 I REPL_HB [replexec-232275] Heartbeat to 10.27.0.15:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:13:28.567+0000 I REPL [replexec-232275] Member 10.27.0.15:23002 is now in state RS_DOWN - Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:13:29.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:13:30.031+0000 I NETWORK [conn191492] end connection 10.27.0.15:40742 (22 connections now open) 2021-06-10T14:13:30.567+0000 I REPL_HB [replexec-232275] Heartbeat to 10.27.0.15:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:13:31.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:13:32.567+0000 I REPL_HB [replexec-232271] Heartbeat to 10.27.0.15:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:13:33.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:13:34.567+0000 I REPL_HB [replexec-232271] Heartbeat to 10.27.0.15:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:13:35.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:13:36.567+0000 I REPL_HB [replexec-232271] Heartbeat to 10.27.0.15:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:13:37.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:13:38.567+0000 I REPL_HB [replexec-232275] Heartbeat to 10.27.0.15:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:13:39.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:13:40.567+0000 I REPL_HB [replexec-232275] Heartbeat to 10.27.0.15:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:13:41.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:13:42.567+0000 I REPL_HB [replexec-232272] Heartbeat to 10.27.0.15:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:13:43.076+0000 I NETWORK [listener] connection accepted from 10.27.0.15:56440 #219010 (23 connections now open) 2021-06-10T14:13:43.112+0000 I ACCESS [conn219010] Successfully authenticated as principal __system on local from client 10.27.0.15:56440 2021-06-10T14:13:43.112+0000 I NETWORK [conn219010] end connection 10.27.0.15:56440 (22 connections now open) 2021-06-10T14:13:43.189+0000 I NETWORK [listener] connection accepted from 10.27.0.15:56450 #219011 (23 connections now open) 2021-06-10T14:13:43.190+0000 I NETWORK [conn219011] received client metadata from 10.27.0.15:56450 conn219011: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:13:43.283+0000 I ACCESS [conn219011] Successfully authenticated as principal __system on local from client 10.27.0.15:56450 2021-06-10T14:13:43.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:13:44.567+0000 I REPL [replexec-232271] Member 10.27.0.15:23002 is now in state SECONDARY 2021-06-10T14:14:04.105+0000 I NETWORK [conn31] end connection 10.27.0.15:39520 (22 connections now open) 2021-06-10T14:14:04.107+0000 I NETWORK [conn218838] end connection 10.27.0.15:55836 (21 connections now open) 2021-06-10T14:14:17.620+0000 I NETWORK [listener] connection accepted from 10.27.0.15:56488 #219013 (22 connections now open) 2021-06-10T14:14:17.620+0000 I NETWORK [conn219013] received client metadata from 10.27.0.15:56488 conn219013: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:14:17.775+0000 I ACCESS [conn219013] Successfully authenticated as principal __system on local from client 10.27.0.15:56488 2021-06-10T14:14:18.249+0000 I NETWORK [listener] connection accepted from 10.27.0.15:56510 #219014 (23 connections now open) 2021-06-10T14:14:18.249+0000 I NETWORK [conn219014] received client metadata from 10.27.0.15:56510 conn219014: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:14:18.263+0000 I ACCESS [conn219014] Successfully authenticated as principal __system on local from client 10.27.0.15:56510 2021-06-10T14:16:29.587+0000 I NETWORK [listener] connection accepted from 10.27.0.16:60340 #219015 (24 connections now open) 2021-06-10T14:16:29.587+0000 I NETWORK [conn219015] received client metadata from 10.27.0.16:60340 conn219015: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:16:29.599+0000 I ACCESS [conn219015] Successfully authenticated as principal __system on local from client 10.27.0.16:60340 2021-06-10T14:17:29.588+0000 I NETWORK [conn218971] end connection 10.27.0.16:60068 (23 connections now open) 2021-06-10T14:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T14:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T14:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T14:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T14:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T14:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T14:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T14:19:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T14:19:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T14:19:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T14:19:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T14:19:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T14:20:06.743+0000 I NETWORK [conn219008] end connection 10.27.0.12:47700 (22 connections now open) 2021-06-10T14:23:33.565+0000 I QUERY [clientcursormon] Cursor id 3922511118043407430 timed out, idle since 2021-06-10T14:13:30.030+0000 2021-06-10T14:23:33.948+0000 I NETWORK [conn219009] end connection 10.27.0.14:38064 (21 connections now open) 2021-06-10T14:23:36.832+0000 I NETWORK [listener] connection accepted from 10.27.0.12:47876 #219022 (22 connections now open) 2021-06-10T14:23:36.832+0000 I NETWORK [conn219022] received client metadata from 10.27.0.12:47876 conn219022: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:23:36.841+0000 I ACCESS [conn219022] Successfully authenticated as principal __system on local from client 10.27.0.12:47876 2021-06-10T14:25:29.032+0000 I NETWORK [conn219011] end connection 10.27.0.15:56450 (21 connections now open) 2021-06-10T14:25:30.567+0000 I CONNPOOL [replexec-232279] dropping unhealthy pooled connection to 10.27.0.15:23002 2021-06-10T14:25:30.567+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:25:30.567+0000 I REPL_HB [replexec-232286] Heartbeat to 10.27.0.15:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:25:30.567+0000 I REPL [replexec-232286] Member 10.27.0.15:23002 is now in state RS_DOWN - Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:25:31.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:25:32.567+0000 I REPL_HB [replexec-232285] Heartbeat to 10.27.0.15:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:25:33.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:25:34.567+0000 I REPL_HB [replexec-232285] Heartbeat to 10.27.0.15:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.15:23002 :: caused by :: Connection refused 2021-06-10T14:25:35.675+0000 I NETWORK [listener] connection accepted from 10.27.0.15:56570 #219023 (22 connections now open) 2021-06-10T14:25:35.710+0000 I ACCESS [conn219023] Successfully authenticated as principal __system on local from client 10.27.0.15:56570 2021-06-10T14:25:35.710+0000 I NETWORK [conn219023] end connection 10.27.0.15:56570 (21 connections now open) 2021-06-10T14:25:35.786+0000 I NETWORK [listener] connection accepted from 10.27.0.15:56578 #219024 (22 connections now open) 2021-06-10T14:25:35.786+0000 I NETWORK [conn219024] received client metadata from 10.27.0.15:56578 conn219024: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:25:35.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.15:23002 2021-06-10T14:25:35.912+0000 I ACCESS [conn219024] Successfully authenticated as principal __system on local from client 10.27.0.15:56578 2021-06-10T14:25:36.567+0000 I REPL [replexec-232285] Member 10.27.0.15:23002 is now in state SECONDARY 2021-06-10T14:26:39.780+0000 I NETWORK [conn218708] end connection 10.27.0.16:58508 (21 connections now open) 2021-06-10T14:26:39.783+0000 I NETWORK [conn30] end connection 10.27.0.16:48300 (20 connections now open) 2021-06-10T14:26:40.503+0000 I CONNPOOL [replexec-232285] dropping unhealthy pooled connection to 10.27.0.16:23002 2021-06-10T14:26:40.503+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:26:40.503+0000 I REPL_HB [replexec-232286] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:26:40.503+0000 I REPL [replexec-232286] Member 10.27.0.16:23002 is now in state RS_DOWN - Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:26:40.541+0000 I NETWORK [conn217592] end connection 10.27.0.16:50314 (19 connections now open) 2021-06-10T14:26:40.809+0000 I NETWORK [listener] connection accepted from 10.27.0.15:56616 #219026 (20 connections now open) 2021-06-10T14:26:40.809+0000 I NETWORK [conn219026] received client metadata from 10.27.0.15:56616 conn219026: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:26:40.824+0000 I ACCESS [conn219026] Successfully authenticated as principal __system on local from client 10.27.0.15:56616 2021-06-10T14:26:40.827+0000 I NETWORK [listener] connection accepted from 10.27.0.15:56624 #219027 (21 connections now open) 2021-06-10T14:26:40.827+0000 I NETWORK [conn219027] received client metadata from 10.27.0.15:56624 conn219027: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:26:40.840+0000 I ACCESS [conn219027] Successfully authenticated as principal __system on local from client 10.27.0.15:56624 2021-06-10T14:26:41.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:26:42.503+0000 I REPL_HB [replexec-232279] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:26:43.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:26:44.503+0000 I REPL_HB [replexec-232285] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:26:45.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:26:46.503+0000 I REPL_HB [replexec-232279] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:26:47.008+0000 I NETWORK [listener] connection accepted from 10.27.0.16:60422 #219028 (22 connections now open) 2021-06-10T14:26:47.042+0000 I ACCESS [conn219028] Successfully authenticated as principal __system on local from client 10.27.0.16:60422 2021-06-10T14:26:47.043+0000 I NETWORK [conn219028] end connection 10.27.0.16:60422 (21 connections now open) 2021-06-10T14:26:47.118+0000 I NETWORK [listener] connection accepted from 10.27.0.16:60430 #219029 (22 connections now open) 2021-06-10T14:26:47.153+0000 I NETWORK [conn219029] received client metadata from 10.27.0.16:60430 conn219029: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:26:47.209+0000 I ACCESS [conn219029] Successfully authenticated as principal __system on local from client 10.27.0.16:60430 2021-06-10T14:26:47.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:26:48.503+0000 I REPL [replexec-232285] Member 10.27.0.16:23002 is now in state SECONDARY 2021-06-10T14:27:33.970+0000 I NETWORK [listener] connection accepted from 10.27.0.14:38376 #219031 (23 connections now open) 2021-06-10T14:27:33.970+0000 I NETWORK [conn219031] received client metadata from 10.27.0.14:38376 conn219031: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:27:33.978+0000 I ACCESS [conn219031] Successfully authenticated as principal __system on local from client 10.27.0.14:38376 2021-06-10T14:27:49.245+0000 I NETWORK [conn219000] end connection 10.27.0.14:37974 (22 connections now open) 2021-06-10T14:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T14:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T14:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T14:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T14:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T14:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T14:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T14:29:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T14:29:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T14:29:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T14:29:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T14:29:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T14:30:49.281+0000 I NETWORK [listener] connection accepted from 10.27.0.14:38388 #219038 (23 connections now open) 2021-06-10T14:30:49.281+0000 I NETWORK [conn219038] received client metadata from 10.27.0.14:38388 conn219038: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:30:49.289+0000 I ACCESS [conn219038] Successfully authenticated as principal __system on local from client 10.27.0.14:38388 2021-06-10T14:32:36.878+0000 I NETWORK [conn219022] end connection 10.27.0.12:47876 (22 connections now open) 2021-06-10T14:34:16.813+0000 I NETWORK [conn218988] end connection 10.27.0.12:47598 (21 connections now open) 2021-06-10T14:34:41.644+0000 I NETWORK [conn218970] end connection 10.27.0.16:60044 (20 connections now open) 2021-06-10T14:34:41.646+0000 I NETWORK [conn219015] end connection 10.27.0.16:60340 (19 connections now open) 2021-06-10T14:34:42.233+0000 I NETWORK [conn219029] end connection 10.27.0.16:60430 (18 connections now open) 2021-06-10T14:34:42.504+0000 I CONNPOOL [replexec-232288] dropping unhealthy pooled connection to 10.27.0.16:23002 2021-06-10T14:34:42.504+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:34:42.505+0000 I REPL_HB [replexec-232289] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:34:42.505+0000 I REPL [replexec-232289] Member 10.27.0.16:23002 is now in state RS_DOWN - Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:34:57.846+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:34:57.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:34:59.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:34:59.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:01.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:01.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:03.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:03.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:05.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:05.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:07.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:07.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:09.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:09.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:11.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:11.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:13.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:13.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:15.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:15.846+0000 I REPL_HB [replexec-232289] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:16.823+0000 I NETWORK [listener] connection accepted from 10.27.0.12:48242 #219039 (19 connections now open) 2021-06-10T14:35:16.823+0000 I NETWORK [conn219039] received client metadata from 10.27.0.12:48242 conn219039: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:35:16.831+0000 I ACCESS [conn219039] Successfully authenticated as principal __system on local from client 10.27.0.12:48242 2021-06-10T14:35:17.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:17.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:19.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:19.846+0000 I REPL_HB [replexec-232289] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:21.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:21.846+0000 I REPL_HB [replexec-232289] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:23.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:23.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:25.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:25.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:27.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:27.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:29.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:29.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:31.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:31.846+0000 I REPL_HB [replexec-232289] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:33.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:33.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:35.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:35.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:36.924+0000 I NETWORK [listener] connection accepted from 10.27.0.12:48512 #219040 (20 connections now open) 2021-06-10T14:35:36.924+0000 I NETWORK [conn219040] received client metadata from 10.27.0.12:48512 conn219040: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:35:36.933+0000 I ACCESS [conn219040] Successfully authenticated as principal __system on local from client 10.27.0.12:48512 2021-06-10T14:35:37.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:37.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:39.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:39.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:41.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:41.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:43.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:43.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:45.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:45.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:47.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:47.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:49.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:49.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:51.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:51.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:53.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:53.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:55.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:55.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:57.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:57.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:35:59.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:35:59.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:01.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:01.846+0000 I REPL_HB [replexec-232294] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:03.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:03.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:05.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:05.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:07.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:07.846+0000 I REPL_HB [replexec-232294] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:09.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:09.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:11.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:11.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:13.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:13.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:15.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:15.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:17.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:17.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:19.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:19.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:21.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:21.846+0000 I REPL_HB [replexec-232294] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:23.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:23.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:25.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:25.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:27.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:27.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:29.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:29.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:31.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:31.846+0000 I REPL_HB [replexec-232294] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:33.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:33.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:35.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:35.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:37.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:37.846+0000 I REPL_HB [replexec-232293] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:39.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:39.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:41.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:41.582+0000 I QUERY [clientcursormon] Cursor id 4824836642766851909 timed out, idle since 2021-06-10T14:26:40.541+0000 2021-06-10T14:36:41.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:43.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:43.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:45.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:45.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:47.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:47.846+0000 I REPL_HB [replexec-232294] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:49.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:49.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:51.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:51.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:53.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:53.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:55.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:55.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:57.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:57.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:36:59.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:36:59.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:01.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:01.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:03.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:03.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:05.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:05.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:07.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:07.846+0000 I REPL_HB [replexec-232292] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:09.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:09.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:11.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:11.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:13.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:13.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:15.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:15.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:17.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:17.846+0000 I REPL_HB [replexec-232295] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:19.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:19.846+0000 I REPL_HB [replexec-232295] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:21.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:21.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:23.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:23.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:25.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:25.846+0000 I REPL_HB [replexec-232288] Heartbeat to 10.27.0.16:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.16:23002 :: caused by :: Connection refused 2021-06-10T14:37:27.403+0000 I NETWORK [listener] connection accepted from 10.27.0.16:37966 #219041 (21 connections now open) 2021-06-10T14:37:27.437+0000 I ACCESS [conn219041] Successfully authenticated as principal __system on local from client 10.27.0.16:37966 2021-06-10T14:37:27.437+0000 I NETWORK [conn219041] end connection 10.27.0.16:37966 (20 connections now open) 2021-06-10T14:37:27.505+0000 I CONNPOOL [Replication] Connecting to 10.27.0.16:23002 2021-06-10T14:37:27.509+0000 I NETWORK [listener] connection accepted from 10.27.0.16:37974 #219043 (21 connections now open) 2021-06-10T14:37:27.510+0000 I NETWORK [conn219043] received client metadata from 10.27.0.16:37974 conn219043: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1160.6.1.el7.x86_64" } } 2021-06-10T14:37:27.597+0000 I ACCESS [conn219043] Successfully authenticated as principal __system on local from client 10.27.0.16:37974 2021-06-10T14:37:27.846+0000 I REPL [replexec-232288] Member 10.27.0.16:23002 is now in state SECONDARY 2021-06-10T14:37:37.977+0000 I NETWORK [listener] connection accepted from 10.27.0.16:37996 #219044 (22 connections now open) 2021-06-10T14:37:37.977+0000 I NETWORK [conn219044] received client metadata from 10.27.0.16:37996 conn219044: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1160.6.1.el7.x86_64" } } 2021-06-10T14:37:38.098+0000 I ACCESS [conn219044] Successfully authenticated as principal __system on local from client 10.27.0.16:37996 2021-06-10T14:37:38.289+0000 I NETWORK [listener] connection accepted from 10.27.0.16:38020 #219045 (23 connections now open) 2021-06-10T14:37:38.289+0000 I NETWORK [conn219045] received client metadata from 10.27.0.16:38020 conn219045: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1160.6.1.el7.x86_64" } } 2021-06-10T14:37:38.300+0000 I ACCESS [conn219045] Successfully authenticated as principal __system on local from client 10.27.0.16:38020 2021-06-10T14:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T14:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T14:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T14:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T14:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T14:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T14:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T14:39:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T14:39:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T14:39:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T14:39:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T14:39:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T14:40:03.990+0000 I NETWORK [conn219031] end connection 10.27.0.14:38376 (22 connections now open) 2021-06-10T14:41:04.016+0000 I NETWORK [listener] connection accepted from 10.27.0.14:40040 #219052 (23 connections now open) 2021-06-10T14:41:04.016+0000 I NETWORK [conn219052] received client metadata from 10.27.0.14:40040 conn219052: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:41:04.024+0000 I ACCESS [conn219052] Successfully authenticated as principal __system on local from client 10.27.0.14:40040 2021-06-10T14:43:36.944+0000 I NETWORK [conn219040] end connection 10.27.0.12:48512 (22 connections now open) 2021-06-10T14:44:49.310+0000 I NETWORK [conn219038] end connection 10.27.0.14:38388 (21 connections now open) 2021-06-10T14:44:49.361+0000 I NETWORK [listener] connection accepted from 10.27.0.14:40052 #219053 (22 connections now open) 2021-06-10T14:44:49.361+0000 I NETWORK [conn219053] received client metadata from 10.27.0.14:40052 conn219053: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:44:49.369+0000 I ACCESS [conn219053] Successfully authenticated as principal __system on local from client 10.27.0.14:40052 2021-06-10T14:46:01.097+0000 I ELECTION [conn5] Received vote request: { replSetRequestVotes: 1, setName: "configs", dryRun: false, term: 10, candidateIndex: 1, configVersion: 3, lastCommittedOp: { ts: Timestamp(1623336358, 1), t: 9 } } 2021-06-10T14:46:01.097+0000 I ELECTION [conn5] Sending vote response: { term: 10, voteGranted: true, reason: "" } 2021-06-10T14:46:01.777+0000 I REPL [replexec-232296] Member 10.27.0.11:23002 is now in state SECONDARY 2021-06-10T14:46:02.100+0000 I NETWORK [conn9] end connection 10.27.0.11:49350 (21 connections now open) 2021-06-10T14:46:02.104+0000 I REPL [replication-5853] Restarting oplog query due to error: InterruptedAtShutdown: error in fetcher batch callback :: caused by :: interrupted at shutdown. Last fetched optime: { ts: Timestamp(1623336358, 1), t: 9 }. Restarts remaining: 1 2021-06-10T14:46:02.107+0000 I REPL [replication-5853] Scheduled new oplog query Fetcher source: 10.27.0.11:23002 database: local query: { find: "oplog.rs", filter: { ts: { $gte: Timestamp(1623336358, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 2000, batchSize: 13981010, term: 10, readConcern: { afterClusterTime: Timestamp(0, 1) } } query metadata: { $replData: 1, $oplogQueryData: 1, $readPreference: { mode: "secondaryPreferred" } } active: 1 findNetworkTimeout: 7000ms getMoreNetworkTimeout: 10000ms shutting down?: 0 first: 1 firstCommandScheduler: RemoteCommandRetryScheduler request: RemoteCommand 119731745 -- target:10.27.0.11:23002 db:local cmd:{ find: "oplog.rs", filter: { ts: { $gte: Timestamp(1623336358, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 2000, batchSize: 13981010, term: 10, readConcern: { afterClusterTime: Timestamp(0, 1) } } active: 1 callbackHandle.valid: 1 callbackHandle.cancelled: 0 attempt: 1 retryPolicy: {type: "NoRetryPolicy"} 2021-06-10T14:46:02.107+0000 I REPL [replication-5854] Error returned from oplog query (no more query restarts left): InterruptedAtShutdown: error in fetcher batch callback :: caused by :: interrupted at shutdown 2021-06-10T14:46:02.107+0000 W REPL [rsBackgroundSync] Fetcher stopped querying remote oplog with error: InterruptedAtShutdown: error in fetcher batch callback :: caused by :: interrupted at shutdown 2021-06-10T14:46:02.107+0000 I REPL [rsBackgroundSync] Clearing sync source 10.27.0.11:23002 to choose a new one. 2021-06-10T14:46:02.107+0000 I REPL [rsBackgroundSync] could not find member to sync from 2021-06-10T14:46:02.108+0000 I REPL [replexec-232301] Member 10.27.0.12:23002 is now in state PRIMARY 2021-06-10T14:46:02.109+0000 I REPL_HB [replexec-232307] Heartbeat to 10.27.0.11:23002 failed after 2 retries, response status: InterruptedAtShutdown: interrupted at shutdown 2021-06-10T14:46:02.109+0000 I REPL [replexec-232307] Member 10.27.0.11:23002 is now in state RS_DOWN - interrupted at shutdown 2021-06-10T14:46:02.609+0000 I CONNPOOL [replexec-232306] dropping unhealthy pooled connection to 10.27.0.11:23002 2021-06-10T14:46:02.609+0000 I CONNPOOL [Replication] Connecting to 10.27.0.11:23002 2021-06-10T14:46:02.609+0000 I REPL_HB [replexec-232302] Heartbeat to 10.27.0.11:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.11:23002 :: caused by :: Connection refused 2021-06-10T14:46:03.108+0000 I REPL [rsBackgroundSync] sync source candidate: 10.27.0.12:23002 2021-06-10T14:46:03.108+0000 I CONNPOOL [RS] Connecting to 10.27.0.12:23002 2021-06-10T14:46:03.109+0000 I REPL_HB [replexec-232305] Heartbeat to 10.27.0.11:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.11:23002 :: caused by :: Connection refused 2021-06-10T14:46:03.133+0000 I REPL [rsBackgroundSync] Changed sync source from empty to 10.27.0.12:23002 2021-06-10T14:46:03.133+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update to 10.27.0.11:23002: InvalidSyncSource: Sync source changed from 10.27.0.11:23002 to 10.27.0.12:23002 2021-06-10T14:46:03.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.11:23002 2021-06-10T14:46:04.025+0000 I NETWORK [conn219052] end connection 10.27.0.14:40040 (20 connections now open) 2021-06-10T14:46:04.050+0000 I NETWORK [listener] connection accepted from 10.27.0.14:40072 #219056 (21 connections now open) 2021-06-10T14:46:04.050+0000 I NETWORK [conn219056] received client metadata from 10.27.0.14:40072 conn219056: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:46:04.058+0000 I ACCESS [conn219056] Successfully authenticated as principal __system on local from client 10.27.0.14:40072 2021-06-10T14:46:05.109+0000 I CONNPOOL [Replication] Connecting to 10.27.0.11:23002 2021-06-10T14:46:05.109+0000 I REPL_HB [replexec-232304] Heartbeat to 10.27.0.11:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.11:23002 :: caused by :: Connection refused 2021-06-10T14:46:06.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.11:23002 2021-06-10T14:46:06.956+0000 I NETWORK [listener] connection accepted from 10.27.0.12:50028 #219057 (22 connections now open) 2021-06-10T14:46:06.956+0000 I NETWORK [conn219057] received client metadata from 10.27.0.12:50028 conn219057: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:46:06.965+0000 I ACCESS [conn219057] Successfully authenticated as principal __system on local from client 10.27.0.12:50028 2021-06-10T14:46:07.109+0000 I REPL_HB [replexec-232305] Heartbeat to 10.27.0.11:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.11:23002 :: caused by :: Connection refused 2021-06-10T14:46:08.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.11:23002 2021-06-10T14:46:09.109+0000 I REPL_HB [replexec-232306] Heartbeat to 10.27.0.11:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.11:23002 :: caused by :: Connection refused 2021-06-10T14:46:10.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.11:23002 2021-06-10T14:46:11.109+0000 I REPL_HB [replexec-232296] Heartbeat to 10.27.0.11:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.11:23002 :: caused by :: Connection refused 2021-06-10T14:46:12.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.11:23002 2021-06-10T14:46:13.109+0000 I REPL_HB [replexec-232305] Heartbeat to 10.27.0.11:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.11:23002 :: caused by :: Connection refused 2021-06-10T14:46:14.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.11:23002 2021-06-10T14:46:15.109+0000 I REPL_HB [replexec-232302] Heartbeat to 10.27.0.11:23002 failed after 2 retries, response status: HostUnreachable: Error connecting to 10.27.0.11:23002 :: caused by :: Connection refused 2021-06-10T14:46:16.512+0000 I NETWORK [listener] connection accepted from 10.27.0.11:17934 #219058 (23 connections now open) 2021-06-10T14:46:16.536+0000 I ACCESS [conn219058] Successfully authenticated as principal __system on local from client 10.27.0.11:17934 2021-06-10T14:46:16.537+0000 I NETWORK [conn219058] end connection 10.27.0.11:17934 (22 connections now open) 2021-06-10T14:46:16.613+0000 I NETWORK [listener] connection accepted from 10.27.0.11:17942 #219059 (23 connections now open) 2021-06-10T14:46:16.613+0000 I NETWORK [conn219059] received client metadata from 10.27.0.11:17942 conn219059: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1160.6.1.el7.x86_64" } } 2021-06-10T14:46:16.629+0000 I ACCESS [conn219059] Successfully authenticated as principal __system on local from client 10.27.0.11:17942 2021-06-10T14:46:16.817+0000 I CONNPOOL [Replication] Connecting to 10.27.0.11:23002 2021-06-10T14:46:17.109+0000 I REPL [replexec-232296] Member 10.27.0.11:23002 is now in state SECONDARY 2021-06-10T14:46:58.788+0000 I CONNPOOL [RS] Ending idle connection to host 10.27.0.11:23002 because the pool meets constraints; 1 connections to that host remain open 2021-06-10T14:47:02.801+0000 I CONNPOOL [RS] Connecting to 10.27.0.11:23002 2021-06-10T14:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T14:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T14:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T14:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T14:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T14:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T14:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T14:49:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T14:49:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T14:49:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T14:49:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T14:49:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T14:51:02.104+0000 I CONNPOOL [RS] Dropping all pooled connections to 10.27.0.11:23002 due to ShutdownInProgress: Pool for 10.27.0.11:23002 has expired. 2021-06-10T14:51:06.966+0000 I NETWORK [conn219057] end connection 10.27.0.12:50028 (22 connections now open) 2021-06-10T14:52:16.918+0000 I NETWORK [conn219039] end connection 10.27.0.12:48242 (21 connections now open) 2021-06-10T14:52:36.978+0000 I NETWORK [listener] connection accepted from 10.27.0.12:50124 #219068 (22 connections now open) 2021-06-10T14:52:36.978+0000 I NETWORK [conn219068] received client metadata from 10.27.0.12:50124 conn219068: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:52:36.987+0000 I ACCESS [conn219068] Successfully authenticated as principal __system on local from client 10.27.0.12:50124 2021-06-10T14:56:19.378+0000 I NETWORK [conn219053] end connection 10.27.0.14:40052 (21 connections now open) 2021-06-10T14:57:16.996+0000 I NETWORK [listener] connection accepted from 10.27.0.12:50138 #219069 (22 connections now open) 2021-06-10T14:57:16.996+0000 I NETWORK [conn219069] received client metadata from 10.27.0.12:50138 conn219069: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:57:17.005+0000 I ACCESS [conn219069] Successfully authenticated as principal __system on local from client 10.27.0.12:50138 2021-06-10T14:58:19.414+0000 I NETWORK [listener] connection accepted from 10.27.0.14:40174 #219070 (23 connections now open) 2021-06-10T14:58:19.414+0000 I NETWORK [conn219070] received client metadata from 10.27.0.14:40174 conn219070: { driver: { name: "NetworkInterfaceTL", version: "4.2.11" }, os: { type: "Linux", name: "CentOS Linux release 7.8.2003 (Core)", architecture: "x86_64", version: "Kernel 3.10.0-1127.19.1.el7.x86_64" } } 2021-06-10T14:58:19.422+0000 I ACCESS [conn219070] Successfully authenticated as principal __system on local from client 10.27.0.14:40174 2021-06-10T14:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.11:25001 due to ShutdownInProgress: Pool for 10.27.0.11:25001 has expired. 2021-06-10T14:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25001 due to ShutdownInProgress: Pool for 10.27.0.12:25001 has expired. 2021-06-10T14:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25001 due to ShutdownInProgress: Pool for 10.27.0.14:25001 has expired. 2021-06-10T14:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.12:25002 due to ShutdownInProgress: Pool for 10.27.0.12:25002 has expired. 2021-06-10T14:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.13:25002 due to ShutdownInProgress: Pool for 10.27.0.13:25002 has expired. 2021-06-10T14:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Dropping all pooled connections to 10.27.0.14:25002 due to ShutdownInProgress: Pool for 10.27.0.14:25002 has expired. 2021-06-10T14:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.11:25001 2021-06-10T14:59:19.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.13:25002 2021-06-10T14:59:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25001 2021-06-10T14:59:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25001 2021-06-10T14:59:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.14:25002 2021-06-10T14:59:20.276+0000 I CONNPOOL [TaskExecutorPool-0] Connecting to 10.27.0.12:25002 2021-06-10T14:59:36.997+0000 I NETWORK [conn219068] end connection 10.27.0.12:50124 (22 connections now open)