Note: This is test shard 4 of 8.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from MaintenanceModeRF5ITest
[ RUN ] MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode
2026-08-07T18:15:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:15:22Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260807 18:15:22.827749 11253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
/tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.253.126:46329
--webserver_interface=127.10.253.126
--webserver_port=0
--builtin_ntp_servers=127.10.253.84:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.253.126:46329 with env {}
W20260807 18:15:23.309428 11262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:15:23.309855 11262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:15:23.309950 11262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:15:23.319216 11262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:15:23.319394 11262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:15:23.319443 11262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:15:23.319499 11262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:15:23.330936 11262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.253.84:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.253.126:46329
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.253.126:46329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.253.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:15:23.332914 11262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:15:23.335530 11262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:15:23.354027 11273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:23.354185 11269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:23.354167 11271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:15:23.355145 11262 server_base.cc:1034] running on GCE node
I20260807 18:15:23.356271 11262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:15:23.358479 11262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:15:23.359956 11262 hybrid_clock.cc:648] HybridClock initialized: now 1786126523359844 us; error 60 us; skew 500 ppm
I20260807 18:15:23.360723 11262 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:15:23.364393 11262 webserver.cc:460] Webserver started at http://127.10.253.126:37057/ using document root <none> and password file <none>
I20260807 18:15:23.365298 11262 fs_manager.cc:359] Metadata directory not provided
I20260807 18:15:23.365427 11262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:15:23.365873 11262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:15:23.369279 11262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/data/instance:
uuid: "3c0cd4ff0bf5421a9714b29fcf5f6ce7"
format_stamp: "Formatted at 2026-08-07 18:15:23 on dist-test-slave-h6n0"
I20260807 18:15:23.370241 11262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/wal/instance:
uuid: "3c0cd4ff0bf5421a9714b29fcf5f6ce7"
format_stamp: "Formatted at 2026-08-07 18:15:23 on dist-test-slave-h6n0"
I20260807 18:15:23.377491 11262 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260807 18:15:23.384313 11280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:23.386860 11262 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.005s sys 0.001s
I20260807 18:15:23.387151 11262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/data,/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/wal
uuid: "3c0cd4ff0bf5421a9714b29fcf5f6ce7"
format_stamp: "Formatted at 2026-08-07 18:15:23 on dist-test-slave-h6n0"
I20260807 18:15:23.387434 11262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:15:23.414796 11262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:15:23.416013 11262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:15:23.416431 11262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:15:23.444378 11262 rpc_server.cc:307] RPC server started. Bound to: 127.10.253.126:46329
I20260807 18:15:23.444442 11355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.253.126:46329 every 8 connection(s)
I20260807 18:15:23.446794 11262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/data/info.pb
I20260807 18:15:23.453090 11357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:23.454018 11253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu as pid 11262
I20260807 18:15:23.454432 11253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/master-0/wal/instance
I20260807 18:15:23.469372 11357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7: Bootstrap starting.
I20260807 18:15:23.474013 11357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:23.475580 11357 log.cc:824] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7: Log is configured to *not* fsync() on all Append() calls
I20260807 18:15:23.479816 11357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7: No bootstrap required, opened a new log
I20260807 18:15:23.490738 11357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0cd4ff0bf5421a9714b29fcf5f6ce7" member_type: VOTER last_known_addr { host: "127.10.253.126" port: 46329 } }
I20260807 18:15:23.491393 11357 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:23.491554 11357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c0cd4ff0bf5421a9714b29fcf5f6ce7, State: Initialized, Role: FOLLOWER
I20260807 18:15:23.492522 11357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0cd4ff0bf5421a9714b29fcf5f6ce7" member_type: VOTER last_known_addr { host: "127.10.253.126" port: 46329 } }
I20260807 18:15:23.492926 11357 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:15:23.493163 11357 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:15:23.493434 11357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:23.496783 11357 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0cd4ff0bf5421a9714b29fcf5f6ce7" member_type: VOTER last_known_addr { host: "127.10.253.126" port: 46329 } }
I20260807 18:15:23.497786 11357 leader_election.cc:302] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c0cd4ff0bf5421a9714b29fcf5f6ce7; no voters:
I20260807 18:15:23.498965 11357 leader_election.cc:288] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:15:23.499142 11366 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:15:23.500365 11366 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [term 1 LEADER]: Becoming Leader. State: Replica: 3c0cd4ff0bf5421a9714b29fcf5f6ce7, State: Running, Role: LEADER
I20260807 18:15:23.501225 11366 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0cd4ff0bf5421a9714b29fcf5f6ce7" member_type: VOTER last_known_addr { host: "127.10.253.126" port: 46329 } }
I20260807 18:15:23.502149 11357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:15:23.505112 11367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c0cd4ff0bf5421a9714b29fcf5f6ce7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0cd4ff0bf5421a9714b29fcf5f6ce7" member_type: VOTER last_known_addr { host: "127.10.253.126" port: 46329 } } }
I20260807 18:15:23.505769 11367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [sys.catalog]: This master's current role is: LEADER
I20260807 18:15:23.506907 11369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c0cd4ff0bf5421a9714b29fcf5f6ce7. Latest consensus state: current_term: 1 leader_uuid: "3c0cd4ff0bf5421a9714b29fcf5f6ce7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0cd4ff0bf5421a9714b29fcf5f6ce7" member_type: VOTER last_known_addr { host: "127.10.253.126" port: 46329 } } }
I20260807 18:15:23.507812 11369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7 [sys.catalog]: This master's current role is: LEADER
I20260807 18:15:23.508757 11372 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:15:23.517062 11372 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:15:23.530685 11372 catalog_manager.cc:1347] Generated new cluster ID: 14790974d19044baa38cea374ff63d2c
I20260807 18:15:23.530874 11372 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:15:23.559538 11372 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:15:23.562638 11372 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:15:23.577227 11372 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c0cd4ff0bf5421a9714b29fcf5f6ce7: Generated new TSK 0
I20260807 18:15:23.579228 11372 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:15:23.601297 11253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
/tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.253.65:0
--local_ip_for_outbound_sockets=127.10.253.65
--webserver_interface=127.10.253.65
--webserver_port=0
--tserver_master_addrs=127.10.253.126:46329
--builtin_ntp_servers=127.10.253.84:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260807 18:15:24.077268 11391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:15:24.077955 11391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:15:24.078121 11391 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260807 18:15:24.078224 11391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:15:24.087184 11391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:15:24.087464 11391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.253.65
I20260807 18:15:24.099423 11391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.253.84:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.253.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.253.65
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.10.253.126:46329
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.253.65
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:15:24.101511 11391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:15:24.105155 11391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:15:24.127069 11399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:24.127243 11398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:24.127542 11401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:15:24.129292 11391 server_base.cc:1034] running on GCE node
I20260807 18:15:24.130724 11391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:15:24.132725 11391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:15:24.134073 11391 hybrid_clock.cc:648] HybridClock initialized: now 1786126524134023 us; error 84 us; skew 500 ppm
I20260807 18:15:24.134709 11391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:15:24.138278 11391 webserver.cc:460] Webserver started at http://127.10.253.65:44985/ using document root <none> and password file <none>
I20260807 18:15:24.139444 11391 fs_manager.cc:359] Metadata directory not provided
I20260807 18:15:24.139634 11391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:15:24.140157 11391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:15:24.144146 11391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data/instance:
uuid: "50da72adf57546f5bab0a028672a51dd"
format_stamp: "Formatted at 2026-08-07 18:15:24 on dist-test-slave-h6n0"
I20260807 18:15:24.145344 11391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal/instance:
uuid: "50da72adf57546f5bab0a028672a51dd"
format_stamp: "Formatted at 2026-08-07 18:15:24 on dist-test-slave-h6n0"
I20260807 18:15:24.154251 11391 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.010s sys 0.000s
I20260807 18:15:24.160470 11410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:24.163332 11391 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260807 18:15:24.163673 11391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal
uuid: "50da72adf57546f5bab0a028672a51dd"
format_stamp: "Formatted at 2026-08-07 18:15:24 on dist-test-slave-h6n0"
I20260807 18:15:24.164050 11391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:15:24.230445 11391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:15:24.231839 11391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:15:24.232226 11391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:15:24.233651 11391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:15:24.238374 11391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:15:24.238581 11391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:24.238765 11391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:15:24.238866 11391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:24.289728 11391 rpc_server.cc:307] RPC server started. Bound to: 127.10.253.65:37131
I20260807 18:15:24.289765 11570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.253.65:37131 every 8 connection(s)
I20260807 18:15:24.292073 11391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data/info.pb
I20260807 18:15:24.297245 11253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu as pid 11391
I20260807 18:15:24.297606 11253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal/instance
I20260807 18:15:24.303193 11253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
/tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.253.66:0
--local_ip_for_outbound_sockets=127.10.253.66
--webserver_interface=127.10.253.66
--webserver_port=0
--tserver_master_addrs=127.10.253.126:46329
--builtin_ntp_servers=127.10.253.84:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260807 18:15:24.322479 11571 heartbeater.cc:347] Connected to a master server at 127.10.253.126:46329
I20260807 18:15:24.323441 11571 heartbeater.cc:464] Registering TS with master...
I20260807 18:15:24.324532 11571 heartbeater.cc:511] Master 127.10.253.126:46329 requested a full tablet report, sending...
I20260807 18:15:24.327802 11303 ts_manager.cc:194] Registered new tserver with Master: 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:15:24.330559 11303 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.253.65:55511
W20260807 18:15:24.790594 11576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:15:24.791227 11576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:15:24.791333 11576 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260807 18:15:24.791399 11576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:15:24.801699 11576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:15:24.801945 11576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.253.66
I20260807 18:15:24.815495 11576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.253.84:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.253.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.253.66
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.10.253.126:46329
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.253.66
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:15:24.817677 11576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:15:24.820472 11576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:15:24.841048 11581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:24.841128 11582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:24.841006 11585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:15:24.842633 11576 server_base.cc:1034] running on GCE node
I20260807 18:15:24.843561 11576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:15:24.844972 11576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:15:24.846403 11576 hybrid_clock.cc:648] HybridClock initialized: now 1786126524846297 us; error 77 us; skew 500 ppm
I20260807 18:15:24.847002 11576 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:15:24.850778 11576 webserver.cc:460] Webserver started at http://127.10.253.66:42121/ using document root <none> and password file <none>
I20260807 18:15:24.851845 11576 fs_manager.cc:359] Metadata directory not provided
I20260807 18:15:24.851979 11576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:15:24.852468 11576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:15:24.856340 11576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/data/instance:
uuid: "b5bb27271da74b1a909d982e6fb2d470"
format_stamp: "Formatted at 2026-08-07 18:15:24 on dist-test-slave-h6n0"
I20260807 18:15:24.857671 11576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/wal/instance:
uuid: "b5bb27271da74b1a909d982e6fb2d470"
format_stamp: "Formatted at 2026-08-07 18:15:24 on dist-test-slave-h6n0"
I20260807 18:15:24.865782 11576 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260807 18:15:24.871567 11595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:24.873838 11576 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260807 18:15:24.874231 11576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/wal
uuid: "b5bb27271da74b1a909d982e6fb2d470"
format_stamp: "Formatted at 2026-08-07 18:15:24 on dist-test-slave-h6n0"
I20260807 18:15:24.874636 11576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:15:24.904282 11576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:15:24.905572 11576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:15:24.905975 11576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:15:24.907407 11576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:15:24.909710 11576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:15:24.909854 11576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:24.910014 11576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:15:24.910108 11576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:24.963011 11576 rpc_server.cc:307] RPC server started. Bound to: 127.10.253.66:43559
I20260807 18:15:24.963171 11762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.253.66:43559 every 8 connection(s)
I20260807 18:15:24.964987 11576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/data/info.pb
I20260807 18:15:24.971906 11253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu as pid 11576
I20260807 18:15:24.972142 11253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-1/wal/instance
I20260807 18:15:24.977388 11253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
/tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.253.67:0
--local_ip_for_outbound_sockets=127.10.253.67
--webserver_interface=127.10.253.67
--webserver_port=0
--tserver_master_addrs=127.10.253.126:46329
--builtin_ntp_servers=127.10.253.84:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260807 18:15:24.987906 11763 heartbeater.cc:347] Connected to a master server at 127.10.253.126:46329
I20260807 18:15:24.988482 11763 heartbeater.cc:464] Registering TS with master...
I20260807 18:15:24.989528 11763 heartbeater.cc:511] Master 127.10.253.126:46329 requested a full tablet report, sending...
I20260807 18:15:24.992537 11303 ts_manager.cc:194] Registered new tserver with Master: b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:15:24.994112 11303 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.253.66:34833
I20260807 18:15:25.335467 11571 heartbeater.cc:503] Master 127.10.253.126:46329 was elected leader, sending a full tablet report...
W20260807 18:15:25.440991 11768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:15:25.441395 11768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:15:25.441529 11768 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260807 18:15:25.441642 11768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:15:25.451519 11768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:15:25.451766 11768 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.253.67
I20260807 18:15:25.463476 11768 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.253.84:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.253.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.253.67
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.10.253.126:46329
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.253.67
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:15:25.465371 11768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:15:25.467975 11768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:15:25.487398 11775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:25.487347 11778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:25.487680 11774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:15:25.490953 11768 server_base.cc:1034] running on GCE node
I20260807 18:15:25.492369 11768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:15:25.494143 11768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:15:25.495687 11768 hybrid_clock.cc:648] HybridClock initialized: now 1786126525495549 us; error 99 us; skew 500 ppm
I20260807 18:15:25.496295 11768 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:15:25.500435 11768 webserver.cc:460] Webserver started at http://127.10.253.67:34099/ using document root <none> and password file <none>
I20260807 18:15:25.501449 11768 fs_manager.cc:359] Metadata directory not provided
I20260807 18:15:25.501575 11768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:15:25.501995 11768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:15:25.505847 11768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/data/instance:
uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
format_stamp: "Formatted at 2026-08-07 18:15:25 on dist-test-slave-h6n0"
I20260807 18:15:25.507823 11768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/wal/instance:
uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
format_stamp: "Formatted at 2026-08-07 18:15:25 on dist-test-slave-h6n0"
I20260807 18:15:25.517601 11768 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.004s
I20260807 18:15:25.523914 11789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:25.527060 11768 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.005s sys 0.001s
I20260807 18:15:25.527619 11768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/wal
uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
format_stamp: "Formatted at 2026-08-07 18:15:25 on dist-test-slave-h6n0"
I20260807 18:15:25.528115 11768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:15:25.564765 11768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:15:25.565891 11768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:15:25.566246 11768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:15:25.567977 11768 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:15:25.571672 11768 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:15:25.571831 11768 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:25.571993 11768 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:15:25.572095 11768 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:25.630618 11768 rpc_server.cc:307] RPC server started. Bound to: 127.10.253.67:33793
I20260807 18:15:25.630753 11941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.253.67:33793 every 8 connection(s)
I20260807 18:15:25.633242 11768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/data/info.pb
I20260807 18:15:25.643621 11253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu as pid 11768
I20260807 18:15:25.643895 11253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-2/wal/instance
I20260807 18:15:25.649358 11253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
/tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.253.68:0
--local_ip_for_outbound_sockets=127.10.253.68
--webserver_interface=127.10.253.68
--webserver_port=0
--tserver_master_addrs=127.10.253.126:46329
--builtin_ntp_servers=127.10.253.84:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260807 18:15:25.658633 11945 heartbeater.cc:347] Connected to a master server at 127.10.253.126:46329
I20260807 18:15:25.659224 11945 heartbeater.cc:464] Registering TS with master...
I20260807 18:15:25.660663 11945 heartbeater.cc:511] Master 127.10.253.126:46329 requested a full tablet report, sending...
I20260807 18:15:25.663632 11303 ts_manager.cc:194] Registered new tserver with Master: 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793)
I20260807 18:15:25.664777 11303 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.253.67:56097
I20260807 18:15:25.998836 11763 heartbeater.cc:503] Master 127.10.253.126:46329 was elected leader, sending a full tablet report...
W20260807 18:15:26.312604 11949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:15:26.313086 11949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:15:26.313304 11949 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260807 18:15:26.313448 11949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:15:26.325640 11949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:15:26.326042 11949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.253.68
I20260807 18:15:26.341105 11949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.253.84:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.253.68:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.10.253.68
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.10.253.126:46329
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.253.68
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:15:26.343278 11949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:15:26.346503 11949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:15:26.371624 11960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:26.371578 11959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:26.372638 11963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:15:26.373509 11949 server_base.cc:1034] running on GCE node
I20260807 18:15:26.374610 11949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:15:26.376160 11949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:15:26.377580 11949 hybrid_clock.cc:648] HybridClock initialized: now 1786126526377515 us; error 61 us; skew 500 ppm
I20260807 18:15:26.378062 11949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:15:26.385903 11949 webserver.cc:460] Webserver started at http://127.10.253.68:40311/ using document root <none> and password file <none>
I20260807 18:15:26.387476 11949 fs_manager.cc:359] Metadata directory not provided
I20260807 18:15:26.387737 11949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:15:26.388283 11949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:15:26.392499 11949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/data/instance:
uuid: "22052958d03d426ebdc2fc310637c846"
format_stamp: "Formatted at 2026-08-07 18:15:26 on dist-test-slave-h6n0"
I20260807 18:15:26.393705 11949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/wal/instance:
uuid: "22052958d03d426ebdc2fc310637c846"
format_stamp: "Formatted at 2026-08-07 18:15:26 on dist-test-slave-h6n0"
I20260807 18:15:26.403350 11949 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.011s sys 0.000s
I20260807 18:15:26.410953 11970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:26.414000 11949 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260807 18:15:26.414456 11949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/data,/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/wal
uuid: "22052958d03d426ebdc2fc310637c846"
format_stamp: "Formatted at 2026-08-07 18:15:26 on dist-test-slave-h6n0"
I20260807 18:15:26.414942 11949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:15:26.446686 11949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:15:26.448508 11949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:15:26.449131 11949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:15:26.451897 11949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:15:26.455870 11949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:15:26.456112 11949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:26.456355 11949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:15:26.456498 11949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:26.555689 11949 rpc_server.cc:307] RPC server started. Bound to: 127.10.253.68:43889
I20260807 18:15:26.555840 12132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.253.68:43889 every 8 connection(s)
I20260807 18:15:26.557757 11949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/data/info.pb
I20260807 18:15:26.565668 11253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu as pid 11949
I20260807 18:15:26.566030 11253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-3/wal/instance
I20260807 18:15:26.573976 11253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
/tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.253.69:0
--local_ip_for_outbound_sockets=127.10.253.69
--webserver_interface=127.10.253.69
--webserver_port=0
--tserver_master_addrs=127.10.253.126:46329
--builtin_ntp_servers=127.10.253.84:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260807 18:15:26.588598 12133 heartbeater.cc:347] Connected to a master server at 127.10.253.126:46329
I20260807 18:15:26.589283 12133 heartbeater.cc:464] Registering TS with master...
I20260807 18:15:26.590682 12133 heartbeater.cc:511] Master 127.10.253.126:46329 requested a full tablet report, sending...
I20260807 18:15:26.593726 11303 ts_manager.cc:194] Registered new tserver with Master: 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889)
I20260807 18:15:26.595244 11303 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.253.68:56595
I20260807 18:15:26.670187 11945 heartbeater.cc:503] Master 127.10.253.126:46329 was elected leader, sending a full tablet report...
W20260807 18:15:27.364246 12137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:15:27.365281 12137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:15:27.365610 12137 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260807 18:15:27.365823 12137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:15:27.380414 12137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:15:27.380774 12137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.253.69
I20260807 18:15:27.397876 12137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.253.84:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.253.69:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/data/info.pb
--webserver_interface=127.10.253.69
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.10.253.126:46329
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.253.69
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:15:27.400393 12137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:15:27.404273 12137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:15:27.436815 12145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:27.436810 12143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:27.437289 12147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:15:27.440707 12137 server_base.cc:1034] running on GCE node
I20260807 18:15:27.442137 12137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:15:27.444672 12137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:15:27.448362 12137 hybrid_clock.cc:648] HybridClock initialized: now 1786126527448081 us; error 160 us; skew 500 ppm
I20260807 18:15:27.449249 12137 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:15:27.457018 12137 webserver.cc:460] Webserver started at http://127.10.253.69:44651/ using document root <none> and password file <none>
I20260807 18:15:27.459033 12137 fs_manager.cc:359] Metadata directory not provided
I20260807 18:15:27.459303 12137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:15:27.459887 12137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:15:27.464861 12137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/data/instance:
uuid: "41f204b71daa453ea5e1226f14f422ca"
format_stamp: "Formatted at 2026-08-07 18:15:27 on dist-test-slave-h6n0"
I20260807 18:15:27.466431 12137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/wal/instance:
uuid: "41f204b71daa453ea5e1226f14f422ca"
format_stamp: "Formatted at 2026-08-07 18:15:27 on dist-test-slave-h6n0"
I20260807 18:15:27.478322 12137 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.004s sys 0.004s
I20260807 18:15:27.486637 12158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:27.489423 12137 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260807 18:15:27.489742 12137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/data,/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/wal
uuid: "41f204b71daa453ea5e1226f14f422ca"
format_stamp: "Formatted at 2026-08-07 18:15:27 on dist-test-slave-h6n0"
I20260807 18:15:27.490262 12137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/wal
metadata directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/wal
1 data directories: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:15:27.535831 12137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:15:27.538285 12137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:15:27.539434 12137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:15:27.542382 12137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:15:27.545787 12137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:15:27.546041 12137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:27.546222 12137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:15:27.546372 12137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:27.602277 12133 heartbeater.cc:503] Master 127.10.253.126:46329 was elected leader, sending a full tablet report...
I20260807 18:15:27.692075 12137 rpc_server.cc:307] RPC server started. Bound to: 127.10.253.69:45839
I20260807 18:15:27.692277 12311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.253.69:45839 every 8 connection(s)
I20260807 18:15:27.695008 12137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/data/info.pb
I20260807 18:15:27.698005 11253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu as pid 12137
I20260807 18:15:27.698318 11253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-4/wal/instance
I20260807 18:15:27.728399 12312 heartbeater.cc:347] Connected to a master server at 127.10.253.126:46329
I20260807 18:15:27.729123 12312 heartbeater.cc:464] Registering TS with master...
I20260807 18:15:27.731472 12312 heartbeater.cc:511] Master 127.10.253.126:46329 requested a full tablet report, sending...
I20260807 18:15:27.733908 11303 ts_manager.cc:194] Registered new tserver with Master: 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:15:27.736063 11303 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.253.69:46491
I20260807 18:15:27.739908 11253 external_mini_cluster.cc:930] 5 TS(s) registered with all masters
I20260807 18:15:27.781700 11253 test_util.cc:268] Using random seed: -46769458
I20260807 18:15:27.846248 11302 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37686:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
rows: "<redacted>""\004\001\000\252\252\252*\004\001\000TUUU"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:15:27.849669 11302 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 6 tablet servers would be needed, 5 are available. Consider bringing up more tablet servers.
I20260807 18:15:27.962612 12219 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7eca40645d4ee29079ced64fa54d37 (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20260807 18:15:27.963310 12041 tablet_service.cc:1467] Processing CreateTablet for tablet 874ba119c7284c4d8a113d6654e0c39e (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20260807 18:15:27.965535 12219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7eca40645d4ee29079ced64fa54d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:27.960865 12223 tablet_service.cc:1467] Processing CreateTablet for tablet 644a01df651c43d4a74ac241ea43068c (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION VALUES < 715827882
I20260807 18:15:27.970232 12044 tablet_service.cc:1467] Processing CreateTablet for tablet 644a01df651c43d4a74ac241ea43068c (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION VALUES < 715827882
I20260807 18:15:27.971735 12223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 644a01df651c43d4a74ac241ea43068c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:27.971657 12038 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7eca40645d4ee29079ced64fa54d37 (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20260807 18:15:27.968518 11481 tablet_service.cc:1467] Processing CreateTablet for tablet 644a01df651c43d4a74ac241ea43068c (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION VALUES < 715827882
I20260807 18:15:27.968425 11476 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7eca40645d4ee29079ced64fa54d37 (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20260807 18:15:27.974049 11478 tablet_service.cc:1467] Processing CreateTablet for tablet 874ba119c7284c4d8a113d6654e0c39e (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20260807 18:15:27.976114 12221 tablet_service.cc:1467] Processing CreateTablet for tablet 874ba119c7284c4d8a113d6654e0c39e (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20260807 18:15:27.977799 11481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 644a01df651c43d4a74ac241ea43068c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:27.977788 12221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 874ba119c7284c4d8a113d6654e0c39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:27.980803 11478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 874ba119c7284c4d8a113d6654e0c39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:27.981822 11476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7eca40645d4ee29079ced64fa54d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:27.995654 11854 tablet_service.cc:1467] Processing CreateTablet for tablet 644a01df651c43d4a74ac241ea43068c (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION VALUES < 715827882
I20260807 18:15:27.997303 12041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 874ba119c7284c4d8a113d6654e0c39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:28.001154 12038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7eca40645d4ee29079ced64fa54d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:28.001755 11854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 644a01df651c43d4a74ac241ea43068c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:28.002331 12044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 644a01df651c43d4a74ac241ea43068c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:27.996420 11852 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7eca40645d4ee29079ced64fa54d37 (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20260807 18:15:28.003561 11852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7eca40645d4ee29079ced64fa54d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:27.993448 11853 tablet_service.cc:1467] Processing CreateTablet for tablet 874ba119c7284c4d8a113d6654e0c39e (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20260807 18:15:28.013790 11853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 874ba119c7284c4d8a113d6654e0c39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:28.004560 11664 tablet_service.cc:1467] Processing CreateTablet for tablet 874ba119c7284c4d8a113d6654e0c39e (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20260807 18:15:28.016103 11662 tablet_service.cc:1467] Processing CreateTablet for tablet 4c7eca40645d4ee29079ced64fa54d37 (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20260807 18:15:28.012707 11665 tablet_service.cc:1467] Processing CreateTablet for tablet 644a01df651c43d4a74ac241ea43068c (DEFAULT_TABLE table=test-workload [id=8bd0c38a73b949c3a98e549c83519895]), partition=RANGE (key) PARTITION VALUES < 715827882
I20260807 18:15:28.023173 11662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7eca40645d4ee29079ced64fa54d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:28.027365 11665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 644a01df651c43d4a74ac241ea43068c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:28.034863 11664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 874ba119c7284c4d8a113d6654e0c39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:28.078512 12357 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca: Bootstrap starting.
I20260807 18:15:28.095752 12359 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9: Bootstrap starting.
I20260807 18:15:28.100356 12360 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846: Bootstrap starting.
I20260807 18:15:28.106036 12357 tablet_bootstrap.cc:654] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.107939 12360 tablet_bootstrap.cc:654] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.109004 12359 tablet_bootstrap.cc:654] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.112353 12360 log.cc:824] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846: Log is configured to *not* fsync() on all Append() calls
I20260807 18:15:28.113912 12361 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Bootstrap starting.
I20260807 18:15:28.114398 12359 log.cc:824] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9: Log is configured to *not* fsync() on all Append() calls
I20260807 18:15:28.124927 12361 tablet_bootstrap.cc:654] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.125466 12360 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846: No bootstrap required, opened a new log
I20260807 18:15:28.126340 12360 ts_tablet_manager.cc:1397] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846: Time spent bootstrapping tablet: real 0.026s user 0.015s sys 0.008s
I20260807 18:15:28.126704 12357 log.cc:824] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca: Log is configured to *not* fsync() on all Append() calls
I20260807 18:15:28.127516 12361 log.cc:824] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Log is configured to *not* fsync() on all Append() calls
I20260807 18:15:28.142405 12367 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470: Bootstrap starting.
I20260807 18:15:28.143739 12361 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: No bootstrap required, opened a new log
I20260807 18:15:28.144460 12361 ts_tablet_manager.cc:1397] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Time spent bootstrapping tablet: real 0.031s user 0.015s sys 0.009s
I20260807 18:15:28.144996 12359 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9: No bootstrap required, opened a new log
I20260807 18:15:28.146770 12359 ts_tablet_manager.cc:1397] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9: Time spent bootstrapping tablet: real 0.051s user 0.011s sys 0.036s
I20260807 18:15:28.152108 12357 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca: No bootstrap required, opened a new log
I20260807 18:15:28.156534 12367 tablet_bootstrap.cc:654] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.161473 12360 raft_consensus.cc:348] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.162041 12367 log.cc:824] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470: Log is configured to *not* fsync() on all Append() calls
I20260807 18:15:28.162639 12360 raft_consensus.cc:374] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.162931 12360 raft_consensus.cc:729] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22052958d03d426ebdc2fc310637c846, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.163210 12357 ts_tablet_manager.cc:1397] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca: Time spent bootstrapping tablet: real 0.085s user 0.011s sys 0.016s
I20260807 18:15:28.164176 12360 consensus_queue.cc:260] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.172151 12361 raft_consensus.cc:348] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.174616 12361 raft_consensus.cc:374] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.174907 12361 raft_consensus.cc:729] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.176538 12367 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470: No bootstrap required, opened a new log
I20260807 18:15:28.176638 12361 consensus_queue.cc:260] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.177211 12367 ts_tablet_manager.cc:1397] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470: Time spent bootstrapping tablet: real 0.035s user 0.017s sys 0.013s
I20260807 18:15:28.181435 12360 ts_tablet_manager.cc:1428] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846: Time spent starting tablet: real 0.055s user 0.017s sys 0.024s
I20260807 18:15:28.182386 12360 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846: Bootstrap starting.
I20260807 18:15:28.187958 12360 tablet_bootstrap.cc:654] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.199457 12361 ts_tablet_manager.cc:1428] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Time spent starting tablet: real 0.055s user 0.022s sys 0.015s
I20260807 18:15:28.200747 12361 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Bootstrap starting.
I20260807 18:15:28.205863 12360 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846: No bootstrap required, opened a new log
I20260807 18:15:28.207695 12359 raft_consensus.cc:348] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.207459 12367 raft_consensus.cc:348] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.208437 12359 raft_consensus.cc:374] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.208671 12367 raft_consensus.cc:374] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.208668 12359 raft_consensus.cc:729] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a9cdd541bff40f98b3a280123bcc1a9, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.208829 12367 raft_consensus.cc:729] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5bb27271da74b1a909d982e6fb2d470, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.210386 12367 consensus_queue.cc:260] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.212739 12360 ts_tablet_manager.cc:1397] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846: Time spent bootstrapping tablet: real 0.031s user 0.011s sys 0.007s
I20260807 18:15:28.214589 12361 tablet_bootstrap.cc:654] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.214998 12360 raft_consensus.cc:348] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.215509 12360 raft_consensus.cc:374] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.215685 12360 raft_consensus.cc:729] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22052958d03d426ebdc2fc310637c846, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.212145 12359 consensus_queue.cc:260] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.216284 12360 consensus_queue.cc:260] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.216708 12370 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:15:28.217890 12370 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.219519 12357 raft_consensus.cc:348] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.220870 12357 raft_consensus.cc:374] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.221282 12367 ts_tablet_manager.cc:1428] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470: Time spent starting tablet: real 0.044s user 0.014s sys 0.014s
W20260807 18:15:28.221844 11764 tablet.cc:2369] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:15:28.222105 12372 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 18:15:28.222496 11764 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20260807 18:15:28.221160 12357 raft_consensus.cc:729] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f204b71daa453ea5e1226f14f422ca, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.223222 12372 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.222513 12367 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470: Bootstrap starting.
I20260807 18:15:28.224819 12357 consensus_queue.cc:260] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.233670 12367 tablet_bootstrap.cc:654] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.240511 12370 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:15:28.242998 12359 ts_tablet_manager.cc:1428] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9: Time spent starting tablet: real 0.096s user 0.020s sys 0.016s
I20260807 18:15:28.245474 12359 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9: Bootstrap starting.
I20260807 18:15:28.247766 12374 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:15:28.253937 12359 tablet_bootstrap.cc:654] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.249106 12374 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.258495 12372 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:15:28.266851 12312 heartbeater.cc:503] Master 127.10.253.126:46329 was elected leader, sending a full tablet report...
I20260807 18:15:28.268532 12361 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: No bootstrap required, opened a new log
I20260807 18:15:28.269009 12361 ts_tablet_manager.cc:1397] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.008s
I20260807 18:15:28.275518 12361 raft_consensus.cc:348] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.276180 12361 raft_consensus.cc:374] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.276646 12361 raft_consensus.cc:729] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.277465 12361 consensus_queue.cc:260] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.283385 12376 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:15:28.284231 12376 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.292009 12377 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:15:28.298820 12370 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:15:28.299358 12370 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
W20260807 18:15:28.300693 11572 tablet.cc:2369] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:15:28.301626 11572 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20260807 18:15:28.301815 12370 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:15:28.304451 12361 ts_tablet_manager.cc:1428] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Time spent starting tablet: real 0.035s user 0.002s sys 0.008s
I20260807 18:15:28.306898 12361 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Bootstrap starting.
I20260807 18:15:28.307322 12367 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470: No bootstrap required, opened a new log
I20260807 18:15:28.307683 12367 ts_tablet_manager.cc:1397] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.038s
W20260807 18:15:28.313114 12134 tablet.cc:2369] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:15:28.313946 12134 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20260807 18:15:28.318773 12372 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:15:28.319818 12372 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.325309 12372 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:15:28.332106 12360 ts_tablet_manager.cc:1428] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846: Time spent starting tablet: real 0.119s user 0.010s sys 0.016s
I20260807 18:15:28.332885 12360 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846: Bootstrap starting.
I20260807 18:15:28.335928 12374 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793)
I20260807 18:15:28.337597 12361 tablet_bootstrap.cc:654] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.337177 12367 raft_consensus.cc:348] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.341236 12367 raft_consensus.cc:374] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.343595 12376 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:15:28.344100 12367 raft_consensus.cc:729] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5bb27271da74b1a909d982e6fb2d470, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.347705 12367 consensus_queue.cc:260] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.352584 12360 tablet_bootstrap.cc:654] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.334761 12377 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.371356 12367 ts_tablet_manager.cc:1428] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470: Time spent starting tablet: real 0.059s user 0.003s sys 0.006s
I20260807 18:15:28.372709 12367 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470: Bootstrap starting.
I20260807 18:15:28.317952 12357 ts_tablet_manager.cc:1428] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca: Time spent starting tablet: real 0.155s user 0.037s sys 0.008s
W20260807 18:15:28.389866 11946 tablet.cc:2369] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:15:28.390590 11946 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20260807 18:15:28.391956 12359 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9: No bootstrap required, opened a new log
I20260807 18:15:28.392670 12359 ts_tablet_manager.cc:1397] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9: Time spent bootstrapping tablet: real 0.149s user 0.004s sys 0.014s
I20260807 18:15:28.395599 12359 raft_consensus.cc:348] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.396157 12360 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846: No bootstrap required, opened a new log
I20260807 18:15:28.396441 12359 raft_consensus.cc:374] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.396566 12360 ts_tablet_manager.cc:1397] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.011s
I20260807 18:15:28.397032 12359 raft_consensus.cc:729] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a9cdd541bff40f98b3a280123bcc1a9, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.398106 12359 consensus_queue.cc:260] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.399103 12360 raft_consensus.cc:348] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.400396 12360 raft_consensus.cc:374] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.400651 12360 raft_consensus.cc:729] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22052958d03d426ebdc2fc310637c846, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.402195 12359 ts_tablet_manager.cc:1428] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260807 18:15:28.403151 12359 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9: Bootstrap starting.
I20260807 18:15:28.404422 12361 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: No bootstrap required, opened a new log
I20260807 18:15:28.408242 12374 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:15:28.408699 12374 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.410741 12374 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:15:28.424311 12367 tablet_bootstrap.cc:654] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.426108 12357 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca: Bootstrap starting.
I20260807 18:15:28.441773 11690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.443120 12361 ts_tablet_manager.cc:1397] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Time spent bootstrapping tablet: real 0.100s user 0.010s sys 0.012s
I20260807 18:15:28.445526 12361 raft_consensus.cc:348] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.446787 12360 consensus_queue.cc:260] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.449301 12361 raft_consensus.cc:374] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.449641 12380 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 18:15:28.450093 12313 tablet.cc:2369] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:15:28.450973 12313 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
I20260807 18:15:28.450302 12380 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.450896 11692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.452167 12361 raft_consensus.cc:729] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.449160 11510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.451735 11692 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 0.
I20260807 18:15:28.443136 11509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.455279 11509 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 0.
I20260807 18:15:28.454676 12361 consensus_queue.cc:260] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.456609 11510 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 0.
I20260807 18:15:28.457715 11690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.458235 11690 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 0.
I20260807 18:15:28.459935 12361 ts_tablet_manager.cc:1428] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260807 18:15:28.460819 11509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.461414 11509 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 0.
I20260807 18:15:28.453402 12360 ts_tablet_manager.cc:1428] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846: Time spent starting tablet: real 0.057s user 0.006s sys 0.003s
W20260807 18:15:28.457363 11977 leader_election.cc:341] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Illegal state: must be running to vote when last-logged opid is not known
I20260807 18:15:28.468741 11977 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, b5bb27271da74b1a909d982e6fb2d470; no voters:
I20260807 18:15:28.469606 12370 raft_consensus.cc:2781] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:15:28.469908 11977 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, b5bb27271da74b1a909d982e6fb2d470; no voters:
I20260807 18:15:28.470225 12370 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:15:28.470643 12370 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.455410 12380 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:15:28.480123 11509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.480509 11510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.480783 11509 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5bb27271da74b1a909d982e6fb2d470 in term 0.
I20260807 18:15:28.480811 11510 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5bb27271da74b1a909d982e6fb2d470 in term 0.
I20260807 18:15:28.483357 12380 raft_consensus.cc:2781] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:15:28.485397 12380 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:15:28.486037 12380 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.488875 11510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.489568 11510 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 0.
I20260807 18:15:28.508462 12377 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889)
I20260807 18:15:28.513775 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:15:28.514708 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:15:28.516593 12074 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 0.
I20260807 18:15:28.522989 12370 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.528859 12367 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470: No bootstrap required, opened a new log
I20260807 18:15:28.529340 12367 ts_tablet_manager.cc:1397] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470: Time spent bootstrapping tablet: real 0.157s user 0.005s sys 0.013s
I20260807 18:15:28.530776 12367 raft_consensus.cc:348] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.531365 12380 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.532835 12073 raft_consensus.cc:2379] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 1: Already voted for candidate 22052958d03d426ebdc2fc310637c846 in this term.
I20260807 18:15:28.537506 12380 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 election: Requested vote from peers 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
W20260807 18:15:28.538422 11977 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 68668.8us
I20260807 18:15:28.540463 11510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd"
I20260807 18:15:28.541186 11510 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.548269 11510 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 1.
I20260807 18:15:28.411073 12376 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:15:28.490294 11884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:28.502095 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:28.552178 12376 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.557729 11510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.558880 11510 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 0.
I20260807 18:15:28.561167 12357 tablet_bootstrap.cc:654] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.563138 11884 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 0.
I20260807 18:15:28.565524 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:15:28.566155 12073 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 0.
I20260807 18:15:28.567143 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:15:28.567674 12074 raft_consensus.cc:2379] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a9cdd541bff40f98b3a280123bcc1a9 in current term 1: Already voted for candidate 22052958d03d426ebdc2fc310637c846 in this term.
I20260807 18:15:28.567487 11411 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9; no voters:
I20260807 18:15:28.568640 12372 raft_consensus.cc:2781] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:15:28.568934 12372 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:15:28.569432 12372 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.569761 12376 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
W20260807 18:15:28.577119 11411 leader_election.cc:341] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260807 18:15:28.579609 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:28.580411 11884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:28.580981 11884 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 0.
I20260807 18:15:28.581748 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:15:28.583014 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:28.584617 11790 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9; no voters:
I20260807 18:15:28.586683 11883 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 0.
I20260807 18:15:28.587617 12376 raft_consensus.cc:2781] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:15:28.588033 12376 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:15:28.589093 12372 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.589936 12376 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.593904 11974 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: b5bb27271da74b1a909d982e6fb2d470
I20260807 18:15:28.597111 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:15:28.597992 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:15:28.599102 12074 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.601094 11510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd"
I20260807 18:15:28.601722 11510 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.602911 11690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470"
W20260807 18:15:28.603384 11974 leader_election.cc:341] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Illegal state: must be running to vote when last-logged opid is not known
W20260807 18:15:28.603894 11974 leader_election.cc:341] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260807 18:15:28.603782 11690 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.605752 12376 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.607540 12367 raft_consensus.cc:374] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.608156 11510 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 1.
I20260807 18:15:28.608834 12074 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 1.
I20260807 18:15:28.609519 12380 raft_consensus.cc:2741] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 18:15:28.610743 11692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470"
I20260807 18:15:28.611198 11692 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.613782 12359 tablet_bootstrap.cc:654] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9: Neither blocks nor log segments found. Creating new log.
I20260807 18:15:28.619498 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:15:28.620162 11881 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.623332 11510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd"
I20260807 18:15:28.623800 12367 raft_consensus.cc:729] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5bb27271da74b1a909d982e6fb2d470, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.624430 11510 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6a9cdd541bff40f98b3a280123bcc1a9 in current term 1: Already voted for candidate 50da72adf57546f5bab0a028672a51dd in this term.
I20260807 18:15:28.624507 12367 consensus_queue.cc:260] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.626078 12367 ts_tablet_manager.cc:1428] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470: Time spent starting tablet: real 0.096s user 0.003s sys 0.003s
I20260807 18:15:28.627686 12376 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 1 election: Requested vote from peers 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:15:28.628890 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:15:28.630012 12074 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6a9cdd541bff40f98b3a280123bcc1a9 in current term 1: Already voted for candidate 50da72adf57546f5bab0a028672a51dd in this term.
I20260807 18:15:28.631902 12359 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9: No bootstrap required, opened a new log
I20260807 18:15:28.632875 12359 ts_tablet_manager.cc:1397] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9: Time spent bootstrapping tablet: real 0.229s user 0.009s sys 0.002s
I20260807 18:15:28.638171 11690 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 1.
I20260807 18:15:28.638929 11883 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 1: Already voted for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in this term.
I20260807 18:15:28.639394 11977 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, b5bb27271da74b1a909d982e6fb2d470; no voters: 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:15:28.640143 12380 raft_consensus.cc:2781] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:15:28.640763 12380 raft_consensus.cc:686] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Becoming Leader. State: Replica: 22052958d03d426ebdc2fc310637c846, State: Running, Role: LEADER
I20260807 18:15:28.641955 12380 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.648947 11692 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 1.
I20260807 18:15:28.650022 11977 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, b5bb27271da74b1a909d982e6fb2d470; no voters:
W20260807 18:15:28.650961 11974 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.10.253.69:45839 for RPC RequestConsensusVote timed out after 0.419s (ON_OUTBOUND_QUEUE)
I20260807 18:15:28.651831 12424 raft_consensus.cc:2781] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:15:28.599157 12370 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 election: Requested vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:15:28.655812 11881 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 1.
I20260807 18:15:28.648888 12359 raft_consensus.cc:348] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.656960 12359 raft_consensus.cc:374] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.657478 12359 raft_consensus.cc:729] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a9cdd541bff40f98b3a280123bcc1a9, State: Initialized, Role: FOLLOWER
W20260807 18:15:28.661870 11596 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.10.253.69:45839 for RPC RequestConsensusVote timed out after 0.338s (ON_OUTBOUND_QUEUE)
I20260807 18:15:28.670393 12374 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:15:28.670917 12374 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.672559 12374 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:15:28.674122 11510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.674731 11510 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5bb27271da74b1a909d982e6fb2d470 in current term 1: Already voted for candidate 50da72adf57546f5bab0a028672a51dd in this term.
I20260807 18:15:28.659596 12359 consensus_queue.cc:260] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
W20260807 18:15:28.683286 11414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.253.66:43559 timed out after 0.437s (SENT)
I20260807 18:15:28.683610 12359 ts_tablet_manager.cc:1428] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9: Time spent starting tablet: real 0.050s user 0.006s sys 0.001s
I20260807 18:15:28.687893 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:28.694991 11881 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 0.
I20260807 18:15:28.695672 12424 raft_consensus.cc:686] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Becoming Leader. State: Replica: 22052958d03d426ebdc2fc310637c846, State: Running, Role: LEADER
I20260807 18:15:28.696635 12424 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.660727 12372 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 1 election: Requested vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
W20260807 18:15:28.702374 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.69:45839, user_credentials={real_user=slave}} blocked reactor thread for 51250.2us
W20260807 18:15:28.707276 11596 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.69:45839, user_credentials={real_user=slave}} blocked reactor thread for 45408.5us
I20260807 18:15:28.714582 11301 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22052958d03d426ebdc2fc310637c846 (127.10.253.68). New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } }
I20260807 18:15:28.718020 11690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.719408 11690 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 0.
W20260807 18:15:28.718515 11793 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.253.66:43559 timed out after 0.375s (SENT)
I20260807 18:15:28.720333 11686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.721879 11687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.724434 11687 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 0.
I20260807 18:15:28.725152 11686 raft_consensus.cc:2379] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 1: Already voted for candidate 22052958d03d426ebdc2fc310637c846 in this term.
I20260807 18:15:28.727237 11692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.719408 11688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470"
I20260807 18:15:28.730149 11414 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:15:28.730202 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:28.728035 11688 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.731078 11881 raft_consensus.cc:2379] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5bb27271da74b1a909d982e6fb2d470 in current term 1: Already voted for candidate 22052958d03d426ebdc2fc310637c846 in this term.
I20260807 18:15:28.731822 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:28.732627 11880 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5bb27271da74b1a909d982e6fb2d470 in current term 1: Already voted for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in this term.
I20260807 18:15:28.734249 12372 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 18:15:28.736956 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:15:28.738276 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:15:28.739033 12073 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5bb27271da74b1a909d982e6fb2d470 in current term 1: Already voted for candidate 50da72adf57546f5bab0a028672a51dd in this term.
I20260807 18:15:28.741884 12424 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:15:28.752120 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:28.753635 11883 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5bb27271da74b1a909d982e6fb2d470 in term 0.
I20260807 18:15:28.758617 11686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.759874 12251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.760103 11690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.761435 11690 raft_consensus.cc:2379] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a9cdd541bff40f98b3a280123bcc1a9 in current term 1: Already voted for candidate 22052958d03d426ebdc2fc310637c846 in this term.
I20260807 18:15:28.761399 12251 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5bb27271da74b1a909d982e6fb2d470 in term 0.
I20260807 18:15:28.762090 11685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470"
I20260807 18:15:28.763723 11684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.764914 11596 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: b5bb27271da74b1a909d982e6fb2d470; no voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:15:28.766938 11596 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470; no voters: 22052958d03d426ebdc2fc310637c846
I20260807 18:15:28.767825 11793 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:15:28.769368 12376 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 18:15:28.770130 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:15:28.771445 11692 raft_consensus.cc:2379] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 1: Already voted for candidate 22052958d03d426ebdc2fc310637c846 in this term.
I20260807 18:15:28.768971 12250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.771999 12249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.780380 12424 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 18:15:28.787441 11688 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 1.
I20260807 18:15:28.787954 12374 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 18:15:28.791495 11883 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.793735 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:15:28.801466 12357 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca: No bootstrap required, opened a new log
I20260807 18:15:28.801891 12357 ts_tablet_manager.cc:1397] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca: Time spent bootstrapping tablet: real 0.376s user 0.014s sys 0.038s
I20260807 18:15:28.805166 12250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.805804 12250 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 0.
I20260807 18:15:28.806640 12249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.807395 12251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:15:28.807420 12380 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:15:28.808351 12247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.810673 12380 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:15:28.810968 12247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
W20260807 18:15:28.812494 11790 leader_election.cc:341] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839): Illegal state: must be running to vote when last-logged opid is not known
I20260807 18:15:28.812968 12357 raft_consensus.cc:348] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.813580 12357 raft_consensus.cc:374] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 18:15:28.813637 11790 leader_election.cc:341] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839): Illegal state: must be running to vote when last-logged opid is not known
I20260807 18:15:28.813831 12357 raft_consensus.cc:729] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f204b71daa453ea5e1226f14f422ca, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.815166 12247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:15:28.817173 12251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.817863 12374 raft_consensus.cc:2741] T 4c7eca40645d4ee29079ced64fa54d37 P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 18:15:28.818588 12250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.818493 12357 consensus_queue.cc:260] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:28.828758 12424 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:15:28.833777 12249 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 0.
I20260807 18:15:28.833777 12247 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.837560 11790 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 5 responses out of 5 voters: 3 yes votes; 2 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 22052958d03d426ebdc2fc310637c846, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:15:28.838713 12376 raft_consensus.cc:2741] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 18:15:28.844493 11297 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22052958d03d426ebdc2fc310637c846 (127.10.253.68). New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } }
I20260807 18:15:28.856305 12249 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Advancing to term 1
W20260807 18:15:28.856911 11596 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.67:33793, user_credentials={real_user=slave}} blocked reactor thread for 60950.6us
W20260807 18:15:28.858214 11596 leader_election.cc:341] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839): Illegal state: must be running to vote when last-logged opid is not known
I20260807 18:15:28.858383 12250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.859035 11414 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, b5bb27271da74b1a909d982e6fb2d470; no voters: 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:15:28.860090 12372 raft_consensus.cc:2781] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader election won for term 1
W20260807 18:15:28.862975 11974 leader_election.cc:341] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839): Illegal state: must be running to vote when last-logged opid is not known
I20260807 18:15:28.863368 12251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
W20260807 18:15:28.865067 11596 leader_election.cc:341] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839): Illegal state: must be running to vote when last-logged opid is not known
I20260807 18:15:28.866055 11596 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd, b5bb27271da74b1a909d982e6fb2d470; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:15:28.864110 12243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.868489 12374 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 18:15:28.869165 12251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "b5bb27271da74b1a909d982e6fb2d470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.869959 12250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.876417 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
W20260807 18:15:28.879909 11411 leader_election.cc:341] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839): Illegal state: must be running to vote when last-logged opid is not known
I20260807 18:15:28.882050 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:15:28.883773 12357 ts_tablet_manager.cc:1428] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca: Time spent starting tablet: real 0.082s user 0.001s sys 0.008s
I20260807 18:15:28.882965 12463 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 18:15:28.885390 12357 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca: Bootstrap starting.
I20260807 18:15:28.889629 11684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.894470 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:15:28.895529 12247 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 1.
W20260807 18:15:28.899793 11411 leader_election.cc:341] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839): Illegal state: must be running to vote when last-logged opid is not known
I20260807 18:15:28.904932 12357 tablet_bootstrap.cc:654] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca: Neither blocks nor log segments found. Creating new log.
W20260807 18:15:28.905160 12163 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.253.65:37131 timed out after 0.387s (SENT)
I20260807 18:15:28.923177 12424 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:15:28.923697 12424 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.926712 11684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.927125 11684 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 1.
I20260807 18:15:28.927776 12424 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:15:28.929179 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:28.929718 11880 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 1.
I20260807 18:15:28.930799 11974 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470; no voters:
I20260807 18:15:28.931475 12424 raft_consensus.cc:2781] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 18:15:28.931754 12424 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:15:28.932070 12424 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:15:28.932912 12357 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca: No bootstrap required, opened a new log
I20260807 18:15:28.933130 12357 ts_tablet_manager.cc:1397] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.008s
I20260807 18:15:28.934370 12357 raft_consensus.cc:348] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.937041 12357 raft_consensus.cc:374] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:15:28.937223 12357 raft_consensus.cc:729] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f204b71daa453ea5e1226f14f422ca, State: Initialized, Role: FOLLOWER
I20260807 18:15:28.937707 12357 consensus_queue.cc:260] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.938853 12377 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:15:28.939340 12377 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.941468 12377 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889)
I20260807 18:15:28.945346 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:28.946003 11880 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41f204b71daa453ea5e1226f14f422ca in current term 1: Already voted for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in this term.
I20260807 18:15:28.946756 12357 ts_tablet_manager.cc:1428] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
W20260807 18:15:28.947371 12163 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.65:37131, user_credentials={real_user=slave}} blocked reactor thread for 47807.8us
I20260807 18:15:28.949029 11684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:28.949110 12249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:15:28.949508 11684 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41f204b71daa453ea5e1226f14f422ca in current term 1: Already voted for candidate 50da72adf57546f5bab0a028672a51dd in this term.
I20260807 18:15:28.949571 12249 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 0.
I20260807 18:15:28.952770 11510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.953470 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:15:28.953707 11509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.954165 12370 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 18:15:28.955008 12460 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 18:15:28.957135 11508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.957536 12372 raft_consensus.cc:686] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 1 LEADER]: Becoming Leader. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Running, Role: LEADER
I20260807 18:15:28.959695 12372 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.967535 11510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:28.968662 12163 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca; no voters: 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:15:28.969463 12377 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:15:28.969882 11297 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 50da72adf57546f5bab0a028672a51dd (127.10.253.65). New cstate: current_term: 1 leader_uuid: "50da72adf57546f5bab0a028672a51dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } }
I20260807 18:15:28.973091 12163 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:15:28.981977 12377 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 18:15:28.965044 12424 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:28.984377 12073 raft_consensus.cc:2354] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41f204b71daa453ea5e1226f14f422ca for earlier term 1. Current term is 2.
I20260807 18:15:28.988658 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:15:28.989372 11880 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:15:28.990351 12160 leader_election.cc:398] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 1 pre-election: Vote denied by peer 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889) with higher term. Message: Invalid argument: T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41f204b71daa453ea5e1226f14f422ca for earlier term 1. Current term is 2.
I20260807 18:15:28.991168 11684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470"
I20260807 18:15:28.991525 11684 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:15:28.995136 11880 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 2.
I20260807 18:15:29.001845 11684 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 2.
I20260807 18:15:29.002875 11510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd"
I20260807 18:15:29.004592 12424 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 2 election: Requested vote from peers 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:15:29.005127 11977 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470; no voters: 50da72adf57546f5bab0a028672a51dd
I20260807 18:15:29.005132 12247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:15:29.005710 12424 raft_consensus.cc:2781] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:15:29.005829 12247 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:15:29.005964 12424 raft_consensus.cc:686] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 LEADER]: Becoming Leader. State: Replica: 22052958d03d426ebdc2fc310637c846, State: Running, Role: LEADER
I20260807 18:15:29.008517 12424 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:29.013403 12247 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 2.
I20260807 18:15:29.018646 12377 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 18:15:29.024995 11297 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 reported cstate change: term changed from 1 to 2, leader changed from 50da72adf57546f5bab0a028672a51dd (127.10.253.65) to 22052958d03d426ebdc2fc310637c846 (127.10.253.68). New cstate: current_term: 2 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } }
I20260807 18:15:29.041934 11684 raft_consensus.cc:1226] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 2 FOLLOWER]: Rejecting Update request from peer 50da72adf57546f5bab0a028672a51dd for earlier term 1. Current term is 2. Ops: []
I20260807 18:15:29.043948 12372 consensus_queue.cc:1046] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:15:29.044692 12372 raft_consensus.cc:3032] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 1 LEADER]: Stepping down as leader of term 1
I20260807 18:15:29.044890 12372 raft_consensus.cc:729] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Running, Role: LEADER
I20260807 18:15:29.045946 12372 consensus_queue.cc:260] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:15:29.047621 12372 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:15:29.082082 11253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
/tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.253.70:0
--local_ip_for_outbound_sockets=127.10.253.70
--webserver_interface=127.10.253.70
--webserver_port=0
--tserver_master_addrs=127.10.253.126:46329
--builtin_ntp_servers=127.10.253.84:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
I20260807 18:15:29.112764 11883 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 18:15:29.115294 12370 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:15:29.122570 12246 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 18:15:29.124761 12460 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:15:29.125200 11684 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P b5bb27271da74b1a909d982e6fb2d470 [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 18:15:29.127890 12424 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:15:29.133301 11510 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260807 18:15:29.133491 11510 pending_rounds.cc:76] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Aborting all ops after (but not including) 0
I20260807 18:15:29.133574 11510 pending_rounds.cc:97] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260807 18:15:29.133778 11510 raft_consensus.cc:2866] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 18:15:29.134874 12370 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 18:15:29.615325 11977 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 52417.6us
W20260807 18:15:29.622857 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.67:33793, user_credentials={real_user=slave}} blocked reactor thread for 56469.2us
W20260807 18:15:29.965651 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.69:45839, user_credentials={real_user=slave}} blocked reactor thread for 60158.2us
W20260807 18:15:29.973588 11977 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.65:37131, user_credentials={real_user=slave}} blocked reactor thread for 60927.4us
W20260807 18:15:30.332811 12327 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.10.253.68:43889, user_credentials={real_user=slave}} blocked reactor thread for 45893.7us
W20260807 18:15:30.436415 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.67:33793, user_credentials={real_user=slave}} blocked reactor thread for 52485us
W20260807 18:15:30.852308 12489 meta_cache.cc:1261] Time spent looking up entry by key: real 0.057s user 0.000s sys 0.000s
W20260807 18:15:31.064353 11977 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.65:37131, user_credentials={real_user=slave}} blocked reactor thread for 51078us
W20260807 18:15:31.219660 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.67:33793, user_credentials={real_user=slave}} blocked reactor thread for 63327us
W20260807 18:15:31.827818 12492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:15:31.828454 12492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:15:31.828720 12492 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260807 18:15:31.828920 12492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:15:31.841835 12492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:15:31.842098 12492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.253.70
I20260807 18:15:31.866458 12492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.253.84:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.253.70:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/data/info.pb
--webserver_interface=127.10.253.70
--webserver_port=0
--enable_log_gc=false
--tserver_master_addrs=127.10.253.126:46329
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.253.70
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
I20260807 18:15:31.869442 12492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:15:31.873781 12492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:15:32.059721 12568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:32.083773 12566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:15:32.125370 12564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:15:32.166388 12492 server_base.cc:1034] running on GCE node
I20260807 18:15:32.168064 12492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:15:32.192247 12492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:15:32.212428 12492 hybrid_clock.cc:648] HybridClock initialized: now 1786126532205238 us; error 7028 us; skew 500 ppm
I20260807 18:15:32.213321 12492 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 18:15:32.333796 12492 webserver.cc:460] Webserver started at http://127.10.253.70:39229/ using document root <none> and password file <none>
I20260807 18:15:32.336102 12492 fs_manager.cc:359] Metadata directory not provided
I20260807 18:15:32.336596 12492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:15:32.343138 12492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:15:32.369184 12492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/data/instance:
uuid: "14597aeb31024f3bacbdbb6a99a2800d"
format_stamp: "Formatted at 2026-08-07 18:15:32 on dist-test-slave-h6n0"
I20260807 18:15:32.371882 12492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/wal/instance:
uuid: "14597aeb31024f3bacbdbb6a99a2800d"
format_stamp: "Formatted at 2026-08-07 18:15:32 on dist-test-slave-h6n0"
I20260807 18:15:32.411654 12492 fs_manager.cc:691] Time spent creating directory manager: real 0.038s user 0.026s sys 0.009s
I20260807 18:15:32.509024 12579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:32.512708 12492 fs_manager.cc:725] Time spent opening block manager: real 0.096s user 0.027s sys 0.054s
I20260807 18:15:32.513080 12492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/data,/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/wal
uuid: "14597aeb31024f3bacbdbb6a99a2800d"
format_stamp: "Formatted at 2026-08-07 18:15:32 on dist-test-slave-h6n0"
I20260807 18:15:32.513717 12492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/wal
metadata directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/wal
1 data directories: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:15:32.778287 12492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:15:32.787621 12492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:15:32.789038 12492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:15:32.829943 12492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:15:32.874469 12492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:15:32.874941 12492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 18:15:32.875301 12492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:15:32.875555 12492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:15:33.339331 12599 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:15:33.339955 12599 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:15:33.347504 12599 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:15:33.348462 11508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 104 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:15:33.349900 11688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 104 } } ignore_live_leader: false dest_uuid: "b5bb27271da74b1a909d982e6fb2d470" is_pre_election: true
I20260807 18:15:33.351861 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 104 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:15:33.356678 12160 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca; no voters: 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:15:33.357365 12599 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:15:33.420315 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 104 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:15:33.966069 12327 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.10.253.68:43889, user_credentials={real_user=slave}} blocked reactor thread for 57037.9us
W20260807 18:15:35.450662 12489 meta_cache.cc:1261] Time spent looking up entry by key: real 0.052s user 0.000s sys 0.000s
W20260807 18:15:35.661772 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.67:33793, user_credentials={real_user=slave}} blocked reactor thread for 49385.4us
I20260807 18:15:36.655414 12492 rpc_server.cc:307] RPC server started. Bound to: 127.10.253.70:40077
I20260807 18:15:36.655498 12751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.253.70:40077 every 8 connection(s)
I20260807 18:15:36.668186 12492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/data/info.pb
I20260807 18:15:36.674971 11253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu as pid 12492
I20260807 18:15:36.675477 11253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-5/wal/instance
I20260807 18:15:36.857352 12752 heartbeater.cc:347] Connected to a master server at 127.10.253.126:46329
I20260807 18:15:36.858014 12752 heartbeater.cc:464] Registering TS with master...
I20260807 18:15:36.859990 12752 heartbeater.cc:511] Master 127.10.253.126:46329 requested a full tablet report, sending...
I20260807 18:15:36.864490 11293 ts_manager.cc:194] Registered new tserver with Master: 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077)
I20260807 18:15:36.867292 11293 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.253.70:38821
W20260807 18:15:37.112357 11977 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 142172us
I20260807 18:15:37.873502 12752 heartbeater.cc:503] Master 127.10.253.126:46329 was elected leader, sending a full tablet report...
I20260807 18:15:37.958336 11293 ts_manager.cc:292] Set tserver state for 50da72adf57546f5bab0a028672a51dd to MAINTENANCE_MODE
I20260807 18:15:37.960017 11253 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu pid 11391
I20260807 18:15:37.979727 11566 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:15:38.488531 11253 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu with pid 11391
W20260807 18:15:38.636291 11282 connection.cc:535] server connection from 127.10.253.65:55511 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 18:15:38.636806 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.253.65:37131 (error 108) [suppressed 3 similar messages]
W20260807 18:15:38.698846 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:38.699536 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:38.701241 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:39.229921 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:39.232260 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:39.232517 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:39.735312 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:39.746079 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:39.778198 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:15:39.985368 12713 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.003s)
W20260807 18:15:40.260592 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:40.295101 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:40.347833 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 18:15:40.437553 12811 consensus_queue.cc:579] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.054s)
I20260807 18:15:40.469385 12555 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.087s)
W20260807 18:15:40.781209 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:40.811291 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:40.894230 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:41.302203 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:41.312676 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:41.383291 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:41.828586 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:41.880780 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:41.979420 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:42.427438 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:42.432689 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260807 18:15:42.500345 11253 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu pid 11576
I20260807 18:15:42.502151 11753 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 18:15:42.532550 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260807 18:15:42.911541 11253 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu with pid 11576
W20260807 18:15:42.944890 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:43.006225 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:43.056983 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:43.088508 11977 connection.cc:535] client connection to 127.10.253.66:43559 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 18:15:43.090787 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:43.091054 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:43.091224 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:43.497309 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260807 18:15:43.553756 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:43.580019 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260807 18:15:43.625918 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:43.649426 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111) [suppressed 154 similar messages]
W20260807 18:15:43.659112 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260807 18:15:43.659685 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:44.035579 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260807 18:15:44.039533 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:44.133947 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:44.173506 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260807 18:15:44.184072 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:44.207629 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260807 18:15:44.552275 12797 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.027s)
I20260807 18:15:44.560806 12073 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 513, Committed index: 513, Last appended: 1.514, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
W20260807 18:15:44.578217 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:44.578740 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:15:44.586727 12833 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.062s)
I20260807 18:15:44.591246 12246 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 513. Preceding OpId from leader: term: 1 index: 516. (index mismatch)
I20260807 18:15:44.596530 12824 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 515, Last known committed idx: 513, Time since last communication: 0.000s
I20260807 18:15:44.600229 12815 consensus_queue.cc:579] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.075s)
I20260807 18:15:44.603055 11881 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 514. Preceding OpId from leader: term: 1 index: 516. (index mismatch)
I20260807 18:15:44.615478 12073 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 513, Committed index: 513, Last appended: 1.517, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:15:44.623529 12074 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 515, Committed index: 515, Last appended: 2.517, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:15:44.625653 12713 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 515, Last known committed idx: 513, Time since last communication: 0.001s
I20260807 18:15:44.627143 12245 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 516. Preceding OpId from leader: term: 1 index: 518. (index mismatch)
W20260807 18:15:44.629606 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 644a01df651c43d4a74ac241ea43068c. This is attempt 1: this message will repeat every 5th retry.
I20260807 18:15:44.629789 11880 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 515. Preceding OpId from leader: term: 1 index: 518. (index mismatch)
W20260807 18:15:44.630218 11975 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c7eca40645d4ee29079ced64fa54d37. This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:44.630719 11975 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 874ba119c7284c4d8a113d6654e0c39e. This is attempt 1: this message will repeat every 5th retry.
I20260807 18:15:44.631001 12833 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 518, Last known committed idx: 513, Time since last communication: 0.000s
W20260807 18:15:44.632289 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:44.633054 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:15:44.634799 11881 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 516. Preceding OpId from leader: term: 2 index: 518. (index mismatch)
W20260807 18:15:44.635028 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:44.635350 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:15:44.635552 12246 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 516. Preceding OpId from leader: term: 2 index: 518. (index mismatch)
I20260807 18:15:44.636080 12833 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 518, Last known committed idx: 513, Time since last communication: 0.000s
I20260807 18:15:44.636569 12822 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 518, Last known committed idx: 513, Time since last communication: 0.000s
I20260807 18:15:44.637447 12824 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.515: config changed from index -1 to 515, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:15:44.650103 12833 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 518, Last known committed idx: 515, Time since last communication: 0.000s
I20260807 18:15:44.652240 11881 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.515: config changed from index -1 to 515, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:15:44.656358 11281 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 644a01df651c43d4a74ac241ea43068c with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260807 18:15:44.658160 11291 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index -1 to 515, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 18:15:44.670696 12245 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.515: config changed from index -1 to 515, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:15:44.677729 12808 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.518: config changed from index -1 to 518, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:15:44.695930 12246 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.518: config changed from index -1 to 518, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:15:44.696779 11281 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 4c7eca40645d4ee29079ced64fa54d37 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260807 18:15:44.694999 12822 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 LEADER]: Committing config change with OpId 2.518: config changed from index -1 to 518, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:15:44.704280 11880 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.518: config changed from index -1 to 518, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:15:44.716733 12247 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Committing config change with OpId 2.518: config changed from index -1 to 518, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:15:44.719506 11281 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 874ba119c7284c4d8a113d6654e0c39e with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260807 18:15:44.720685 11883 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Committing config change with OpId 2.518: config changed from index -1 to 518, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:15:44.724802 12840 ts_tablet_manager.cc:927] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d: Initiating tablet copy from peer 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889)
I20260807 18:15:44.761910 12854 ts_tablet_manager.cc:927] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: Initiating tablet copy from peer 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889)
I20260807 18:15:44.764830 11293 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca reported cstate change: config changed from index -1 to 518, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:15:44.763500 12853 ts_tablet_manager.cc:927] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: Initiating tablet copy from peer 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889)
I20260807 18:15:44.776037 11291 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index -1 to 518, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New cstate: current_term: 2 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 18:15:44.773627 12840 tablet_copy_client.cc:316] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.253.68:43889
I20260807 18:15:44.797756 12854 tablet_copy_client.cc:316] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.253.68:43889
I20260807 18:15:44.810798 12853 tablet_copy_client.cc:316] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.253.68:43889
I20260807 18:15:44.843008 12102 tablet_copy_service.cc:140] P 22052958d03d426ebdc2fc310637c846: Received BeginTabletCopySession request for tablet 4c7eca40645d4ee29079ced64fa54d37 from peer 14597aeb31024f3bacbdbb6a99a2800d ({username='slave'} at 127.10.253.70:35401)
I20260807 18:15:44.843477 12102 tablet_copy_service.cc:161] P 22052958d03d426ebdc2fc310637c846: Beginning new tablet copy session on tablet 4c7eca40645d4ee29079ced64fa54d37 from peer 14597aeb31024f3bacbdbb6a99a2800d at {username='slave'} at 127.10.253.70:35401: session id = 14597aeb31024f3bacbdbb6a99a2800d-4c7eca40645d4ee29079ced64fa54d37
I20260807 18:15:44.843706 12103 tablet_copy_service.cc:140] P 22052958d03d426ebdc2fc310637c846: Received BeginTabletCopySession request for tablet 644a01df651c43d4a74ac241ea43068c from peer 14597aeb31024f3bacbdbb6a99a2800d ({username='slave'} at 127.10.253.70:35401)
I20260807 18:15:44.844158 12100 tablet_copy_service.cc:140] P 22052958d03d426ebdc2fc310637c846: Received BeginTabletCopySession request for tablet 874ba119c7284c4d8a113d6654e0c39e from peer 14597aeb31024f3bacbdbb6a99a2800d ({username='slave'} at 127.10.253.70:35401)
I20260807 18:15:44.844364 12100 tablet_copy_service.cc:161] P 22052958d03d426ebdc2fc310637c846: Beginning new tablet copy session on tablet 874ba119c7284c4d8a113d6654e0c39e from peer 14597aeb31024f3bacbdbb6a99a2800d at {username='slave'} at 127.10.253.70:35401: session id = 14597aeb31024f3bacbdbb6a99a2800d-874ba119c7284c4d8a113d6654e0c39e
I20260807 18:15:44.849360 12102 tablet_copy_source_session.cc:205] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 18:15:44.849778 12103 tablet_copy_service.cc:161] P 22052958d03d426ebdc2fc310637c846: Beginning new tablet copy session on tablet 644a01df651c43d4a74ac241ea43068c from peer 14597aeb31024f3bacbdbb6a99a2800d at {username='slave'} at 127.10.253.70:35401: session id = 14597aeb31024f3bacbdbb6a99a2800d-644a01df651c43d4a74ac241ea43068c
I20260807 18:15:44.858191 12854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7eca40645d4ee29079ced64fa54d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:44.863953 12100 tablet_copy_source_session.cc:205] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 18:15:44.878500 12854 tablet_copy_client.cc:791] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Starting download of 0 data blocks...
I20260807 18:15:44.878784 12103 tablet_copy_source_session.cc:205] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 18:15:44.879534 12854 tablet_copy_client.cc:655] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Starting download of 1 WAL segments...
I20260807 18:15:44.904978 12853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 874ba119c7284c4d8a113d6654e0c39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:44.916709 12853 tablet_copy_client.cc:791] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Starting download of 0 data blocks...
I20260807 18:15:44.917169 12853 tablet_copy_client.cc:655] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Starting download of 1 WAL segments...
I20260807 18:15:44.925447 12840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 644a01df651c43d4a74ac241ea43068c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:15:44.961889 12854 tablet_copy_client.cc:531] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 18:15:44.993768 12840 tablet_copy_client.cc:791] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Starting download of 0 data blocks...
I20260807 18:15:44.994550 12853 tablet_copy_client.cc:531] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 18:15:45.012018 12840 tablet_copy_client.cc:655] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Starting download of 1 WAL segments...
I20260807 18:15:45.030445 12854 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap starting.
I20260807 18:15:45.031875 12853 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap starting.
W20260807 18:15:45.060482 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:15:45.080442 12840 tablet_copy_client.cc:531] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 18:15:45.086213 12840 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap starting.
W20260807 18:15:45.151418 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:45.192943 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:45.222357 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:45.222880 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:45.224749 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:45.303340 11975 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:45.510103 11975 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:45.510488 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260807 18:15:45.593206 12854 log.cc:824] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: Log is configured to *not* fsync() on all Append() calls
W20260807 18:15:45.646978 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:45.710161 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:45.729677 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:45.745123 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:45.761566 11975 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:45.830226 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:45.895419 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:45.989886 11975 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:45.996708 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:46.089941 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:46.220834 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:46.248250 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:46.281652 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:46.294134 11975 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:46.351848 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:46.489903 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:46.536550 11975 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260807 18:15:46.575644 12713 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.011s)
I20260807 18:15:46.591864 12713 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.025s)
W20260807 18:15:46.623669 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260807 18:15:46.634567 12796 consensus_queue.cc:579] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.000s)
W20260807 18:15:46.655333 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 18:15:46.695421 12797 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.079s)
I20260807 18:15:46.772541 12796 consensus_queue.cc:579] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.148s)
I20260807 18:15:46.779479 12808 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.162s)
W20260807 18:15:46.864003 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:46.880934 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:46.909984 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:46.912482 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:46.968638 11975 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:47.062495 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:47.129853 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:47.156322 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:47.198722 11975 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:47.364037 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:47.420017 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:47.471405 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:47.508975 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:47.555094 11975 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:47.681456 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:47.681506 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:47.861353 11975 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:47.954375 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:48.056859 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:48.116429 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:48.203275 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:48.217938 11975 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:48.256655 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:48.479657 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:48.480791 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:48.533326 11975 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:48.549036 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:48.665611 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111) [suppressed 259 similar messages]
W20260807 18:15:48.701251 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:48.735380 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:48.807700 11975 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:48.892057 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:48.941862 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:49.052063 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:49.067561 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:49.094645 11975 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:49.238370 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:49.285037 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.69:45839, user_credentials={real_user=slave}} blocked reactor thread for 44822.9us
W20260807 18:15:49.290346 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:49.341135 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:49.396440 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:49.487787 11975 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:49.653699 11975 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:49.687609 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:49.688508 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260807 18:15:49.956782 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:49.979213 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260807 18:15:49.979583 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260807 18:15:49.994732 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:50.126655 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260807 18:15:50.203279 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260807 18:15:50.220147 11975 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 46: this message will repeat every 5th retry.
W20260807 18:15:50.375941 11975 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 46: this message will repeat every 5th retry.
W20260807 18:15:50.500083 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260807 18:15:50.505528 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260807 18:15:50.516829 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260807 18:15:50.517125 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260807 18:15:50.672557 12854 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap replaying log segment 1/1 (413.9K/440.8K this segment, stats: ops{read=489 overwritten=0 applied=485 ignored=0} inserts{seen=8003 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20260807 18:15:50.688591 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 46: this message will repeat every 5th retry.
I20260807 18:15:50.684186 12853 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap replaying log segment 1/1 (377.6K/445.7K this segment, stats: ops{read=443 overwritten=0 applied=442 ignored=0} inserts{seen=7374 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20260807 18:15:50.749583 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260807 18:15:50.787533 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260807 18:15:50.882054 11975 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 51: this message will repeat every 5th retry.
W20260807 18:15:50.984786 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260807 18:15:51.045929 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260807 18:15:51.070418 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260807 18:15:51.077143 12840 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap replaying log segment 1/1 (323.4K/444.3K this segment, stats: ops{read=381 overwritten=0 applied=377 ignored=0} inserts{seen=6258 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20260807 18:15:51.117470 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260807 18:15:51.344022 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260807 18:15:51.414098 12854 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap replayed 1/1 log segments. Stats: ops{read=522 overwritten=0 applied=520 ignored=0} inserts{seen=8534 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260807 18:15:51.415361 12854 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap complete.
I20260807 18:15:51.416280 12854 ts_tablet_manager.cc:1397] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: Time spent bootstrapping tablet: real 6.386s user 1.618s sys 0.380s
I20260807 18:15:51.439006 12854 raft_consensus.cc:348] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 LEARNER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
W20260807 18:15:51.445361 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260807 18:15:51.490185 11975 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 51: this message will repeat every 5th retry.
I20260807 18:15:51.536357 12854 raft_consensus.cc:729] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 14597aeb31024f3bacbdbb6a99a2800d, State: Initialized, Role: LEARNER
W20260807 18:15:51.556087 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260807 18:15:51.549598 12854 consensus_queue.cc:260] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 520, Last appended: 1.522, Last appended by leader: 522, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:15:51.585297 12854 ts_tablet_manager.cc:1428] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d: Time spent starting tablet: real 0.164s user 0.048s sys 0.042s
I20260807 18:15:51.609234 12103 tablet_copy_service.cc:342] P 22052958d03d426ebdc2fc310637c846: Request end of tablet copy session 14597aeb31024f3bacbdbb6a99a2800d-4c7eca40645d4ee29079ced64fa54d37 received from {username='slave'} at 127.10.253.70:35401
I20260807 18:15:51.611552 12103 tablet_copy_service.cc:433] P 22052958d03d426ebdc2fc310637c846: ending tablet copy session 14597aeb31024f3bacbdbb6a99a2800d-4c7eca40645d4ee29079ced64fa54d37 on tablet 4c7eca40645d4ee29079ced64fa54d37 with peer 14597aeb31024f3bacbdbb6a99a2800d
W20260807 18:15:51.618260 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260807 18:15:51.688580 12674 raft_consensus.cc:1203] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.517->[1.518-1.703] Dedup: 1.522->[1.523-1.703]
W20260807 18:15:51.759192 12756 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
W20260807 18:15:51.875980 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260807 18:15:51.964094 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 51: this message will repeat every 5th retry.
W20260807 18:15:52.087671 12853 log.cc:924] Time spent T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: Append to log took a long time: real 0.103s user 0.001s sys 0.000s
W20260807 18:15:52.160574 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260807 18:15:52.196640 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260807 18:15:52.202668 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260807 18:15:52.399509 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260807 18:15:52.469722 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260807 18:15:52.481791 12853 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap replayed 1/1 log segments. Stats: ops{read=522 overwritten=0 applied=520 ignored=0} inserts{seen=8713 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260807 18:15:52.487151 12853 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap complete.
I20260807 18:15:52.488107 12853 ts_tablet_manager.cc:1397] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: Time spent bootstrapping tablet: real 7.456s user 1.713s sys 0.315s
I20260807 18:15:52.489480 12853 raft_consensus.cc:348] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 LEARNER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:15:52.491082 12853 raft_consensus.cc:729] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 14597aeb31024f3bacbdbb6a99a2800d, State: Initialized, Role: LEARNER
I20260807 18:15:52.491427 12853 consensus_queue.cc:260] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 520, Last appended: 2.522, Last appended by leader: 522, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:15:52.555569 12853 ts_tablet_manager.cc:1428] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d: Time spent starting tablet: real 0.046s user 0.010s sys 0.005s
I20260807 18:15:52.563390 12103 tablet_copy_service.cc:342] P 22052958d03d426ebdc2fc310637c846: Request end of tablet copy session 14597aeb31024f3bacbdbb6a99a2800d-874ba119c7284c4d8a113d6654e0c39e received from {username='slave'} at 127.10.253.70:35401
I20260807 18:15:52.563696 12103 tablet_copy_service.cc:433] P 22052958d03d426ebdc2fc310637c846: ending tablet copy session 14597aeb31024f3bacbdbb6a99a2800d-874ba119c7284c4d8a113d6654e0c39e on tablet 874ba119c7284c4d8a113d6654e0c39e with peer 14597aeb31024f3bacbdbb6a99a2800d
W20260807 18:15:52.663143 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260807 18:15:52.698769 12833 raft_consensus.cc:1050] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846: attempting to promote NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d to VOTER
I20260807 18:15:52.720055 12833 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 727, Committed index: 727, Last appended: 1.728, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 729 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
I20260807 18:15:52.739662 12675 raft_consensus.cc:1203] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.517->[2.518-2.722] Dedup: 2.522->[2.523-2.722]
W20260807 18:15:52.744814 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:52.747248 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:52.747816 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260807 18:15:52.749576 11883 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 728. Preceding OpId from leader: term: 1 index: 730. (index mismatch)
I20260807 18:15:52.753393 12880 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 729, Last known committed idx: 727, Time since last communication: 0.000s
I20260807 18:15:52.761808 12674 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 LEARNER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 728. Preceding OpId from leader: term: 1 index: 730. (index mismatch)
I20260807 18:15:52.775558 12880 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 729, Last known committed idx: 727, Time since last communication: 0.000s
I20260807 18:15:52.781348 12245 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 727. Preceding OpId from leader: term: 1 index: 730. (index mismatch)
I20260807 18:15:52.782508 12862 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 729, Last known committed idx: 726, Time since last communication: 0.001s
W20260807 18:15:52.847569 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260807 18:15:52.855628 12833 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.729: config changed from index 518 to 729, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 729 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:52.860152 12674 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.729: config changed from index 518 to 729, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 729 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:52.874801 12245 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.729: config changed from index 518 to 729, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 729 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:52.879473 11880 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.729: config changed from index 518 to 729, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 729 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:52.907492 11293 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 518 to 729, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 729 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260807 18:15:52.941655 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260807 18:15:52.983788 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260807 18:15:53.268957 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:53.301028 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:53.307130 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.67:33793, user_credentials={real_user=slave}} blocked reactor thread for 54500.8us
W20260807 18:15:53.340766 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 56: this message will repeat every 5th retry.
W20260807 18:15:53.403225 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260807 18:15:53.450042 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260807 18:15:53.551056 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260807 18:15:53.636264 12822 raft_consensus.cc:1050] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846: attempting to promote NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d to VOTER
I20260807 18:15:53.638309 12822 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 750, Committed index: 750, Last appended: 2.750, Last appended by leader: 0, Current term: 2, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 751 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:15:53.668576 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111) [suppressed 234 similar messages]
I20260807 18:15:53.704079 11880 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 750. Preceding OpId from leader: term: 2 index: 751. (index mismatch)
I20260807 18:15:53.705680 12245 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 750. Preceding OpId from leader: term: 2 index: 751. (index mismatch)
I20260807 18:15:53.707371 12833 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 751, Last known committed idx: 750, Time since last communication: 0.000s
I20260807 18:15:53.707890 12869 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 751, Last known committed idx: 750, Time since last communication: 0.000s
W20260807 18:15:53.708735 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:53.708926 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:15:53.719626 12676 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 LEARNER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 750. Preceding OpId from leader: term: 2 index: 751. (index mismatch)
I20260807 18:15:53.722162 12814 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 751, Last known committed idx: 750, Time since last communication: 0.000s
I20260807 18:15:53.736577 12814 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 LEADER]: Committing config change with OpId 2.751: config changed from index 518 to 751, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 751 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:53.751219 12674 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Committing config change with OpId 2.751: config changed from index 518 to 751, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 751 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
W20260807 18:15:53.755884 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:15:53.767372 11880 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Committing config change with OpId 2.751: config changed from index 518 to 751, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 751 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:53.771454 11291 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 518 to 751, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 751 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260807 18:15:53.778259 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:15:53.783097 12249 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Committing config change with OpId 2.751: config changed from index 518 to 751, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 751 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
W20260807 18:15:53.968704 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260807 18:15:54.160112 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260807 18:15:54.272193 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:54.278489 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:54.278913 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:54.329644 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:54.497157 11975 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077): Couldn't send request to peer 14597aeb31024f3bacbdbb6a99a2800d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 61: this message will repeat every 5th retry.
W20260807 18:15:54.653087 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260807 18:15:54.669559 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260807 18:15:54.806890 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:54.873812 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:15:54.898962 12840 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap replayed 1/1 log segments. Stats: ops{read=522 overwritten=0 applied=522 ignored=0} inserts{seen=8689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:15:54.900288 12840 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d: Bootstrap complete.
W20260807 18:15:54.900717 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:15:54.900859 12840 ts_tablet_manager.cc:1397] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d: Time spent bootstrapping tablet: real 9.815s user 1.723s sys 0.345s
I20260807 18:15:54.904085 12840 raft_consensus.cc:348] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:15:54.905426 12840 raft_consensus.cc:729] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 14597aeb31024f3bacbdbb6a99a2800d, State: Initialized, Role: LEARNER
I20260807 18:15:54.905984 12840 consensus_queue.cc:260] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 522, Last appended: 1.522, Last appended by leader: 522, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:15:54.908540 12713 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.174s)
I20260807 18:15:54.912415 12824 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.178s)
I20260807 18:15:54.923692 12840 ts_tablet_manager.cc:1428] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d: Time spent starting tablet: real 0.023s user 0.004s sys 0.007s
I20260807 18:15:54.952637 12103 tablet_copy_service.cc:342] P 22052958d03d426ebdc2fc310637c846: Request end of tablet copy session 14597aeb31024f3bacbdbb6a99a2800d-644a01df651c43d4a74ac241ea43068c received from {username='slave'} at 127.10.253.70:35401
I20260807 18:15:54.952826 12103 tablet_copy_service.cc:433] P 22052958d03d426ebdc2fc310637c846: ending tablet copy session 14597aeb31024f3bacbdbb6a99a2800d-644a01df651c43d4a74ac241ea43068c on tablet 644a01df651c43d4a74ac241ea43068c with peer 14597aeb31024f3bacbdbb6a99a2800d
W20260807 18:15:54.937785 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 18:15:54.958633 12074 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 783, Committed index: 783, Last appended: 1.786, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 787 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
I20260807 18:15:54.969237 12249 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 786. Preceding OpId from leader: term: 1 index: 787. (index mismatch)
I20260807 18:15:54.969656 12675 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 786. Preceding OpId from leader: term: 1 index: 787. (index mismatch)
I20260807 18:15:54.970031 11880 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 784. Preceding OpId from leader: term: 1 index: 787. (index mismatch)
I20260807 18:15:54.972054 12797 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 787, Last known committed idx: 783, Time since last communication: 0.000s
I20260807 18:15:54.973127 12797 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 787, Last known committed idx: 783, Time since last communication: 0.000s
I20260807 18:15:54.973500 12814 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 787, Last known committed idx: 783, Time since last communication: 0.000s
W20260807 18:15:54.977758 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:15:55.000658 12675 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.787: config changed from index 729 to 787, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 787 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:55.002110 12862 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.787: config changed from index 729 to 787, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 787 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:55.016443 11298 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d reported cstate change: config changed from index 729 to 787, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 787 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:55.019644 11281 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 4c7eca40645d4ee29079ced64fa54d37 with cas_config_opid_index 729: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 18:15:55.030887 11884 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.787: config changed from index 729 to 787, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 787 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:55.043668 12249 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.787: config changed from index 729 to 787, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 787 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:55.175958 12674 raft_consensus.cc:1203] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.514->[1.515-1.784] Dedup: 1.522->[1.523-1.784]
W20260807 18:15:55.322258 11285 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:15:55.349105 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260807 18:15:55.372550 11285 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.253.65:37131, user_credentials={real_user=slave}} blocked reactor thread for 50329us
W20260807 18:15:55.395453 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260807 18:15:55.401932 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:55.402781 11285 catalog_manager.cc:4584] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4c7eca40645d4ee29079ced64fa54d37: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:15:55.411859 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:55.464263 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:15:55.744478 12713 consensus_queue.cc:579] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.050s)
I20260807 18:15:55.750077 12946 consensus_queue.cc:579] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.055s)
I20260807 18:15:55.760483 12074 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 808, Committed index: 808, Last appended: 2.808, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 809 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
I20260807 18:15:55.778390 12676 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 808. Preceding OpId from leader: term: 2 index: 810. (index mismatch)
I20260807 18:15:55.779385 12924 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 809, Last known committed idx: 808, Time since last communication: 0.000s
W20260807 18:15:55.786973 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:15:55.789490 11884 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 808. Preceding OpId from leader: term: 2 index: 810. (index mismatch)
I20260807 18:15:55.791221 12245 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 808. Preceding OpId from leader: term: 2 index: 810. (index mismatch)
I20260807 18:15:55.799256 12869 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 809, Last known committed idx: 808, Time since last communication: 0.000s
I20260807 18:15:55.801787 12946 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 809, Last known committed idx: 808, Time since last communication: 0.000s
I20260807 18:15:55.825069 12824 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 LEADER]: Committing config change with OpId 2.809: config changed from index 751 to 809, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 809 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:55.828776 11884 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Committing config change with OpId 2.809: config changed from index 751 to 809, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 809 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:55.830785 11281 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 874ba119c7284c4d8a113d6654e0c39e with cas_config_opid_index 751: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 18:15:55.832554 12675 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Committing config change with OpId 2.809: config changed from index 751 to 809, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 809 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:55.844086 11291 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 751 to 809, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New cstate: current_term: 2 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 809 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 18:15:55.860533 12249 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Committing config change with OpId 2.809: config changed from index 751 to 809, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 809 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
W20260807 18:15:55.958750 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260807 18:15:56.019904 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:15:56.043768 12555 raft_consensus.cc:1050] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846: attempting to promote NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d to VOTER
I20260807 18:15:56.046628 12555 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 814, Committed index: 814, Last appended: 1.815, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
I20260807 18:15:56.076072 12674 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 LEARNER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 815. Preceding OpId from leader: term: 1 index: 816. (index mismatch)
I20260807 18:15:56.078049 11884 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 815. Preceding OpId from leader: term: 1 index: 816. (index mismatch)
I20260807 18:15:56.079777 12246 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 815. Preceding OpId from leader: term: 1 index: 816. (index mismatch)
I20260807 18:15:56.087957 12797 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 816, Last known committed idx: 814, Time since last communication: 0.000s
I20260807 18:15:56.089053 12952 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 816, Last known committed idx: 814, Time since last communication: 0.000s
I20260807 18:15:56.092521 12870 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 816, Last known committed idx: 814, Time since last communication: 0.000s
W20260807 18:15:56.113072 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:15:56.115919 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:15:56.162374 12713 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.816: config changed from index 515 to 816, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:56.163756 12245 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.816: config changed from index 515 to 816, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:56.178761 11297 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca reported cstate change: config changed from index 515 to 816, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:56.194885 11880 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.816: config changed from index 515 to 816, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:56.203415 12674 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.816: config changed from index 515 to 816, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
W20260807 18:15:56.348006 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:56.428119 11285 catalog_manager.cc:4584] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 874ba119c7284c4d8a113d6654e0c39e: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:15:56.548242 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:56.603433 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:56.657511 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:15:56.961580 12713 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.002s)
W20260807 18:15:56.973399 11298 catalog_manager.cc:5173] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 4c7eca40645d4ee29079ced64fa54d37 with cas_config_opid_index 787: no extra replica candidate found for tablet 4c7eca40645d4ee29079ced64fa54d37 (table test-workload [id=8bd0c38a73b949c3a98e549c83519895]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy
W20260807 18:15:56.996922 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:57.088624 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:57.171868 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:15:57.248486 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:57.558722 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:57.598479 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:57.671268 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:57.709486 11285 catalog_manager.cc:4584] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4c7eca40645d4ee29079ced64fa54d37: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:15:57.806380 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 18:15:57.858685 12862 consensus_queue.cc:579] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.097s)
W20260807 18:15:58.102123 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 18:15:58.152032 12824 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.090s)
I20260807 18:15:58.171557 12814 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.108s)
I20260807 18:15:58.173539 12074 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 891, Committed index: 891, Last appended: 1.895, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
I20260807 18:15:58.180735 12673 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 893. Preceding OpId from leader: term: 1 index: 896. (index mismatch)
W20260807 18:15:58.181486 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:15:58.184430 12814 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 896, Last known committed idx: 891, Time since last communication: 0.000s
I20260807 18:15:58.194715 11880 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 893. Preceding OpId from leader: term: 1 index: 896. (index mismatch)
I20260807 18:15:58.194816 12246 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 895. Preceding OpId from leader: term: 1 index: 896. (index mismatch)
I20260807 18:15:58.196527 12924 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 896, Last known committed idx: 891, Time since last communication: 0.000s
I20260807 18:15:58.196967 12862 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 896, Last known committed idx: 891, Time since last communication: 0.000s
I20260807 18:15:58.220574 12990 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.896: config changed from index 816 to 896, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:58.237843 12249 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.896: config changed from index 816 to 896, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:58.248342 11281 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 644a01df651c43d4a74ac241ea43068c with cas_config_opid_index 816: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 18:15:58.249524 11884 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.896: config changed from index 816 to 896, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:58.257782 12675 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.896: config changed from index 816 to 896, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:15:58.265970 11298 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 816 to 896, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260807 18:15:58.284674 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:58.608165 11285 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.253.65:37131, user_credentials={real_user=slave}} blocked reactor thread for 207715us
W20260807 18:15:58.638826 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:15:58.694409 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 206 similar messages]
W20260807 18:15:58.696118 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:15:58.761508 11285 catalog_manager.cc:4584] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 644a01df651c43d4a74ac241ea43068c: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:15:58.827559 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:59.151081 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:15:59.202646 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:15:59.495332 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:15:59.744643 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:15:59.800910 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260807 18:15:59.818504 11285 catalog_manager.cc:4584] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4c7eca40645d4ee29079ced64fa54d37: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:15:59.993989 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260807 18:16:00.176894 12797 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.002s)
W20260807 18:16:00.259565 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:16:00.436863 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:16:00.540009 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260807 18:16:00.776099 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260807 18:16:00.814036 11291 ts_manager.cc:281] Unset tserver state for 50da72adf57546f5bab0a028672a51dd from MAINTENANCE_MODE
I20260807 18:16:00.816236 11253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
/tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.253.65:37131
--local_ip_for_outbound_sockets=127.10.253.65
--tserver_master_addrs=127.10.253.126:46329
--webserver_port=44985
--webserver_interface=127.10.253.65
--builtin_ntp_servers=127.10.253.84:36511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=2
--enable_log_gc=false with env {}
W20260807 18:16:00.819257 11285 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111) [suppressed 23 similar messages]
W20260807 18:16:00.829948 11285 catalog_manager.cc:4584] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 874ba119c7284c4d8a113d6654e0c39e: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
I20260807 18:16:00.847635 12074 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 996, Committed index: 996, Last appended: 1.997, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
I20260807 18:16:00.858850 11880 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 997. Preceding OpId from leader: term: 1 index: 998. (index mismatch)
I20260807 18:16:00.858978 12673 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 997. Preceding OpId from leader: term: 1 index: 998. (index mismatch)
I20260807 18:16:00.864179 13016 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 998, Last known committed idx: 997, Time since last communication: 0.000s
I20260807 18:16:00.865471 12249 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 997. Preceding OpId from leader: term: 1 index: 998. (index mismatch)
I20260807 18:16:00.865975 13016 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 998, Last known committed idx: 997, Time since last communication: 0.000s
I20260807 18:16:00.867388 13016 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 998, Last known committed idx: 997, Time since last communication: 0.000s
I20260807 18:16:00.873706 12824 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.998: config changed from index 896 to 998, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
W20260807 18:16:00.875227 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:00.875550 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:00.876861 11880 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.998: config changed from index 896 to 998, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:00.880074 11281 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 644a01df651c43d4a74ac241ea43068c with cas_config_opid_index 896: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 6)
I20260807 18:16:00.881079 12673 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.998: config changed from index 896 to 998, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:00.894430 12249 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.998: config changed from index 896 to 998, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:00.895264 11291 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 896 to 998, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:00.901386 12133 heartbeater.cc:511] Master 127.10.253.126:46329 requested a full tablet report, sending...
I20260807 18:16:00.907616 11945 heartbeater.cc:511] Master 127.10.253.126:46329 requested a full tablet report, sending...
I20260807 18:16:00.919360 12312 heartbeater.cc:511] Master 127.10.253.126:46329 requested a full tablet report, sending...
I20260807 18:16:00.981254 12752 heartbeater.cc:511] Master 127.10.253.126:46329 requested a full tablet report, sending...
W20260807 18:16:01.063010 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260807 18:16:01.087532 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260807 18:16:01.228334 12074 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1006, Committed index: 1006, Last appended: 1.1007, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1008 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
W20260807 18:16:01.236760 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:01.238329 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:01.241953 11884 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1007. Preceding OpId from leader: term: 1 index: 1008. (index mismatch)
I20260807 18:16:01.242947 12555 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1008, Last known committed idx: 1006, Time since last communication: 0.000s
I20260807 18:16:01.251149 12674 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1007. Preceding OpId from leader: term: 1 index: 1008. (index mismatch)
I20260807 18:16:01.256153 12824 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1008, Last known committed idx: 1006, Time since last communication: 0.000s
I20260807 18:16:01.258839 12249 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1007. Preceding OpId from leader: term: 1 index: 1008. (index mismatch)
I20260807 18:16:01.259806 13043 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1008, Last known committed idx: 1006, Time since last communication: 0.001s
I20260807 18:16:01.270903 12555 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1008: config changed from index 787 to 1008, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1008 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:01.280988 11281 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 4c7eca40645d4ee29079ced64fa54d37 with cas_config_opid_index 787: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 9)
I20260807 18:16:01.282169 12675 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1008: config changed from index 787 to 1008, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1008 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:01.282936 12247 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1008: config changed from index 787 to 1008, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1008 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:01.290329 11880 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1008: config changed from index 787 to 1008, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1008 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:01.296592 11291 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 787 to 1008, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1008 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260807 18:16:01.439338 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:01.494946 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:01.684343 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260807 18:16:01.751653 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:01.792073 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:02.034749 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:16:02.181237 12074 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1036, Committed index: 1036, Last appended: 2.1039, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1040 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
W20260807 18:16:02.184253 11977 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 48555.7us
I20260807 18:16:02.199265 12247 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1036. Preceding OpId from leader: term: 2 index: 1041. (index mismatch)
I20260807 18:16:02.202672 13043 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1040, Last known committed idx: 1035, Time since last communication: 0.000s
I20260807 18:16:02.204751 12673 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1036. Preceding OpId from leader: term: 2 index: 1041. (index mismatch)
I20260807 18:16:02.206857 12797 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1040, Last known committed idx: 1036, Time since last communication: 0.000s
I20260807 18:16:02.210937 11881 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1037. Preceding OpId from leader: term: 2 index: 1041. (index mismatch)
I20260807 18:16:02.212815 12797 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1040, Last known committed idx: 1036, Time since last communication: 0.000s
W20260807 18:16:02.218604 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:02.219136 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:02.219724 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:02.244801 13016 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 LEADER]: Committing config change with OpId 2.1040: config changed from index 809 to 1040, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1040 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:02.251395 12673 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Committing config change with OpId 2.1040: config changed from index 809 to 1040, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1040 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:02.254660 11281 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 874ba119c7284c4d8a113d6654e0c39e with cas_config_opid_index 809: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 9)
I20260807 18:16:02.262763 12247 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Committing config change with OpId 2.1040: config changed from index 809 to 1040, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1040 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:02.275934 11291 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 809 to 1040, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New cstate: current_term: 2 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1040 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260807 18:16:02.284373 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:16:02.286566 11881 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Committing config change with OpId 2.1040: config changed from index 809 to 1040, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1040 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
W20260807 18:16:02.343214 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:02.696317 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:02.704047 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:02.729753 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:02.797433 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:02.826174 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:16:02.903597 12824 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.054s)
W20260807 18:16:02.946930 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 18:16:02.958446 13043 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.109s)
W20260807 18:16:03.026310 11285 catalog_manager.cc:4584] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 644a01df651c43d4a74ac241ea43068c: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
I20260807 18:16:03.087098 12074 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1065, Committed index: 1065, Last appended: 1.1065, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:03.098999 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:03.106139 12247 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1065. Preceding OpId from leader: term: 1 index: 1067. (index mismatch)
I20260807 18:16:03.111163 12674 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1065. Preceding OpId from leader: term: 1 index: 1066. (index mismatch)
I20260807 18:16:03.121589 11880 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1065. Preceding OpId from leader: term: 1 index: 1067. (index mismatch)
I20260807 18:16:03.125363 13061 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1066, Last known committed idx: 1065, Time since last communication: 0.000s
I20260807 18:16:03.139853 13061 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1066, Last known committed idx: 1063, Time since last communication: 0.000s
I20260807 18:16:03.151840 12824 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1066, Last known committed idx: 1065, Time since last communication: 0.000s
I20260807 18:16:03.165084 13061 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1066: config changed from index 998 to 1066, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:03.196477 11884 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1066: config changed from index 998 to 1066, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:03.205861 12673 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1066: config changed from index 998 to 1066, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:03.225138 11281 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 644a01df651c43d4a74ac241ea43068c with cas_config_opid_index 998: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260807 18:16:03.230032 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:16:03.243615 11293 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 reported cstate change: config changed from index 998 to 1066, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:03.243526 12247 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1066: config changed from index 998 to 1066, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:03.276299 13034 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.046s)
I20260807 18:16:03.315117 13016 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.086s)
I20260807 18:16:03.341439 12074 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1070, Committed index: 1070, Last appended: 1.1073, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1074 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
I20260807 18:16:03.346240 12674 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1073. Preceding OpId from leader: term: 1 index: 1074. (index mismatch)
I20260807 18:16:03.348131 12862 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1074, Last known committed idx: 1070, Time since last communication: 0.000s
W20260807 18:16:03.349987 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:03.350813 12249 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1073. Preceding OpId from leader: term: 1 index: 1074. (index mismatch)
I20260807 18:16:03.353215 12921 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1074, Last known committed idx: 1070, Time since last communication: 0.000s
W20260807 18:16:03.361645 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:16:03.365844 11884 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1073. Preceding OpId from leader: term: 1 index: 1074. (index mismatch)
I20260807 18:16:03.369797 12824 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1074, Last known committed idx: 1070, Time since last communication: 0.001s
I20260807 18:16:03.381549 13034 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1074: config changed from index 1008 to 1074, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1074 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:03.408706 11281 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 4c7eca40645d4ee29079ced64fa54d37 with cas_config_opid_index 1008: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 18:16:03.411294 11298 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1008 to 1074, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1074 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 18:16:03.410290 12673 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1074: config changed from index 1008 to 1074, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1074 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:03.424801 11884 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1074: config changed from index 1008 to 1074, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1074 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:03.432933 12246 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1074: config changed from index 1008 to 1074, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1074 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
W20260807 18:16:03.591787 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:03.694458 13042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:16:03.695245 13042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:16:03.695595 13042 flags.cc:425] Enabled unsafe flag: --enable_log_gc=false
W20260807 18:16:03.695873 13042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:16:03.698864 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 188 similar messages]
W20260807 18:16:03.717237 13042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:16:03.717638 13042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.253.65
I20260807 18:16:03.747251 13042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.253.84:36511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.253.65:37131
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.253.65
--webserver_port=44985
--enable_log_gc=false
--tserver_master_addrs=127.10.253.126:46329
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.253.65
--log_dir=/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 17:13:57 UTC on ccycloud.quasar-mgcilv.root.comops.site
build id 4572599
ASAN enabled
W20260807 18:16:03.747774 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 18:16:03.749800 13042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:16:03.753659 13042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:16:03.897476 13087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:16:03.900525 13089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:16:03.901113 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:03.901957 13085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:16:03.907387 13042 server_base.cc:1034] running on GCE node
I20260807 18:16:03.914179 13042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:16:03.932561 13042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:16:03.936024 13042 hybrid_clock.cc:648] HybridClock initialized: now 1786126563935789 us; error 128 us; skew 500 ppm
I20260807 18:16:03.936757 13042 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260807 18:16:03.942222 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:04.075299 11285 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.253.65:37131, user_credentials={real_user=slave}} blocked reactor thread for 56894.2us
W20260807 18:16:04.076797 11285 catalog_manager.cc:4584] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4c7eca40645d4ee29079ced64fa54d37: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
I20260807 18:16:04.117456 13042 webserver.cc:460] Webserver started at http://127.10.253.65:44985/ using document root <none> and password file <none>
I20260807 18:16:04.119319 13042 fs_manager.cc:359] Metadata directory not provided
I20260807 18:16:04.119606 13042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:16:04.151202 13042 fs_manager.cc:709] Time spent opening directory manager: real 0.026s user 0.017s sys 0.001s
W20260807 18:16:04.154947 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:16:04.170549 13106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:16:04.175487 13042 fs_manager.cc:725] Time spent opening block manager: real 0.018s user 0.004s sys 0.005s
W20260807 18:16:04.176087 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 18:16:04.175834 13042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal
uuid: "50da72adf57546f5bab0a028672a51dd"
format_stamp: "Formatted at 2026-08-07 18:15:24 on dist-test-slave-h6n0"
I20260807 18:16:04.179618 13042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:16:04.229804 12713 consensus_queue.cc:579] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.047s)
I20260807 18:16:04.267005 12824 consensus_queue.cc:579] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.083s)
I20260807 18:16:04.294055 12074 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1102, Committed index: 1102, Last appended: 2.1104, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1105 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
I20260807 18:16:04.297811 12673 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1104. Preceding OpId from leader: term: 2 index: 1105. (index mismatch)
I20260807 18:16:04.300163 12247 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1102. Preceding OpId from leader: term: 2 index: 1105. (index mismatch)
W20260807 18:16:04.302433 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:04.303858 13053 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1105, Last known committed idx: 1102, Time since last communication: 0.000s
I20260807 18:16:04.310285 11880 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1102. Preceding OpId from leader: term: 2 index: 1105. (index mismatch)
I20260807 18:16:04.317598 12824 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1105, Last known committed idx: 1100, Time since last communication: 0.000s
I20260807 18:16:04.319473 12862 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1105, Last known committed idx: 1102, Time since last communication: 0.000s
I20260807 18:16:04.331813 12246 raft_consensus.cc:1203] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.1102->[2.1103-2.1105] Dedup: 2.1104->[2.1105-2.1105]
I20260807 18:16:04.334265 12862 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 LEADER]: Committing config change with OpId 2.1105: config changed from index 1040 to 1105, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1105 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:04.334754 11880 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Committing config change with OpId 2.1105: config changed from index 1040 to 1105, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1105 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:04.340399 12249 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Committing config change with OpId 2.1105: config changed from index 1040 to 1105, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1105 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:04.351768 11281 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 874ba119c7284c4d8a113d6654e0c39e with cas_config_opid_index 1040: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 18:16:04.355108 11298 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1040 to 1105, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New cstate: current_term: 2 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1105 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 18:16:04.365334 12674 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Committing config change with OpId 2.1105: config changed from index 1040 to 1105, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1105 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:04.439448 13042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:16:04.441553 13042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:16:04.442193 13042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:16:04.452443 13042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:16:04.471220 13122 ts_tablet_manager.cc:542] Loading tablet metadata (0/3 complete)
I20260807 18:16:04.494999 13042 ts_tablet_manager.cc:579] Loaded tablet metadata (3 total tablets, 3 live tablets)
I20260807 18:16:04.495280 13042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.032s user 0.007s sys 0.000s
I20260807 18:16:04.495553 13042 ts_tablet_manager.cc:594] Registering tablets (0/3 complete)
W20260807 18:16:04.508296 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:16:04.511843 13122 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Bootstrap starting.
I20260807 18:16:04.533048 13042 ts_tablet_manager.cc:610] Registered 3 tablets
I20260807 18:16:04.537045 13042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.041s user 0.008s sys 0.011s
W20260807 18:16:04.698915 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:04.820935 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:16:05.016472 13122 log.cc:824] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Log is configured to *not* fsync() on all Append() calls
I20260807 18:16:05.112473 12921 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.024s)
I20260807 18:16:05.171754 12074 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1129, Committed index: 1129, Last appended: 1.1131, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
W20260807 18:16:05.181449 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:05.186880 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:05.187390 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:05.193771 11880 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1131. Preceding OpId from leader: term: 1 index: 1133. (index mismatch)
I20260807 18:16:05.202709 12247 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1130. Preceding OpId from leader: term: 1 index: 1133. (index mismatch)
I20260807 18:16:05.203202 13016 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1132, Last known committed idx: 1129, Time since last communication: 0.000s
I20260807 18:16:05.232585 12675 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1130. Preceding OpId from leader: term: 1 index: 1133. (index mismatch)
I20260807 18:16:05.243788 12921 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1132, Last known committed idx: 1128, Time since last communication: 0.000s
I20260807 18:16:05.272809 12713 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1132: config changed from index 1066 to 1132, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:05.275979 12674 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1132: config changed from index 1066 to 1132, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:05.280937 13053 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1132, Last known committed idx: 1128, Time since last communication: 0.000s
I20260807 18:16:05.283314 11281 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 644a01df651c43d4a74ac241ea43068c with cas_config_opid_index 1066: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260807 18:16:05.299247 11291 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1066 to 1132, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:05.330180 11880 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1132: config changed from index 1066 to 1132, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
W20260807 18:16:05.373260 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:16:05.393098 12921 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.051s)
I20260807 18:16:05.403678 12247 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1132: config changed from index 1066 to 1132, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:05.641204 13179 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:05.641534 13179 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
I20260807 18:16:05.644829 13179 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077)
I20260807 18:16:05.646299 12249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1134 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:05.648188 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1134 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:16:05.687249 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:05.706593 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:16:05.757465 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:16:05.784812 12074 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1141, Committed index: 1141, Last appended: 1.1141, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1142 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
I20260807 18:16:05.793489 12673 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1141. Preceding OpId from leader: term: 1 index: 1142. (index mismatch)
I20260807 18:16:05.795758 12921 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1142, Last known committed idx: 1141, Time since last communication: 0.000s
W20260807 18:16:05.824250 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:05.824491 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:05.825917 12247 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1141. Preceding OpId from leader: term: 1 index: 1142. (index mismatch)
W20260807 18:16:05.842581 11793 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260807 18:16:05.860299 11884 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1141. Preceding OpId from leader: term: 1 index: 1142. (index mismatch)
I20260807 18:16:05.862504 12797 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1142, Last known committed idx: 1139, Time since last communication: 0.000s
I20260807 18:16:05.880666 13209 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1142, Last known committed idx: 1141, Time since last communication: 0.000s
I20260807 18:16:05.922554 12797 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1142: config changed from index 1074 to 1142, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1142 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:05.926682 12246 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1142: config changed from index 1074 to 1142, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1142 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:05.931434 11281 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 4c7eca40645d4ee29079ced64fa54d37 with cas_config_opid_index 1074: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260807 18:16:05.934408 12674 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1142: config changed from index 1074 to 1142, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1142 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:05.942332 11298 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1074 to 1142, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1142 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260807 18:16:05.947934 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 18:16:06.050196 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1134 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:06.096740 11791 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca
I20260807 18:16:06.097333 13179 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 18:16:06.102769 11793 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 260167us
W20260807 18:16:06.104672 11793 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:06.097348 11880 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1142: config changed from index 1074 to 1142, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1142 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
W20260807 18:16:06.177740 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:06.310626 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:06.369181 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:16:06.416934 13208 consensus_queue.cc:579] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.122s)
I20260807 18:16:06.427728 12074 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1152, Committed index: 1152, Last appended: 2.1155, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1156 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
I20260807 18:16:06.435026 12675 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1155. Preceding OpId from leader: term: 2 index: 1156. (index mismatch)
I20260807 18:16:06.442230 11883 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1152. Preceding OpId from leader: term: 2 index: 1156. (index mismatch)
I20260807 18:16:06.446620 12247 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1154. Preceding OpId from leader: term: 2 index: 1156. (index mismatch)
I20260807 18:16:06.447531 13208 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1156, Last known committed idx: 1152, Time since last communication: 0.000s
W20260807 18:16:06.460584 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:06.463263 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:06.467705 13013 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1156, Last known committed idx: 1150, Time since last communication: 0.000s
I20260807 18:16:06.496928 12797 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1156, Last known committed idx: 1152, Time since last communication: 0.000s
W20260807 18:16:06.498471 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:06.533231 12797 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 LEADER]: Committing config change with OpId 2.1156: config changed from index 1105 to 1156, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1156 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:06.540879 11281 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 874ba119c7284c4d8a113d6654e0c39e with cas_config_opid_index 1105: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260807 18:16:06.549871 11297 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1105 to 1156, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New cstate: current_term: 2 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1156 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:06.550570 12673 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Committing config change with OpId 2.1156: config changed from index 1105 to 1156, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1156 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:06.552382 12247 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Committing config change with OpId 2.1156: config changed from index 1105 to 1156, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1156 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
W20260807 18:16:06.644811 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 18:16:06.704145 11880 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Committing config change with OpId 2.1156: config changed from index 1105 to 1156, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1156 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
W20260807 18:16:06.832953 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:06.955909 11977 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 101737us
W20260807 18:16:07.015173 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:07.015585 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:07.022567 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:16:07.165143 13122 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=238 overwritten=0 applied=232 ignored=0} inserts{seen=3809 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 6 replicates
I20260807 18:16:07.166631 13122 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Bootstrap complete.
I20260807 18:16:07.171241 13122 ts_tablet_manager.cc:1397] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Time spent bootstrapping tablet: real 2.658s user 0.850s sys 0.183s
W20260807 18:16:07.174162 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:16:07.174980 11285 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111) [suppressed 4 similar messages]
I20260807 18:16:07.189751 13122 raft_consensus.cc:348] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Replica starting. Triggering 6 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
W20260807 18:16:07.196949 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:07.199723 11285 catalog_manager.cc:4584] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 644a01df651c43d4a74ac241ea43068c: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
I20260807 18:16:07.208285 13122 raft_consensus.cc:729] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Initialized, Role: FOLLOWER
I20260807 18:16:07.210157 13122 consensus_queue.cc:260] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 232, Last appended: 1.238, Last appended by leader: 238, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:07.213369 13016 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.041s)
I20260807 18:16:07.235142 13122 ts_tablet_manager.cc:1428] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Time spent starting tablet: real 0.063s user 0.026s sys 0.010s
I20260807 18:16:07.236532 13122 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Bootstrap starting.
I20260807 18:16:07.277933 12797 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.105s)
I20260807 18:16:07.338263 12074 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1176, Committed index: 1176, Last appended: 1.1178, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1179 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
I20260807 18:16:07.352069 11881 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1178. Preceding OpId from leader: term: 1 index: 1179. (index mismatch)
I20260807 18:16:07.353650 12797 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1179, Last known committed idx: 1176, Time since last communication: 0.000s
I20260807 18:16:07.348167 12676 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1178. Preceding OpId from leader: term: 1 index: 1179. (index mismatch)
I20260807 18:16:07.360356 12246 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1178. Preceding OpId from leader: term: 1 index: 1179. (index mismatch)
I20260807 18:16:07.360971 13209 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1179, Last known committed idx: 1176, Time since last communication: 0.000s
I20260807 18:16:07.365546 12713 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1179, Last known committed idx: 1176, Time since last communication: 0.000s
W20260807 18:16:07.368855 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:07.374723 13034 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1179: config changed from index 1132 to 1179, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1179 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:07.385728 11281 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 644a01df651c43d4a74ac241ea43068c with cas_config_opid_index 1132: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 18:16:07.387200 11297 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1132 to 1179, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1179 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 18:16:07.392357 12676 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1179: config changed from index 1132 to 1179, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1179 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:07.396045 11881 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1179: config changed from index 1132 to 1179, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1179 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:07.413913 12246 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1179: config changed from index 1132 to 1179, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1179 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
W20260807 18:16:07.492157 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 18:16:07.515129 13303 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:07.515625 13303 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:07.539517 13303 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
W20260807 18:16:07.544252 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:07.578313 13118 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:07.621728 13118 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:07.711565 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:07.727262 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:07.728400 13107 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:16:07.729270 13303 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 18:16:07.747128 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:07.836112 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:16:07.862206 13013 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer 50da72adf57546f5bab0a028672a51dd for more than 2 seconds (2.075s)
I20260807 18:16:07.871886 12074 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1191, Committed index: 1191, Last appended: 1.1195, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1196 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:07.879770 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:07.914716 12674 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1192. Preceding OpId from leader: term: 1 index: 1196. (index mismatch)
I20260807 18:16:07.915990 12797 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1196, Last known committed idx: 1191, Time since last communication: 0.000s
I20260807 18:16:07.925629 12249 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1191. Preceding OpId from leader: term: 1 index: 1196. (index mismatch)
I20260807 18:16:07.934242 12797 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1196, Last known committed idx: 1187, Time since last communication: 0.000s
I20260807 18:16:07.935415 11883 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1191. Preceding OpId from leader: term: 1 index: 1196. (index mismatch)
I20260807 18:16:07.936414 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:07.954188 13042 rpc_server.cc:307] RPC server started. Bound to: 127.10.253.65:37131
I20260807 18:16:07.954344 13357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.253.65:37131 every 8 connection(s)
I20260807 18:16:07.957463 13042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/data/info.pb
I20260807 18:16:07.961081 13013 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1196, Last known committed idx: 1191, Time since last communication: 0.000s
I20260807 18:16:07.970194 11253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu as pid 13042
I20260807 18:16:07.993422 12862 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1196: config changed from index 1142 to 1196, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1196 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:08.012461 11281 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 4c7eca40645d4ee29079ced64fa54d37 with cas_config_opid_index 1142: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 18:16:08.017575 12245 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1196: config changed from index 1142 to 1196, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1196 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:08.023504 11293 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1142 to 1196, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1196 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 18:16:08.036377 12676 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1196: config changed from index 1142 to 1196, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1196 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:08.093232 11883 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1196: config changed from index 1142 to 1196, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1196 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:08.130311 13303 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:08.130688 13303 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:08.132246 13303 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:16:08.134835 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:08.138123 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
W20260807 18:16:08.143095 13118 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:08.143378 13118 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:16:08.144275 13303 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:08.186409 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:16:08.276518 13374 tablet_replica_mm_ops.cc:318] Log GC is disabled (check --enable_log_gc)
W20260807 18:16:08.337280 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:08.433861 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:16:08.461113 13303 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:08.461380 13303 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:08.462491 13303 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:16:08.464027 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:08.464418 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:08.465502 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:08.466373 13107 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:08.469003 13303 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:08.489934 12797 consensus_queue.cc:579] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.061s)
W20260807 18:16:08.494867 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:08.511715 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:08.519693 13118 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:08.544871 13358 heartbeater.cc:347] Connected to a master server at 127.10.253.126:46329
I20260807 18:16:08.545524 13358 heartbeater.cc:464] Registering TS with master...
I20260807 18:16:08.547917 13358 heartbeater.cc:511] Master 127.10.253.126:46329 requested a full tablet report, sending...
I20260807 18:16:08.553968 11297 ts_manager.cc:194] Re-registered known tserver with Master: 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:08.557099 11297 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.253.65:59583
W20260807 18:16:08.701352 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 191 similar messages]
I20260807 18:16:08.771699 13303 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:08.772004 13303 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:08.773300 13303 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:16:08.775218 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:08.776961 12247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
W20260807 18:16:08.778013 13118 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:08.778620 13107 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:16:08.779127 13303 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:08.795388 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:16:08.864481 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
W20260807 18:16:08.885818 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:09.006403 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:09.033481 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 18:16:09.303223 13122 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=228 overwritten=0 applied=228 ignored=0} inserts{seen=3851 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:16:09.305130 13122 tablet_bootstrap.cc:492] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Bootstrap complete.
I20260807 18:16:09.307627 13122 ts_tablet_manager.cc:1397] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Time spent bootstrapping tablet: real 2.071s user 0.725s sys 0.228s
I20260807 18:16:09.309425 13122 raft_consensus.cc:348] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:16:09.310019 13122 raft_consensus.cc:729] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Initialized, Role: FOLLOWER
I20260807 18:16:09.310591 13122 consensus_queue.cc:260] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 228, Last appended: 1.228, Last appended by leader: 228, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:16:09.320402 13122 ts_tablet_manager.cc:1428] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Time spent starting tablet: real 0.012s user 0.005s sys 0.004s
I20260807 18:16:09.320753 13358 heartbeater.cc:503] Master 127.10.253.126:46329 was elected leader, sending a full tablet report...
I20260807 18:16:09.320987 13122 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Bootstrap starting.
I20260807 18:16:09.381910 12713 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.043s)
W20260807 18:16:09.387665 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:16:09.463927 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 26: this message will repeat every 5th retry.
I20260807 18:16:09.474632 12074 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1243, Committed index: 1243, Last appended: 1.1243, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1244 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
I20260807 18:16:09.483263 13261 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 228. Preceding OpId from leader: term: 1 index: 1244. (index mismatch)
W20260807 18:16:09.486559 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:09.487706 12674 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1243. Preceding OpId from leader: term: 1 index: 1244. (index mismatch)
I20260807 18:16:09.488523 13386 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1244, Last known committed idx: 228, Time since last communication: 0.001s
I20260807 18:16:09.489761 12246 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1243. Preceding OpId from leader: term: 1 index: 1245. (index mismatch)
I20260807 18:16:09.491053 11881 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1243. Preceding OpId from leader: term: 1 index: 1245. (index mismatch)
I20260807 18:16:09.492574 12862 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1244, Last known committed idx: 1243, Time since last communication: 0.000s
I20260807 18:16:09.520805 13053 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1244, Last known committed idx: 1243, Time since last communication: 0.000s
I20260807 18:16:09.521705 12713 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1244, Last known committed idx: 1240, Time since last communication: 0.000s
I20260807 18:16:09.538703 12862 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1244: config changed from index 1179 to 1244, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1244 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:09.541072 11884 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1244: config changed from index 1179 to 1244, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1244 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
W20260807 18:16:09.544685 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260807 18:16:09.544625 12249 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1244: config changed from index 1179 to 1244, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1244 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:09.564680 11281 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 644a01df651c43d4a74ac241ea43068c with cas_config_opid_index 1179: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260807 18:16:09.565678 13387 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:09.566033 13387 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:16:09.567595 13387 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:16:09.568816 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 228 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:09.570791 13387 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:09.571112 13387 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:09.573664 13387 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:16:09.577580 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 228 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:09.578516 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:09.583671 11297 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1179 to 1244, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1244 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:09.586992 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
W20260807 18:16:09.588896 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260807 18:16:09.594697 12673 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1244: config changed from index 1179 to 1244, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1244 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:09.599807 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 238 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:09.599472 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 228 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:09.600968 13107 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:09.601716 13387 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:09.601735 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:09.602957 13387 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 18:16:09.618716 13118 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:09.619006 13118 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:09.645009 13107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.67:33793, user_credentials={real_user=slave}} blocked reactor thread for 43530.8us
W20260807 18:16:09.688264 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.67:33793, user_credentials={real_user=slave}} blocked reactor thread for 64220.4us
I20260807 18:16:09.958091 12713 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.086s)
I20260807 18:16:09.970950 12073 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1256, Committed index: 1256, Last appended: 1.1259, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1260 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
I20260807 18:16:09.972617 13398 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:09.973269 13398 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }
I20260807 18:16:09.978458 12245 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1259. Preceding OpId from leader: term: 1 index: 1260. (index mismatch)
I20260807 18:16:09.978713 11881 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1259. Preceding OpId from leader: term: 1 index: 1260. (index mismatch)
I20260807 18:16:09.982218 13386 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1260, Last known committed idx: 1256, Time since last communication: 0.000s
I20260807 18:16:09.983039 13386 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1260, Last known committed idx: 1256, Time since last communication: 0.000s
I20260807 18:16:09.989202 13398 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:16:09.990638 12673 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1259. Preceding OpId from leader: term: 1 index: 1260. (index mismatch)
I20260807 18:16:09.991389 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 228 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:09.992427 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 228 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:09.994379 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 228 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:09.997020 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
W20260807 18:16:09.997529 13118 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:10.002378 13378 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1260: config changed from index 1196 to 1260, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1260 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:10.003355 13384 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1260, Last known committed idx: 1256, Time since last communication: 0.002s
I20260807 18:16:10.012751 12246 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1260: config changed from index 1196 to 1260, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1260 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:10.023120 13260 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 238. Preceding OpId from leader: term: 1 index: 1260. (index mismatch)
I20260807 18:16:10.019323 12676 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1260: config changed from index 1196 to 1260, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1260 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:10.030661 13384 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1260, Last known committed idx: 232, Time since last communication: 0.000s
W20260807 18:16:10.040174 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:10.039436 11298 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca reported cstate change: config changed from index 1196 to 1260, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1260 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
W20260807 18:16:10.073942 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 31: this message will repeat every 5th retry.
I20260807 18:16:10.075310 11881 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1260: config changed from index 1196 to 1260, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1260 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:10.077509 11281 catalog_manager.cc:5008] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 4c7eca40645d4ee29079ced64fa54d37 with cas_config_opid_index 1196: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
W20260807 18:16:10.098210 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:10.161490 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:16:10.508769 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:10.592727 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 36: this message will repeat every 5th retry.
W20260807 18:16:10.609779 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:10.811350 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260807 18:16:11.026564 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:11.173012 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:11.217017 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 41: this message will repeat every 5th retry.
W20260807 18:16:11.344152 12489 meta_cache.cc:1261] Time spent looking up entry by key: real 0.069s user 0.003s sys 0.000s
W20260807 18:16:11.356273 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260807 18:16:11.508338 12921 consensus_queue.cc:579] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.033s)
I20260807 18:16:11.566068 13261 raft_consensus.cc:858] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }.
Pending config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }:
New config: opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:11.566644 13261 raft_consensus.cc:1565] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Could not prepare op 'term: 1 index: 816' and following 429 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } }.
Pending config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }:
New config: opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:11.615743 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:11.754479 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260807 18:16:11.831856 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 46: this message will repeat every 5th retry.
W20260807 18:16:11.994248 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260807 18:16:12.030977 12921 consensus_queue.cc:579] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Leader has been unable to successfully communicate with peer b5bb27271da74b1a909d982e6fb2d470 for more than 2 seconds (2.059s)
W20260807 18:16:12.153486 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260807 18:16:12.191877 13261 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Committing config change with OpId 1.515: config changed from index -1 to 515, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
W20260807 18:16:12.396688 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260807 18:16:12.640977 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260807 18:16:12.640698 13221 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c7eca40645d4ee29079ced64fa54d37 with delete_type TABLET_DATA_TOMBSTONED (TS 50da72adf57546f5bab0a028672a51dd not found in new config with opid_index 787) from {username='slave'} at 127.0.0.1:51654
W20260807 18:16:12.764889 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.69:45839, user_credentials={real_user=slave}} blocked reactor thread for 64991.3us
W20260807 18:16:12.833007 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260807 18:16:12.854609 13398 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:12.847318 13261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.253.68:42039 (request call id 15) took 3101 ms. Trace:
I20260807 18:16:12.860364 13416 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:12.862226 13416 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:16:12.913555 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:12.915798 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:12.916740 13416 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:16:12.920871 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:12.932137 13161 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:55268 (request call id 11) took 2450 ms. Trace:
I20260807 18:16:12.932564 13161 rpcz_store.cc:276] 0807 18:16:10.473544 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:10.473619 (+ 75us) service_pool.cc:227] Handling call
0807 18:16:12.923388 (+2449769us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x615000043424. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6018bb630 00007fa605493c7f 00007fa5fffff016 00007fa5ffffed45 00007fa5fceef9be 00007fa5fceee79e 00007fa5fcef4b25 00007fa5fcef554f 00007fa5fcef5378 00000000009edb7c
0807 18:16:12.923653 (+ 265us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5591448448}
I20260807 18:16:12.970867 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:12.971669 13416 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 18:16:13.074610 13118 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 6 similar messages]
W20260807 18:16:13.104562 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260807 18:16:13.168241 13118 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 111629us
W20260807 18:16:13.177536 13118 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:13.184253 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 51: this message will repeat every 5th retry.
W20260807 18:16:13.278983 13428 log.cc:924] Time spent T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260807 18:16:13.279157 13221 tablet_service.cc:1514] Processing DeleteTablet for tablet 874ba119c7284c4d8a113d6654e0c39e with delete_type TABLET_DATA_TOMBSTONED (TS 50da72adf57546f5bab0a028672a51dd not found in new config with opid_index 809) from {username='slave'} at 127.0.0.1:51654
W20260807 18:16:13.373801 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260807 18:16:13.438606 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260807 18:16:13.571019 13260 raft_consensus.cc:858] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }.
Pending config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }:
New config: opid_index: 729 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:13.592993 13260 raft_consensus.cc:1565] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Could not prepare op 'term: 1 index: 729' and following 532 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }.
Pending config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }:
New config: opid_index: 729 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:13.674666 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260807 18:16:13.711519 13452 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
W20260807 18:16:13.764325 12489 meta_cache.cc:1261] Time spent looking up entry by key: real 0.052s user 0.002s sys 0.000s
W20260807 18:16:13.786013 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 130 similar messages]
I20260807 18:16:13.761067 13452 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:16:13.901392 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:13.902678 11884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:13.903162 13452 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:16:13.915616 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:13.938411 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:13.939065 13452 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 18:16:14.023366 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260807 18:16:14.033222 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260807 18:16:14.120198 13118 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 74496.5us
W20260807 18:16:14.167178 13118 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:14.307284 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260807 18:16:14.393787 13452 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:14.394236 13452 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:16:14.396492 12249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:14.408564 13452 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:16:14.413204 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
W20260807 18:16:14.413519 13118 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:14.416505 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:16:14.416909 13452 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:14.422627 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:16:14.440997 13459 log.cc:924] Time spent T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Append to log took a long time: real 0.112s user 0.000s sys 0.005s
I20260807 18:16:14.419365 13260 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Committing config change with OpId 1.518: config changed from index -1 to 518, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:16:14.582723 13398 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:14.583067 13398 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:16:14.585644 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 728 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:14.585603 12249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 728 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:14.588667 13398 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:16:14.589496 13442 tablet_replica.cc:330] stopping tablet replica
I20260807 18:16:14.597141 13417 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:14.602469 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 728 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:16:14.604382 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260807 18:16:14.627844 13118 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:14.597620 13417 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:16:14.641386 13118 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
W20260807 18:16:14.641748 13118 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 48757.6us
I20260807 18:16:14.645218 13122 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Bootstrap replaying log segment 1/1 (131.7K/164.8K this segment, stats: ops{read=182 overwritten=1 applied=180 ignored=0} inserts{seen=2947 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260807 18:16:14.655491 13260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.253.68:42039 (request call id 22) took 4251 ms. Trace:
I20260807 18:16:14.659060 13442 raft_consensus.cc:2229] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:16:14.664999 13398 raft_consensus.cc:2684] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Received pre-election callback for term 2 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260807 18:16:14.666774 13442 raft_consensus.cc:2258] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:16:14.681849 13417 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:16:14.687121 11884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 728 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:14.687544 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 728 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
W20260807 18:16:14.720731 13118 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:14.720958 13118 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
W20260807 18:16:14.721544 13118 raft_consensus.cc:2670] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260807 18:16:14.733135 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 728 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:16:14.758627 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260807 18:16:14.881775 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260807 18:16:14.987308 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 56: this message will repeat every 5th retry.
I20260807 18:16:15.138984 13417 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:15.140507 13417 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:16:15.145834 12249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:15.170490 11884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:15.182667 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:16:15.196557 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260807 18:16:15.249414 13417 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:16:15.291131 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
W20260807 18:16:15.291888 13107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.68:43889, user_credentials={real_user=slave}} blocked reactor thread for 104995us
I20260807 18:16:15.298751 13417 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 18:16:15.371315 13118 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 165794us
W20260807 18:16:15.373919 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260807 18:16:15.445907 13221 tablet_service.cc:1514] Processing DeleteTablet for tablet 644a01df651c43d4a74ac241ea43068c with delete_type TABLET_DATA_TOMBSTONED (TS 50da72adf57546f5bab0a028672a51dd not found in new config with opid_index 896) from {username='slave'} at 127.0.0.1:51654
W20260807 18:16:15.446596 13118 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:15.469774 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260807 18:16:15.755267 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260807 18:16:15.864389 13442 op_tracker.cc:283] OpTracker waiting for 301 outstanding ops to complete now for 1.156s
I20260807 18:16:15.864665 13442 op_tracker.cc:285] Dumping up to 50 currently running ops:
I20260807 18:16:15.864876 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d8c00 [op_id=(term: 1 index: 728), ts=7315974359838609408, rows=[]]]
I20260807 18:16:15.891492 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d8880 [op_id=(term: 1 index: 727), ts=7315974359621193728, rows=[]]]
I20260807 18:16:15.892066 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d8500 [op_id=(term: 1 index: 726), ts=7315974359532466176, rows=[]]]
I20260807 18:16:15.917364 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d8180 [op_id=(term: 1 index: 725), ts=7315974359212392448, rows=[]]]
I20260807 18:16:15.947819 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d7e00 [op_id=(term: 1 index: 724), ts=7315974359207419904, rows=[]]]
I20260807 18:16:15.980211 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d7a80 [op_id=(term: 1 index: 723), ts=7315974358939705344, rows=[]]]
I20260807 18:16:15.985433 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d7700 [op_id=(term: 1 index: 722), ts=7315974358912446464, rows=[]]]
I20260807 18:16:15.996080 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d7380 [op_id=(term: 1 index: 721), ts=7315974358601814016, rows=[]]]
I20260807 18:16:15.998057 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d7000 [op_id=(term: 1 index: 720), ts=7315974358596976640, rows=[]]]
I20260807 18:16:16.001991 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d6c80 [op_id=(term: 1 index: 719), ts=7315974358080045056, rows=[]]]
I20260807 18:16:16.002552 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d6900 [op_id=(term: 1 index: 718), ts=7315974357995487232, rows=[]]]
I20260807 18:16:16.004755 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d6580 [op_id=(term: 1 index: 717), ts=7315974357942947840, rows=[]]]
I20260807 18:16:16.005160 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d6200 [op_id=(term: 1 index: 716), ts=7315974357545668608, rows=[]]]
W20260807 18:16:16.046447 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260807 18:16:16.047848 13476 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:16.048295 13476 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:16:16.058895 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:16.063136 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:16.065173 13476 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:16:16.077409 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d5e80 [op_id=(term: 1 index: 715), ts=7315974357334421504, rows=[]]]
I20260807 18:16:16.077826 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d5b00 [op_id=(term: 1 index: 714), ts=7315974357191561216, rows=[]]]
I20260807 18:16:16.078394 12249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:16.079856 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d5780 [op_id=(term: 1 index: 713), ts=7315974357081862144, rows=[]]]
W20260807 18:16:16.081210 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260807 18:16:16.086784 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:16.080370 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d5400 [op_id=(term: 1 index: 712), ts=7315974356744785920, rows=[]]]
I20260807 18:16:16.103643 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d5080 [op_id=(term: 1 index: 711), ts=7315974356441669632, rows=[]]]
I20260807 18:16:16.104156 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d4d00 [op_id=(term: 1 index: 710), ts=7315974356432740352, rows=[]]]
I20260807 18:16:16.104686 13476 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:16.106791 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d4980 [op_id=(term: 1 index: 709), ts=7315974356388265984, rows=[]]]
I20260807 18:16:16.107082 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d4600 [op_id=(term: 1 index: 708), ts=7315974355832102912, rows=[]]]
I20260807 18:16:16.109519 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d4280 [op_id=(term: 1 index: 707), ts=7315974355496189952, rows=[]]]
I20260807 18:16:16.109807 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d3f00 [op_id=(term: 1 index: 706), ts=7315974355348664320, rows=[]]]
I20260807 18:16:16.117870 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001afa00 [op_id=(term: 1 index: 614), ts=7315974340180762624, rows=[]]]
I20260807 18:16:16.118381 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001af680 [op_id=(term: 1 index: 613), ts=7315974340170629120, rows=[]]]
I20260807 18:16:16.159659 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001af300 [op_id=(term: 1 index: 612), ts=7315974339923423232, rows=[]]]
I20260807 18:16:16.160373 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001aef80 [op_id=(term: 1 index: 611), ts=7315974339521355776, rows=[]]]
I20260807 18:16:16.203049 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001aec00 [op_id=(term: 1 index: 610), ts=7315974339121430528, rows=[]]]
I20260807 18:16:16.203485 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ae880 [op_id=(term: 1 index: 609), ts=7315974339083530240, rows=[]]]
I20260807 18:16:16.238098 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ae500 [op_id=(term: 1 index: 608), ts=7315974339053342720, rows=[]]]
I20260807 18:16:16.238674 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ae180 [op_id=(term: 1 index: 607), ts=7315974338681466880, rows=[]]]
I20260807 18:16:16.249406 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ade00 [op_id=(term: 1 index: 606), ts=7315974338587009024, rows=[]]]
I20260807 18:16:16.249781 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ada80 [op_id=(term: 1 index: 605), ts=7315974338486616064, rows=[]]]
I20260807 18:16:16.254143 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ad700 [op_id=(term: 1 index: 604), ts=7315974338473861120, rows=[]]]
I20260807 18:16:16.254483 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ad380 [op_id=(term: 1 index: 603), ts=7315974338335264768, rows=[]]]
I20260807 18:16:16.258258 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d3b80 [op_id=(term: 1 index: 705), ts=7315974355225174016, rows=[]]]
I20260807 18:16:16.258630 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001a9480 [op_id=(term: 1 index: 585), ts=7315974336109117440, rows=[]]]
I20260807 18:16:16.297271 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d3800 [op_id=(term: 1 index: 704), ts=7315974355146313728, rows=[]]]
I20260807 18:16:16.298393 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001a9100 [op_id=(term: 1 index: 584), ts=7315974335925092352, rows=[]]]
I20260807 18:16:16.301224 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d3480 [op_id=(term: 1 index: 703), ts=7315974354518777856, rows=[]]]
I20260807 18:16:16.301638 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001a8d80 [op_id=(term: 1 index: 583), ts=7315974335706959872, rows=[]]]
I20260807 18:16:16.305394 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d3100 [op_id=(term: 1 index: 702), ts=7315974354403966976, rows=[]]]
I20260807 18:16:16.306950 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001a8a00 [op_id=(term: 1 index: 582), ts=7315974335541796864, rows=[]]]
I20260807 18:16:16.359789 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d2d80 [op_id=(term: 1 index: 701), ts=7315974354388254720, rows=[]]]
I20260807 18:16:16.388769 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001a8680 [op_id=(term: 1 index: 581), ts=7315974335479058432, rows=[]]]
W20260807 18:16:16.391616 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260807 18:16:16.470659 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d2a00 [op_id=(term: 1 index: 700), ts=7315974354374422528, rows=[]]]
I20260807 18:16:16.471659 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001a8300 [op_id=(term: 1 index: 580), ts=7315974335117668352, rows=[]]]
I20260807 18:16:16.476820 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d2680 [op_id=(term: 1 index: 699), ts=7315974353832734720, rows=[]]]
I20260807 18:16:16.477249 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001a7f80 [op_id=(term: 1 index: 579), ts=7315974335101313024, rows=[]]]
I20260807 18:16:16.513109 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d2300 [op_id=(term: 1 index: 698), ts=7315974353767395328, rows=[]]]
W20260807 18:16:16.630780 13118 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 234455us
I20260807 18:16:14.696475 13260 rpcz_store.cc:276] 0807 18:16:10.330137 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:10.334036 (+ 3899us) service_pool.cc:227] Handling call
0807 18:16:10.843759 (+509723us) raft_consensus.cc:1457] Updating replica for 1023 ops
0807 18:16:11.230910 (+387151us) raft_consensus.cc:1520] Early marking committed up to index 238
0807 18:16:11.474154 (+243244us) raft_consensus.cc:1525] Triggering prepare for 1023 ops
0807 18:16:11.474585 (+ 431us) write_op.cc:270] Start()
0807 18:16:11.474661 (+ 76us) write_op.cc:276] Timestamp: P: 1786126538406486 usec, L: 0
0807 18:16:11.607595 (+132934us) write_op.cc:270] Start()
0807 18:16:11.607645 (+ 50us) write_op.cc:276] Timestamp: P: 1786126538422762 usec, L: 0
0807 18:16:11.607961 (+ 316us) write_op.cc:270] Start()
0807 18:16:11.607987 (+ 26us) write_op.cc:276] Timestamp: P: 1786126538500781 usec, L: 0
0807 18:16:11.608252 (+ 265us) write_op.cc:270] Start()
0807 18:16:11.608279 (+ 27us) write_op.cc:276] Timestamp: P: 1786126538508693 usec, L: 0
0807 18:16:11.608515 (+ 236us) write_op.cc:270] Start()
0807 18:16:11.608545 (+ 30us) write_op.cc:276] Timestamp: P: 1786126538509605 usec, L: 0
0807 18:16:11.608705 (+ 160us) write_op.cc:270] Start()
0807 18:16:11.608749 (+ 44us) write_op.cc:276] Timestamp: P: 1786126538563912 usec, L: 0
0807 18:16:11.608935 (+ 186us) write_op.cc:270] Start()
0807 18:16:11.608991 (+ 56us) write_op.cc:276] Timestamp: P: 1786126538606128 usec, L: 0
0807 18:16:11.609139 (+ 148us) write_op.cc:270] Start()
0807 18:16:11.609161 (+ 22us) write_op.cc:276] Timestamp: P: 1786126538607832 usec, L: 0
0807 18:16:11.609289 (+ 128us) write_op.cc:270] Start()
0807 18:16:11.609306 (+ 17us) write_op.cc:276] Timestamp: P: 1786126538609046 usec, L: 0
0807 18:16:11.609423 (+ 117us) write_op.cc:270] Start()
0807 18:16:11.609440 (+ 17us) write_op.cc:276] Timestamp: P: 1786126538643489 usec, L: 0
0807 18:16:11.609560 (+ 120us) write_op.cc:270] Start()
0807 18:16:11.609600 (+ 40us) write_op.cc:276] Timestamp: P: 1786126538709375 usec, L: 0
0807 18:16:11.609830 (+ 230us) write_op.cc:270] Start()
0807 18:16:11.609850 (+ 20us) write_op.cc:276] Timestamp: P: 1786126538710443 usec, L: 0
0807 18:16:11.610051 (+ 201us) write_op.cc:270] Start()
0807 18:16:11.610074 (+ 23us) write_op.cc:276] Timestamp: P: 1786126538733570 usec, L: 0
0807 18:16:11.610214 (+ 140us) write_op.cc:270] Start()
0807 18:16:11.610234 (+ 20us) write_op.cc:276] Timestamp: P: 1786126538772958 usec, L: 0
0807 18:16:11.610390 (+ 156us) write_op.cc:270] Start()
0807 18:16:11.610409 (+ 19us) write_op.cc:276] Timestamp: P: 1786126538832642 usec, L: 0
0807 18:16:11.610558 (+ 149us) write_op.cc:270] Start()
0807 18:16:11.610580 (+ 22us) write_op.cc:276] Timestamp: P: 1786126538845200 usec, L: 0
0807 18:16:11.610737 (+ 157us) write_op.cc:270] Start()
0807 18:16:11.610764 (+ 27us) write_op.cc:276] Timestamp: P: 1786126538847107 usec, L: 0
0807 18:16:11.610941 (+ 177us) write_op.cc:270] Start()
0807 18:16:11.610968 (+ 27us) write_op.cc:276] Timestamp: P: 1786126538870296 usec, L: 0
0807 18:16:11.614726 (+ 3758us) write_op.cc:270] Start()
0807 18:16:11.614760 (+ 34us) write_op.cc:276] Timestamp: P: 1786126538908065 usec, L: 0
0807 18:16:11.615036 (+ 276us) write_op.cc:270] Start()
0807 18:16:11.615062 (+ 26us) write_op.cc:276] Timestamp: P: 1786126538921159 usec, L: 0
0807 18:16:11.615304 (+ 242us) write_op.cc:270] Start()
0807 18:16:11.615328 (+ 24us) write_op.cc:276] Timestamp: P: 1786126538923098 usec, L: 0
0807 18:16:11.615533 (+ 205us) write_op.cc:270] Start()
0807 18:16:11.615557 (+ 24us) write_op.cc:276] Timestamp: P: 1786126538928183 usec, L: 0
0807 18:16:11.615755 (+ 198us) write_op.cc:270] Start()
0807 18:16:11.615779 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539011427 usec, L: 0
0807 18:16:11.618901 (+ 3122us) write_op.cc:270] Start()
0807 18:16:11.618938 (+ 37us) write_op.cc:276] Timestamp: P: 1786126539020254 usec, L: 0
0807 18:16:11.619275 (+ 337us) write_op.cc:270] Start()
0807 18:16:11.619300 (+ 25us) write_op.cc:276] Timestamp: P: 1786126539028780 usec, L: 0
0807 18:16:11.619728 (+ 428us) write_op.cc:270] Start()
0807 18:16:11.619769 (+ 41us) write_op.cc:276] Timestamp: P: 1786126539041065 usec, L: 0
0807 18:16:11.620299 (+ 530us) write_op.cc:270] Start()
0807 18:16:11.620348 (+ 49us) write_op.cc:276] Timestamp: P: 1786126539080515 usec, L: 0
0807 18:16:11.620504 (+ 156us) write_op.cc:270] Start()
0807 18:16:11.620526 (+ 22us) write_op.cc:276] Timestamp: P: 1786126539091859 usec, L: 0
0807 18:16:11.621305 (+ 779us) write_op.cc:270] Start()
0807 18:16:11.621334 (+ 29us) write_op.cc:276] Timestamp: P: 1786126539119724 usec, L: 0
0807 18:16:11.626794 (+ 5460us) write_op.cc:270] Start()
0807 18:16:11.626838 (+ 44us) write_op.cc:276] Timestamp: P: 1786126539128053 usec, L: 0
0807 18:16:11.629480 (+ 2642us) write_op.cc:270] Start()
0807 18:16:11.629530 (+ 50us) write_op.cc:276] Timestamp: P: 1786126539137026 usec, L: 0
0807 18:16:11.629804 (+ 274us) write_op.cc:270] Start()
0807 18:16:11.629832 (+ 28us) write_op.cc:276] Timestamp: P: 1786126539191641 usec, L: 0
0807 18:16:11.630058 (+ 226us) write_op.cc:270] Start()
0807 18:16:11.630087 (+ 29us) write_op.cc:276] Timestamp: P: 1786126539203091 usec, L: 0
0807 18:16:11.630306 (+ 219us) write_op.cc:270] Start()
0807 18:16:11.630348 (+ 42us) write_op.cc:276] Timestamp: P: 1786126539223626 usec, L: 0
0807 18:16:11.630585 (+ 237us) write_op.cc:270] Start()
0807 18:16:11.630612 (+ 27us) write_op.cc:276] Timestamp: P: 1786126539227550 usec, L: 0
0807 18:16:11.630898 (+ 286us) write_op.cc:270] Start()
0807 18:16:11.630927 (+ 29us) write_op.cc:276] Timestamp: P: 1786126539258577 usec, L: 0
0807 18:16:11.631155 (+ 228us) write_op.cc:270] Start()
0807 18:16:11.631197 (+ 42us) write_op.cc:276] Timestamp: P: 1786126539262487 usec, L: 0
0807 18:16:11.631397 (+ 200us) write_op.cc:270] Start()
0807 18:16:11.631422 (+ 25us) write_op.cc:276] Timestamp: P: 1786126539309074 usec, L: 0
0807 18:16:11.631735 (+ 313us) write_op.cc:270] Start()
0807 18:16:11.631779 (+ 44us) write_op.cc:276] Timestamp: P: 1786126539355306 usec, L: 0
0807 18:16:11.632004 (+ 225us) write_op.cc:270] Start()
0807 18:16:11.632031 (+ 27us) write_op.cc:276] Timestamp: P: 1786126539360415 usec, L: 0
0807 18:16:11.632193 (+ 162us) write_op.cc:270] Start()
0807 18:16:11.632220 (+ 27us) write_op.cc:276] Timestamp: P: 1786126539372469 usec, L: 0
0807 18:16:11.640062 (+ 7842us) write_op.cc:270] Start()
0807 18:16:11.640111 (+ 49us) write_op.cc:276] Timestamp: P: 1786126539376771 usec, L: 0
0807 18:16:11.640551 (+ 440us) write_op.cc:270] Start()
0807 18:16:11.640582 (+ 31us) write_op.cc:276] Timestamp: P: 1786126539445635 usec, L: 0
0807 18:16:11.640769 (+ 187us) write_op.cc:270] Start()
0807 18:16:11.640793 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539455915 usec, L: 0
0807 18:16:11.641081 (+ 288us) write_op.cc:270] Start()
0807 18:16:11.641112 (+ 31us) write_op.cc:276] Timestamp: P: 1786126539467853 usec, L: 0
0807 18:16:11.641322 (+ 210us) write_op.cc:270] Start()
0807 18:16:11.641350 (+ 28us) write_op.cc:276] Timestamp: P: 1786126539477875 usec, L: 0
0807 18:16:11.641675 (+ 325us) write_op.cc:270] Start()
0807 18:16:11.641703 (+ 28us) write_op.cc:276] Timestamp: P: 1786126539500019 usec, L: 0
0807 18:16:11.642343 (+ 640us) write_op.cc:270] Start()
0807 18:16:11.642456 (+ 113us) write_op.cc:276] Timestamp: P: 1786126539548516 usec, L: 0
0807 18:16:11.646324 (+ 3868us) write_op.cc:270] Start()
0807 18:16:11.646360 (+ 36us) write_op.cc:276] Timestamp: P: 1786126539553814 usec, L: 0
0807 18:16:11.646893 (+ 533us) write_op.cc:270] Start()
0807 18:16:11.647011 (+ 118us) write_op.cc:276] Timestamp: P: 1786126539564803 usec, L: 0
0807 18:16:11.647386 (+ 375us) write_op.cc:270] Start()
0807 18:16:11.647427 (+ 41us) write_op.cc:276] Timestamp: P: 1786126539573381 usec, L: 0
0807 18:16:11.647602 (+ 175us) write_op.cc:270] Start()
0807 18:16:11.647626 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539655603 usec, L: 0
0807 18:16:11.647880 (+ 254us) write_op.cc:270] Start()
0807 18:16:11.647908 (+ 28us) write_op.cc:276] Timestamp: P: 1786126539659881 usec, L: 0
0807 18:16:11.648097 (+ 189us) write_op.cc:270] Start()
0807 18:16:11.648121 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539672075 usec, L: 0
0807 18:16:11.648345 (+ 224us) write_op.cc:270] Start()
0807 18:16:11.648369 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539698292 usec, L: 0
0807 18:16:11.648644 (+ 275us) write_op.cc:270] Start()
0807 18:16:11.648686 (+ 42us) write_op.cc:276] Timestamp: P: 1786126539710200 usec, L: 0
0807 18:16:11.649972 (+ 1286us) write_op.cc:270] Start()
0807 18:16:11.650140 (+ 168us) write_op.cc:276] Timestamp: P: 1786126539755278 usec, L: 0
0807 18:16:11.650412 (+ 272us) write_op.cc:270] Start()
0807 18:16:11.650438 (+ 26us) write_op.cc:276] Timestamp: P: 1786126539759824 usec, L: 0
0807 18:16:11.659094 (+ 8656us) write_op.cc:270] Start()
0807 18:16:11.659134 (+ 40us) write_op.cc:276] Timestamp: P: 1786126539765189 usec, L: 0
0807 18:16:11.659438 (+ 304us) write_op.cc:270] Start()
0807 18:16:11.659674 (+ 236us) write_op.cc:276] Timestamp: P: 1786126539790212 usec, L: 0
0807 18:16:11.659912 (+ 238us) write_op.cc:270] Start()
0807 18:16:11.659939 (+ 27us) write_op.cc:276] Timestamp: P: 1786126539817688 usec, L: 0
0807 18:16:11.660310 (+ 371us) write_op.cc:270] Start()
0807 18:16:11.660338 (+ 28us) write_op.cc:276] Timestamp: P: 1786126539828241 usec, L: 0
0807 18:16:11.660600 (+ 262us) write_op.cc:270] Start()
0807 18:16:11.660645 (+ 45us) write_op.cc:276] Timestamp: P: 1786126539849256 usec, L: 0
0807 18:16:11.660936 (+ 291us) write_op.cc:270] Start()
0807 18:16:11.660963 (+ 27us) write_op.cc:276] Timestamp: P: 1786126539851948 usec, L: 0
0807 18:16:11.661480 (+ 517us) write_op.cc:270] Start()
0807 18:16:11.661508 (+ 28us) write_op.cc:276] Timestamp: P: 1786126539868281 usec, L: 0
0807 18:16:11.661763 (+ 255us) write_op.cc:270] Start()
0807 18:16:11.661802 (+ 39us) write_op.cc:276] Timestamp: P: 1786126539900613 usec, L: 0
0807 18:16:11.661994 (+ 192us) write_op.cc:270] Start()
0807 18:16:11.662038 (+ 44us) write_op.cc:276] Timestamp: P: 1786126539936911 usec, L: 0
0807 18:16:11.662261 (+ 223us) write_op.cc:270] Start()
0807 18:16:11.662283 (+ 22us) write_op.cc:276] Timestamp: P: 1786126539963701 usec, L: 0
0807 18:16:11.662556 (+ 273us) write_op.cc:270] Start()
0807 18:16:11.662595 (+ 39us) write_op.cc:276] Timestamp: P: 1786126540004747 usec, L: 0
0807 18:16:11.662790 (+ 195us) write_op.cc:270] Start()
0807 18:16:11.662814 (+ 24us) write_op.cc:276] Timestamp: P: 1786126540008550 usec, L: 0
0807 18:16:11.663059 (+ 245us) write_op.cc:270] Start()
0807 18:16:11.663183 (+ 124us) write_op.cc:276] Timestamp: P: 1786126540035662 usec, L: 0
0807 18:16:11.663424 (+ 241us) write_op.cc:270] Start()
0807 18:16:11.663470 (+ 46us) write_op.cc:276] Timestamp: P: 1786126540074454 usec, L: 0
0807 18:16:11.663659 (+ 189us) write_op.cc:270] Start()
0807 18:16:11.663681 (+ 22us) write_op.cc:276] Timestamp: P: 1786126540080178 usec, L: 0
0807 18:16:11.675461 (+ 11780us) write_op.cc:270] Start()
0807 18:16:11.675531 (+ 70us) write_op.cc:276] Timestamp: P: 1786126540081128 usec, L: 0
0807 18:16:11.676010 (+ 479us) write_op.cc:270] Start()
0807 18:16:11.676043 (+ 33us) write_op.cc:276] Timestamp: P: 1786126540083045 usec, L: 0
0807 18:16:11.676224 (+ 181us) write_op.cc:270] Start()
0807 18:16:11.676245 (+ 21us) write_op.cc:276] Timestamp: P: 1786126540127242 usec, L: 0
0807 18:16:11.677014 (+ 769us) write_op.cc:270] Start()
0807 18:16:11.677050 (+ 36us) write_op.cc:276] Timestamp: P: 1786126540149603 usec, L: 0
0807 18:16:11.677362 (+ 312us) write_op.cc:270] Start()
0807 18:16:11.677407 (+ 45us) write_op.cc:276] Timestamp: P: 1786126540157572 usec, L: 0
0807 18:16:11.677639 (+ 232us) write_op.cc:270] Start()
0807 18:16:11.677915 (+ 276us) write_op.cc:276] Timestamp: P: 1786126540215052 usec, L: 0
0807 18:16:11.678192 (+ 277us) write_op.cc:270] Start()
0807 18:16:11.678219 (+ 27us) write_op.cc:276] Timestamp: P: 1786126540222989 usec, L: 0
0807 18:16:11.685895 (+ 7676us) write_op.cc:270] Start()
0807 18:16:11.685943 (+ 48us) write_op.cc:276] Timestamp: P: 1786126540225396 usec, L: 0
0807 18:16:11.686259 (+ 316us) write_op.cc:270] Start()
0807 18:16:11.686291 (+ 32us) write_op.cc:276] Timestamp: P: 1786126540236000 usec, L: 0
0807 18:16:11.686575 (+ 284us) write_op.cc:270] Start()
0807 18:16:11.686606 (+ 31us) write_op.cc:276] Timestamp: P: 1786126540297744 usec, L: 0
0807 18:16:11.686967 (+ 361us) write_op.cc:270] Start()
0807 18:16:11.687021 (+ 54us) write_op.cc:276] Timestamp: P: 1786126540299018 usec, L: 0
0807 18:16:11.687374 (+ 353us) write_op.cc:270] Start()
0807 18:16:11.687407 (+ 33us) write_op.cc:276] Timestamp: P: 1786126540303735 usec, L: 0
0807 18:16:11.687693 (+ 286us) write_op.cc:270] Start()
0807 18:16:11.687721 (+ 28us) write_op.cc:276] Timestamp: P: 1786126540322211 usec, L: 0
0807 18:16:11.688153 (+ 432us) write_op.cc:270] Start()
0807 18:16:11.688183 (+ 30us) write_op.cc:276] Timestamp: P: 1786126540365532 usec, L: 0
0807 18:16:11.688448 (+ 265us) write_op.cc:270] Start()
0807 18:16:11.688478 (+ 30us) write_op.cc:276] Timestamp: P: 1786126540369655 usec, L: 0
0807 18:16:11.688854 (+ 376us) write_op.cc:270] Start()
0807 18:16:11.688889 (+ 35us) write_op.cc:276] Timestamp: P: 1786126540399014 usec, L: 0
0807 18:16:11.689134 (+ 245us) write_op.cc:270] Start()
0807 18:16:11.689171 (+ 37us) write_op.cc:276] Timestamp: P: 1786126540410162 usec, L: 0
0807 18:16:11.689644 (+ 473us) write_op.cc:270] Start()
0807 18:16:11.689679 (+ 35us) write_op.cc:276] Timestamp: P: 1786126540438796 usec, L: 0
0807 18:16:11.689869 (+ 190us) write_op.cc:270] Start()
0807 18:16:11.689895 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540439904 usec, L: 0
0807 18:16:11.690137 (+ 242us) write_op.cc:270] Start()
0807 18:16:11.690163 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540481528 usec, L: 0
0807 18:16:11.699602 (+ 9439us) write_op.cc:270] Start()
0807 18:16:11.699658 (+ 56us) write_op.cc:276] Timestamp: P: 1786126540512869 usec, L: 0
0807 18:16:11.700048 (+ 390us) write_op.cc:270] Start()
0807 18:16:11.700094 (+ 46us) write_op.cc:276] Timestamp: P: 1786126540524526 usec, L: 0
0807 18:16:11.700440 (+ 346us) write_op.cc:270] Start()
0807 18:16:11.700470 (+ 30us) write_op.cc:276] Timestamp: P: 1786126540537736 usec, L: 0
0807 18:16:11.715190 (+ 14720us) write_op.cc:270] Start()
0807 18:16:11.715242 (+ 52us) write_op.cc:276] Timestamp: P: 1786126540554537 usec, L: 0
0807 18:16:11.715620 (+ 378us) write_op.cc:270] Start()
0807 18:16:11.715648 (+ 28us) write_op.cc:276] Timestamp: P: 1786126540613721 usec, L: 0
0807 18:16:11.715878 (+ 230us) write_op.cc:270] Start()
0807 18:16:11.715917 (+ 39us) write_op.cc:276] Timestamp: P: 1786126540614776 usec, L: 0
0807 18:16:11.716092 (+ 175us) write_op.cc:270] Start()
0807 18:16:11.716115 (+ 23us) write_op.cc:276] Timestamp: P: 1786126540623367 usec, L: 0
0807 18:16:11.716355 (+ 240us) write_op.cc:270] Start()
0807 18:16:11.716384 (+ 29us) write_op.cc:276] Timestamp: P: 1786126540686879 usec, L: 0
0807 18:16:11.718324 (+ 1940us) write_op.cc:270] Start()
0807 18:16:11.718414 (+ 90us) write_op.cc:276] Timestamp: P: 1786126540688100 usec, L: 0
0807 18:16:11.718855 (+ 441us) write_op.cc:270] Start()
0807 18:16:11.718899 (+ 44us) write_op.cc:276] Timestamp: P: 1786126540707406 usec, L: 0
0807 18:16:11.724793 (+ 5894us) write_op.cc:270] Start()
0807 18:16:11.724836 (+ 43us) write_op.cc:276] Timestamp: P: 1786126540714600 usec, L: 0
0807 18:16:11.725403 (+ 567us) write_op.cc:270] Start()
0807 18:16:11.725439 (+ 36us) write_op.cc:276] Timestamp: P: 1786126540784279 usec, L: 0
0807 18:16:11.725692 (+ 253us) write_op.cc:270] Start()
0807 18:16:11.725739 (+ 47us) write_op.cc:276] Timestamp: P: 1786126540791399 usec, L: 0
0807 18:16:11.726036 (+ 297us) write_op.cc:270] Start()
0807 18:16:11.726067 (+ 31us) write_op.cc:276] Timestamp: P: 1786126540794136 usec, L: 0
0807 18:16:11.726389 (+ 322us) write_op.cc:270] Start()
0807 18:16:11.726421 (+ 32us) write_op.cc:276] Timestamp: P: 1786126540798632 usec, L: 0
0807 18:16:11.726695 (+ 274us) write_op.cc:270] Start()
0807 18:16:11.726723 (+ 28us) write_op.cc:276] Timestamp: P: 1786126540850786 usec, L: 0
0807 18:16:11.727008 (+ 285us) write_op.cc:270] Start()
0807 18:16:11.727035 (+ 27us) write_op.cc:276] Timestamp: P: 1786126540887539 usec, L: 0
0807 18:16:11.727319 (+ 284us) write_op.cc:270] Start()
0807 18:16:11.727347 (+ 28us) write_op.cc:276] Timestamp: P: 1786126540892845 usec, L: 0
0807 18:16:11.727559 (+ 212us) write_op.cc:270] Start()
0807 18:16:11.727585 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540906883 usec, L: 0
0807 18:16:11.727795 (+ 210us) write_op.cc:270] Start()
0807 18:16:11.727823 (+ 28us) write_op.cc:276] Timestamp: P: 1786126540912699 usec, L: 0
0807 18:16:11.728126 (+ 303us) write_op.cc:270] Start()
0807 18:16:11.728153 (+ 27us) write_op.cc:276] Timestamp: P: 1786126540979818 usec, L: 0
0807 18:16:11.728428 (+ 275us) write_op.cc:270] Start()
0807 18:16:11.728453 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541003545 usec, L: 0
0807 18:16:11.728676 (+ 223us) write_op.cc:270] Start()
0807 18:16:11.728701 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541005988 usec, L: 0
0807 18:16:11.728961 (+ 260us) write_op.cc:270] Start()
0807 18:16:11.728989 (+ 28us) write_op.cc:276] Timestamp: P: 1786126541014884 usec, L: 0
0807 18:16:11.729222 (+ 233us) write_op.cc:270] Start()
0807 18:16:11.729248 (+ 26us) write_op.cc:276] Timestamp: P: 1786126541027254 usec, L: 0
0807 18:16:11.729406 (+ 158us) write_op.cc:270] Start()
0807 18:16:11.729431 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541042645 usec, L: 0
0807 18:16:11.746052 (+ 16621us) write_op.cc:270] Start()
0807 18:16:11.746121 (+ 69us) write_op.cc:276] Timestamp: P: 1786126541114082 usec, L: 0
0807 18:16:11.746644 (+ 523us) write_op.cc:270] Start()
0807 18:16:11.746674 (+ 30us) write_op.cc:276] Timestamp: P: 1786126541119638 usec, L: 0
0807 18:16:11.746862 (+ 188us) write_op.cc:270] Start()
0807 18:16:11.746883 (+ 21us) write_op.cc:276] Timestamp: P: 1786126541141646 usec, L: 0
0807 18:16:11.747339 (+ 456us) write_op.cc:270] Start()
0807 18:16:11.765617 (+ 18278us) write_op.cc:276] Timestamp: P: 1786126541152876 usec, L: 0
0807 18:16:11.765911 (+ 294us) write_op.cc:270] Start()
0807 18:16:11.765942 (+ 31us) write_op.cc:276] Timestamp: P: 1786126541184201 usec, L: 0
0807 18:16:11.782744 (+ 16802us) write_op.cc:270] Start()
0807 18:16:11.782801 (+ 57us) write_op.cc:276] Timestamp: P: 1786126541194486 usec, L: 0
0807 18:16:11.783317 (+ 516us) write_op.cc:270] Start()
0807 18:16:11.783352 (+ 35us) write_op.cc:276] Timestamp: P: 1786126541206224 usec, L: 0
0807 18:16:11.783548 (+ 196us) write_op.cc:270] Start()
0807 18:16:11.783574 (+ 26us) write_op.cc:276] Timestamp: P: 1786126541218855 usec, L: 0
0807 18:16:11.783976 (+ 402us) write_op.cc:270] Start()
0807 18:16:11.784006 (+ 30us) write_op.cc:276] Timestamp: P: 1786126541272104 usec, L: 0
0807 18:16:11.784958 (+ 952us) write_op.cc:270] Start()
0807 18:16:11.785001 (+ 43us) write_op.cc:276] Timestamp: P: 1786126541276646 usec, L: 0
0807 18:16:11.785231 (+ 230us) write_op.cc:270] Start()
0807 18:16:11.785257 (+ 26us) write_op.cc:276] Timestamp: P: 1786126541277614 usec, L: 0
0807 18:16:11.785493 (+ 236us) write_op.cc:270] Start()
0807 18:16:11.785582 (+ 89us) write_op.cc:276] Timestamp: P: 1786126541298425 usec, L: 0
0807 18:16:11.786191 (+ 609us) write_op.cc:270] Start()
0807 18:16:11.786245 (+ 54us) write_op.cc:276] Timestamp: P: 1786126541325971 usec, L: 0
0807 18:16:11.786479 (+ 234us) write_op.cc:270] Start()
0807 18:16:11.786510 (+ 31us) write_op.cc:276] Timestamp: P: 1786126541352074 usec, L: 0
0807 18:16:11.786786 (+ 276us) write_op.cc:270] Start()
0807 18:16:11.786815 (+ 29us) write_op.cc:276] Timestamp: P: 1786126541373657 usec, L: 0
0807 18:16:11.786995 (+ 180us) write_op.cc:270] Start()
0807 18:16:11.787026 (+ 31us) write_op.cc:276] Timestamp: P: 1786126541386652 usec, L: 0
0807 18:16:11.787252 (+ 226us) write_op.cc:270] Start()
0807 18:16:11.787280 (+ 28us) write_op.cc:276] Timestamp: P: 1786126541390134 usec, L: 0
0807 18:16:11.803444 (+ 16164us) write_op.cc:270] Start()
0807 18:16:11.803487 (+ 43us) write_op.cc:276] Timestamp: P: 1786126541421481 usec, L: 0
0807 18:16:11.804089 (+ 602us) write_op.cc:270] Start()
0807 18:16:11.804183 (+ 94us) write_op.cc:276] Timestamp: P: 1786126541471629 usec, L: 0
0807 18:16:11.807447 (+ 3264us) write_op.cc:270] Start()
0807 18:16:11.807488 (+ 41us) write_op.cc:276] Timestamp: P: 1786126541479038 usec, L: 0
0807 18:16:11.807765 (+ 277us) write_op.cc:270] Start()
0807 18:16:11.807792 (+ 27us) write_op.cc:276] Timestamp: P: 1786126541505655 usec, L: 0
0807 18:16:11.808079 (+ 287us) write_op.cc:270] Start()
0807 18:16:11.808192 (+ 113us) write_op.cc:276] Timestamp: P: 1786126541509412 usec, L: 0
0807 18:16:11.808461 (+ 269us) write_op.cc:270] Start()
0807 18:16:11.808573 (+ 112us) write_op.cc:276] Timestamp: P: 1786126541532028 usec, L: 0
0807 18:16:11.809281 (+ 708us) write_op.cc:270] Start()
0807 18:16:11.809336 (+ 55us) write_op.cc:276] Timestamp: P: 1786126541548059 usec, L: 0
0807 18:16:11.809681 (+ 345us) write_op.cc:270] Start()
0807 18:16:11.809711 (+ 30us) write_op.cc:276] Timestamp: P: 1786126541590472 usec, L: 0
0807 18:16:11.809937 (+ 226us) write_op.cc:270] Start()
0807 18:16:11.809964 (+ 27us) write_op.cc:276] Timestamp: P: 1786126541623412 usec, L: 0
0807 18:16:11.810123 (+ 159us) write_op.cc:270] Start()
0807 18:16:11.810163 (+ 40us) write_op.cc:276] Timestamp: P: 1786126541624230 usec, L: 0
0807 18:16:11.827286 (+ 17123us) write_op.cc:270] Start()
0807 18:16:11.832224 (+ 4938us) write_op.cc:276] Timestamp: P: 1786126541627022 usec, L: 0
0807 18:16:11.844751 (+ 12527us) write_op.cc:270] Start()
0807 18:16:11.844811 (+ 60us) write_op.cc:276] Timestamp: P: 1786126541651723 usec, L: 0
0807 18:16:11.850260 (+ 5449us) write_op.cc:270] Start()
0807 18:16:11.850299 (+ 39us) write_op.cc:276] Timestamp: P: 1786126541734894 usec, L: 0
0807 18:16:11.850972 (+ 673us) write_op.cc:270] Start()
0807 18:16:11.851005 (+ 33us) write_op.cc:276] Timestamp: P: 1786126541739610 usec, L: 0
0807 18:16:11.851210 (+ 205us) write_op.cc:270] Start()
0807 18:16:11.851235 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541777100 usec, L: 0
0807 18:16:11.851500 (+ 265us) write_op.cc:270] Start()
0807 18:16:11.851529 (+ 29us) write_op.cc:276] Timestamp: P: 1786126541779220 usec, L: 0
0807 18:16:11.852492 (+ 963us) write_op.cc:270] Start()
0807 18:16:11.852526 (+ 34us) write_op.cc:276] Timestamp: P: 1786126541801857 usec, L: 0
0807 18:16:11.852716 (+ 190us) write_op.cc:270] Start()
0807 18:16:11.852741 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541846644 usec, L: 0
0807 18:16:11.855410 (+ 2669us) write_op.cc:270] Start()
0807 18:16:11.855442 (+ 32us) write_op.cc:276] Timestamp: P: 1786126541855295 usec, L: 0
0807 18:16:11.855679 (+ 237us) write_op.cc:270] Start()
0807 18:16:11.864187 (+ 8508us) write_op.cc:276] Timestamp: P: 1786126541870758 usec, L: 0
0807 18:16:11.865217 (+ 1030us) write_op.cc:270] Start()
0807 18:16:11.865257 (+ 40us) write_op.cc:276] Timestamp: P: 1786126541928379 usec, L: 0
0807 18:16:11.865655 (+ 398us) write_op.cc:270] Start()
0807 18:16:11.865686 (+ 31us) write_op.cc:276] Timestamp: P: 1786126542003605 usec, L: 0
0807 18:16:11.865878 (+ 192us) write_op.cc:270] Start()
0807 18:16:11.865905 (+ 27us) write_op.cc:276] Timestamp: P: 1786126542008677 usec, L: 0
0807 18:16:11.866255 (+ 350us) write_op.cc:270] Start()
0807 18:16:11.866287 (+ 32us) write_op.cc:276] Timestamp: P: 1786126542019205 usec, L: 0
0807 18:16:11.866595 (+ 308us) write_op.cc:270] Start()
0807 18:16:11.866629 (+ 34us) write_op.cc:276] Timestamp: P: 1786126542022490 usec, L: 0
0807 18:16:11.866887 (+ 258us) write_op.cc:270] Start()
0807 18:16:11.866913 (+ 26us) write_op.cc:276] Timestamp: P: 1786126542100455 usec, L: 0
0807 18:16:11.867158 (+ 245us) write_op.cc:270] Start()
0807 18:16:11.867180 (+ 22us) write_op.cc:276] Timestamp: P: 1786126542136248 usec, L: 0
0807 18:16:11.867338 (+ 158us) write_op.cc:270] Start()
0807 18:16:11.867359 (+ 21us) write_op.cc:276] Timestamp: P: 1786126542138330 usec, L: 0
0807 18:16:11.867553 (+ 194us) write_op.cc:270] Start()
0807 18:16:11.867576 (+ 23us) write_op.cc:276] Timestamp: P: 1786126542173064 usec, L: 0
0807 18:16:11.868000 (+ 424us) write_op.cc:270] Start()
0807 18:16:11.868027 (+ 27us) write_op.cc:276] Timestamp: P: 1786126542187865 usec, L: 0
0807 18:16:11.935235 (+ 67208us) write_op.cc:270] Start()
0807 18:16:11.942762 (+ 7527us) write_op.cc:276] Timestamp: P: 1786126542237789 usec, L: 0
0807 18:16:11.943333 (+ 571us) write_op.cc:270] Start()
0807 18:16:11.943374 (+ 41us) write_op.cc:276] Timestamp: P: 1786126542244749 usec, L: 0
0807 18:16:11.943665 (+ 291us) write_op.cc:270] Start()
0807 18:16:11.943821 (+ 156us) write_op.cc:276] Timestamp: P: 1786126542254151 usec, L: 0
0807 18:16:11.944147 (+ 326us) write_op.cc:270] Start()
0807 18:16:11.944255 (+ 108us) write_op.cc:276] Timestamp: P: 1786126542300060 usec, L: 0
0807 18:16:11.944508 (+ 253us) write_op.cc:270] Start()
0807 18:16:11.944535 (+ 27us) write_op.cc:276] Timestamp: P: 1786126542320773 usec, L: 0
0807 18:16:11.944766 (+ 231us) write_op.cc:270] Start()
0807 18:16:11.944793 (+ 27us) write_op.cc:276] Timestamp: P: 1786126542370220 usec, L: 0
0807 18:16:11.945004 (+ 211us) write_op.cc:270] Start()
0807 18:16:11.945029 (+ 25us) write_op.cc:276] Timestamp: P: 1786126542377375 usec, L: 0
0807 18:16:11.945334 (+ 305us) write_op.cc:270] Start()
0807 18:16:11.945364 (+ 30us) write_op.cc:276] Timestamp: P: 1786126542411876 usec, L: 0
0807 18:16:11.945574 (+ 210us) write_op.cc:270] Start()
0807 18:16:11.945597 (+ 23us) write_op.cc:276] Timestamp: P: 1786126542430713 usec, L: 0
0807 18:16:11.945866 (+ 269us) write_op.cc:270] Start()
0807 18:16:11.945892 (+ 26us) write_op.cc:276] Timestamp: P: 1786126542441597 usec, L: 0
0807 18:16:11.946046 (+ 154us) write_op.cc:270] Start()
0807 18:16:11.946067 (+ 21us) write_op.cc:276] Timestamp: P: 1786126542460956 usec, L: 0
0807 18:16:11.946330 (+ 263us) write_op.cc:270] Start()
0807 18:16:11.946353 (+ 23us) write_op.cc:276] Timestamp: P: 1786126542536131 usec, L: 0
0807 18:16:12.021153 (+ 74800us) write_op.cc:270] Start()
0807 18:16:12.021213 (+ 60us) write_op.cc:276] Timestamp: P: 1786126542547210 usec, L: 0
0807 18:16:12.021684 (+ 471us) write_op.cc:270] Start()
0807 18:16:12.021718 (+ 34us) write_op.cc:276] Timestamp: P: 1786126542559680 usec, L: 0
0807 18:16:12.021900 (+ 182us) write_op.cc:270] Start()
0807 18:16:12.021926 (+ 26us) write_op.cc:276] Timestamp: P: 1786126542575011 usec, L: 0
0807 18:16:12.022199 (+ 273us) write_op.cc:270] Start()
0807 18:16:12.022242 (+ 43us) write_op.cc:276] Timestamp: P: 1786126542631226 usec, L: 0
0807 18:16:12.022506 (+ 264us) write_op.cc:270] Start()
0807 18:16:12.022573 (+ 67us) write_op.cc:276] Timestamp: P: 1786126542633343 usec, L: 0
0807 18:16:12.022939 (+ 366us) write_op.cc:270] Start()
0807 18:16:12.022970 (+ 31us) write_op.cc:276] Timestamp: P: 1786126542644569 usec, L: 0
0807 18:16:12.023304 (+ 334us) write_op.cc:270] Start()
0807 18:16:12.023336 (+ 32us) write_op.cc:276] Timestamp: P: 1786126542676289 usec, L: 0
0807 18:16:12.023534 (+ 198us) write_op.cc:270] Start()
0807 18:16:12.023559 (+ 25us) write_op.cc:276] Timestamp: P: 1786126542724786 usec, L: 0
0807 18:16:12.023797 (+ 238us) write_op.cc:270] Start()
0807 18:16:12.023823 (+ 26us) write_op.cc:276] Timestamp: P: 1786126542756438 usec, L: 0
0807 18:16:12.024042 (+ 219us) write_op.cc:270] Start()
0807 18:16:12.024070 (+ 28us) write_op.cc:276] Timestamp: P: 1786126542775068 usec, L: 0
0807 18:16:12.027325 (+ 3255us) write_op.cc:270] Start()
0807 18:16:12.027369 (+ 44us) write_op.cc:276] Timestamp: P: 1786126542778524 usec, L: 0
0807 18:16:12.076641 (+ 49272us) write_op.cc:270] Start()
0807 18:16:12.076731 (+ 90us) write_op.cc:276] Timestamp: P: 1786126542828407 usec, L: 0
0807 18:16:12.091308 (+ 14577us) write_op.cc:270] Start()
0807 18:16:12.091366 (+ 58us) write_op.cc:276] Timestamp: P: 1786126542836626 usec, L: 0
0807 18:16:12.091793 (+ 427us) write_op.cc:270] Start()
0807 18:16:12.091829 (+ 36us) write_op.cc:276] Timestamp: P: 1786126542857359 usec, L: 0
0807 18:16:12.104030 (+ 12201us) write_op.cc:270] Start()
0807 18:16:12.104091 (+ 61us) write_op.cc:276] Timestamp: P: 1786126542858863 usec, L: 0
0807 18:16:12.104354 (+ 263us) write_op.cc:270] Start()
0807 18:16:12.104385 (+ 31us) write_op.cc:276] Timestamp: P: 1786126542894314 usec, L: 0
0807 18:16:12.113079 (+ 8694us) write_op.cc:270] Start()
0807 18:16:12.113127 (+ 48us) write_op.cc:276] Timestamp: P: 1786126542903023 usec, L: 0
0807 18:16:12.136829 (+ 23702us) write_op.cc:270] Start()
0807 18:16:12.136879 (+ 50us) write_op.cc:276] Timestamp: P: 1786126542934314 usec, L: 0
0807 18:16:12.137208 (+ 329us) write_op.cc:270] Start()
0807 18:16:12.137239 (+ 31us) write_op.cc:276] Timestamp: P: 1786
W20260807 18:16:16.684145 13118 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:16.730331 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
I20260807 18:16:12.867436 13261 rpcz_store.cc:276] 0807 18:16:09.723123 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:09.730010 (+ 6887us) service_pool.cc:227] Handling call
0807 18:16:09.996036 (+266026us) raft_consensus.cc:1457] Updating replica for 1017 ops
0807 18:16:10.125644 (+129608us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 18:16:10.125655 (+ 11us) raft_consensus.cc:1525] Triggering prepare for 1017 ops
0807 18:16:10.126207 (+ 552us) write_op.cc:270] Start()
0807 18:16:10.126299 (+ 92us) write_op.cc:276] Timestamp: P: 1786126538005331 usec, L: 0
0807 18:16:10.134910 (+ 8611us) write_op.cc:270] Start()
0807 18:16:10.134955 (+ 45us) write_op.cc:276] Timestamp: P: 1786126538056344 usec, L: 0
0807 18:16:10.135464 (+ 509us) write_op.cc:270] Start()
0807 18:16:10.135504 (+ 40us) write_op.cc:276] Timestamp: P: 1786126538096155 usec, L: 0
0807 18:16:10.135740 (+ 236us) write_op.cc:270] Start()
0807 18:16:10.135765 (+ 25us) write_op.cc:276] Timestamp: P: 1786126538099320 usec, L: 0
0807 18:16:10.136045 (+ 280us) write_op.cc:270] Start()
0807 18:16:10.136071 (+ 26us) write_op.cc:276] Timestamp: P: 1786126538114766 usec, L: 0
0807 18:16:10.136328 (+ 257us) write_op.cc:270] Start()
0807 18:16:10.136379 (+ 51us) write_op.cc:276] Timestamp: P: 1786126538153031 usec, L: 0
0807 18:16:10.136648 (+ 269us) write_op.cc:270] Start()
0807 18:16:10.136765 (+ 117us) write_op.cc:276] Timestamp: P: 1786126538241334 usec, L: 0
0807 18:16:10.156504 (+ 19739us) write_op.cc:270] Start()
0807 18:16:10.156650 (+ 146us) write_op.cc:276] Timestamp: P: 1786126538262865 usec, L: 0
0807 18:16:10.157214 (+ 564us) write_op.cc:270] Start()
0807 18:16:10.157245 (+ 31us) write_op.cc:276] Timestamp: P: 1786126538326374 usec, L: 0
0807 18:16:10.157758 (+ 513us) write_op.cc:270] Start()
0807 18:16:10.157795 (+ 37us) write_op.cc:276] Timestamp: P: 1786126538368156 usec, L: 0
0807 18:16:10.158115 (+ 320us) write_op.cc:270] Start()
0807 18:16:10.158184 (+ 69us) write_op.cc:276] Timestamp: P: 1786126538399283 usec, L: 0
0807 18:16:10.158474 (+ 290us) write_op.cc:270] Start()
0807 18:16:10.158516 (+ 42us) write_op.cc:276] Timestamp: P: 1786126538428321 usec, L: 0
0807 18:16:10.158810 (+ 294us) write_op.cc:270] Start()
0807 18:16:10.158851 (+ 41us) write_op.cc:276] Timestamp: P: 1786126538467737 usec, L: 0
0807 18:16:10.159050 (+ 199us) write_op.cc:270] Start()
0807 18:16:10.159075 (+ 25us) write_op.cc:276] Timestamp: P: 1786126538484911 usec, L: 0
0807 18:16:10.159294 (+ 219us) write_op.cc:270] Start()
0807 18:16:10.159320 (+ 26us) write_op.cc:276] Timestamp: P: 1786126538507738 usec, L: 0
0807 18:16:10.159647 (+ 327us) write_op.cc:270] Start()
0807 18:16:10.159677 (+ 30us) write_op.cc:276] Timestamp: P: 1786126538565725 usec, L: 0
0807 18:16:10.174854 (+ 15177us) write_op.cc:270] Start()
0807 18:16:10.174909 (+ 55us) write_op.cc:276] Timestamp: P: 1786126538596954 usec, L: 0
0807 18:16:10.175146 (+ 237us) write_op.cc:270] Start()
0807 18:16:10.175167 (+ 21us) write_op.cc:276] Timestamp: P: 1786126538599662 usec, L: 0
0807 18:16:10.175339 (+ 172us) write_op.cc:270] Start()
0807 18:16:10.175359 (+ 20us) write_op.cc:276] Timestamp: P: 1786126538609789 usec, L: 0
0807 18:16:10.175531 (+ 172us) write_op.cc:270] Start()
0807 18:16:10.175551 (+ 20us) write_op.cc:276] Timestamp: P: 1786126538642860 usec, L: 0
0807 18:16:10.175739 (+ 188us) write_op.cc:270] Start()
0807 18:16:10.175759 (+ 20us) write_op.cc:276] Timestamp: P: 1786126538704085 usec, L: 0
0807 18:16:10.175923 (+ 164us) write_op.cc:270] Start()
0807 18:16:10.175983 (+ 60us) write_op.cc:276] Timestamp: P: 1786126538705750 usec, L: 0
0807 18:16:10.176235 (+ 252us) write_op.cc:270] Start()
0807 18:16:10.176258 (+ 23us) write_op.cc:276] Timestamp: P: 1786126538737665 usec, L: 0
0807 18:16:10.176427 (+ 169us) write_op.cc:270] Start()
0807 18:16:10.176488 (+ 61us) write_op.cc:276] Timestamp: P: 1786126538778320 usec, L: 0
0807 18:16:10.176720 (+ 232us) write_op.cc:270] Start()
0807 18:16:10.176743 (+ 23us) write_op.cc:276] Timestamp: P: 1786126538821756 usec, L: 0
0807 18:16:10.176987 (+ 244us) write_op.cc:270] Start()
0807 18:16:10.177007 (+ 20us) write_op.cc:276] Timestamp: P: 1786126538836374 usec, L: 0
0807 18:16:10.177244 (+ 237us) write_op.cc:270] Start()
0807 18:16:10.177265 (+ 21us) write_op.cc:276] Timestamp: P: 1786126538850833 usec, L: 0
0807 18:16:10.183268 (+ 6003us) write_op.cc:270] Start()
0807 18:16:10.183308 (+ 40us) write_op.cc:276] Timestamp: P: 1786126538869409 usec, L: 0
0807 18:16:10.184352 (+ 1044us) write_op.cc:270] Start()
0807 18:16:10.184387 (+ 35us) write_op.cc:276] Timestamp: P: 1786126538920147 usec, L: 0
0807 18:16:10.184644 (+ 257us) write_op.cc:270] Start()
0807 18:16:10.184669 (+ 25us) write_op.cc:276] Timestamp: P: 1786126538922172 usec, L: 0
0807 18:16:10.184884 (+ 215us) write_op.cc:270] Start()
0807 18:16:10.184908 (+ 24us) write_op.cc:276] Timestamp: P: 1786126538925946 usec, L: 0
0807 18:16:10.185083 (+ 175us) write_op.cc:270] Start()
0807 18:16:10.185106 (+ 23us) write_op.cc:276] Timestamp: P: 1786126538926909 usec, L: 0
0807 18:16:10.196133 (+ 11027us) write_op.cc:270] Start()
0807 18:16:10.196168 (+ 35us) write_op.cc:276] Timestamp: P: 1786126539010886 usec, L: 0
0807 18:16:10.196395 (+ 227us) write_op.cc:270] Start()
0807 18:16:10.196418 (+ 23us) write_op.cc:276] Timestamp: P: 1786126539025542 usec, L: 0
0807 18:16:10.196556 (+ 138us) write_op.cc:270] Start()
0807 18:16:10.196577 (+ 21us) write_op.cc:276] Timestamp: P: 1786126539031644 usec, L: 0
0807 18:16:10.196823 (+ 246us) write_op.cc:270] Start()
0807 18:16:10.196848 (+ 25us) write_op.cc:276] Timestamp: P: 1786126539038470 usec, L: 0
0807 18:16:10.197036 (+ 188us) write_op.cc:270] Start()
0807 18:16:10.197095 (+ 59us) write_op.cc:276] Timestamp: P: 1786126539081887 usec, L: 0
0807 18:16:10.197310 (+ 215us) write_op.cc:270] Start()
0807 18:16:10.197335 (+ 25us) write_op.cc:276] Timestamp: P: 1786126539093053 usec, L: 0
0807 18:16:10.197525 (+ 190us) write_op.cc:270] Start()
0807 18:16:10.197547 (+ 22us) write_op.cc:276] Timestamp: P: 1786126539117414 usec, L: 0
0807 18:16:10.197724 (+ 177us) write_op.cc:270] Start()
0807 18:16:10.197748 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539125425 usec, L: 0
0807 18:16:10.198146 (+ 398us) write_op.cc:270] Start()
0807 18:16:10.198176 (+ 30us) write_op.cc:276] Timestamp: P: 1786126539140189 usec, L: 0
0807 18:16:10.198343 (+ 167us) write_op.cc:270] Start()
0807 18:16:10.198375 (+ 32us) write_op.cc:276] Timestamp: P: 1786126539191195 usec, L: 0
0807 18:16:10.198531 (+ 156us) write_op.cc:270] Start()
0807 18:16:10.198574 (+ 43us) write_op.cc:276] Timestamp: P: 1786126539205315 usec, L: 0
0807 18:16:10.198763 (+ 189us) write_op.cc:270] Start()
0807 18:16:10.198790 (+ 27us) write_op.cc:276] Timestamp: P: 1786126539209059 usec, L: 0
0807 18:16:10.198943 (+ 153us) write_op.cc:270] Start()
0807 18:16:10.198964 (+ 21us) write_op.cc:276] Timestamp: P: 1786126539231263 usec, L: 0
0807 18:16:10.199212 (+ 248us) write_op.cc:270] Start()
0807 18:16:10.199240 (+ 28us) write_op.cc:276] Timestamp: P: 1786126539237231 usec, L: 0
0807 18:16:10.199406 (+ 166us) write_op.cc:270] Start()
0807 18:16:10.199429 (+ 23us) write_op.cc:276] Timestamp: P: 1786126539260026 usec, L: 0
0807 18:16:10.199588 (+ 159us) write_op.cc:270] Start()
0807 18:16:10.199622 (+ 34us) write_op.cc:276] Timestamp: P: 1786126539336793 usec, L: 0
0807 18:16:10.199773 (+ 151us) write_op.cc:270] Start()
0807 18:16:10.199794 (+ 21us) write_op.cc:276] Timestamp: P: 1786126539355340 usec, L: 0
0807 18:16:10.199958 (+ 164us) write_op.cc:270] Start()
0807 18:16:10.199981 (+ 23us) write_op.cc:276] Timestamp: P: 1786126539375164 usec, L: 0
0807 18:16:10.204850 (+ 4869us) write_op.cc:270] Start()
0807 18:16:10.204890 (+ 40us) write_op.cc:276] Timestamp: P: 1786126539377086 usec, L: 0
0807 18:16:10.205147 (+ 257us) write_op.cc:270] Start()
0807 18:16:10.205171 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539383436 usec, L: 0
0807 18:16:10.205348 (+ 177us) write_op.cc:270] Start()
0807 18:16:10.205368 (+ 20us) write_op.cc:276] Timestamp: P: 1786126539445647 usec, L: 0
0807 18:16:10.205613 (+ 245us) write_op.cc:270] Start()
0807 18:16:10.205636 (+ 23us) write_op.cc:276] Timestamp: P: 1786126539465747 usec, L: 0
0807 18:16:10.205795 (+ 159us) write_op.cc:270] Start()
0807 18:16:10.205819 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539469093 usec, L: 0
0807 18:16:10.205974 (+ 155us) write_op.cc:270] Start()
0807 18:16:10.205996 (+ 22us) write_op.cc:276] Timestamp: P: 1786126539475938 usec, L: 0
0807 18:16:10.206184 (+ 188us) write_op.cc:270] Start()
0807 18:16:10.206222 (+ 38us) write_op.cc:276] Timestamp: P: 1786126539501168 usec, L: 0
0807 18:16:10.206412 (+ 190us) write_op.cc:270] Start()
0807 18:16:10.206432 (+ 20us) write_op.cc:276] Timestamp: P: 1786126539551458 usec, L: 0
0807 18:16:10.206687 (+ 255us) write_op.cc:270] Start()
0807 18:16:10.206725 (+ 38us) write_op.cc:276] Timestamp: P: 1786126539553093 usec, L: 0
0807 18:16:10.206970 (+ 245us) write_op.cc:270] Start()
0807 18:16:10.207032 (+ 62us) write_op.cc:276] Timestamp: P: 1786126539566052 usec, L: 0
0807 18:16:10.207241 (+ 209us) write_op.cc:270] Start()
0807 18:16:10.207262 (+ 21us) write_op.cc:276] Timestamp: P: 1786126539573820 usec, L: 0
0807 18:16:10.207415 (+ 153us) write_op.cc:270] Start()
0807 18:16:10.207433 (+ 18us) write_op.cc:276] Timestamp: P: 1786126539651615 usec, L: 0
0807 18:16:10.207590 (+ 157us) write_op.cc:270] Start()
0807 18:16:10.207620 (+ 30us) write_op.cc:276] Timestamp: P: 1786126539659410 usec, L: 0
0807 18:16:10.207767 (+ 147us) write_op.cc:270] Start()
0807 18:16:10.207786 (+ 19us) write_op.cc:276] Timestamp: P: 1786126539665242 usec, L: 0
0807 18:16:10.208098 (+ 312us) write_op.cc:270] Start()
0807 18:16:10.208125 (+ 27us) write_op.cc:276] Timestamp: P: 1786126539680614 usec, L: 0
0807 18:16:10.208283 (+ 158us) write_op.cc:270] Start()
0807 18:16:10.208303 (+ 20us) write_op.cc:276] Timestamp: P: 1786126539707742 usec, L: 0
0807 18:16:10.208426 (+ 123us) write_op.cc:270] Start()
0807 18:16:10.208444 (+ 18us) write_op.cc:276] Timestamp: P: 1786126539752749 usec, L: 0
0807 18:16:10.208546 (+ 102us) write_op.cc:270] Start()
0807 18:16:10.208561 (+ 15us) write_op.cc:276] Timestamp: P: 1786126539768076 usec, L: 0
0807 18:16:10.208769 (+ 208us) write_op.cc:270] Start()
0807 18:16:10.208788 (+ 19us) write_op.cc:276] Timestamp: P: 1786126539769123 usec, L: 0
0807 18:16:10.208920 (+ 132us) write_op.cc:270] Start()
0807 18:16:10.208937 (+ 17us) write_op.cc:276] Timestamp: P: 1786126539792023 usec, L: 0
0807 18:16:10.209104 (+ 167us) write_op.cc:270] Start()
0807 18:16:10.209128 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539816526 usec, L: 0
0807 18:16:10.209277 (+ 149us) write_op.cc:270] Start()
0807 18:16:10.209297 (+ 20us) write_op.cc:276] Timestamp: P: 1786126539827428 usec, L: 0
0807 18:16:10.209445 (+ 148us) write_op.cc:270] Start()
0807 18:16:10.209466 (+ 21us) write_op.cc:276] Timestamp: P: 1786126539845981 usec, L: 0
0807 18:16:10.209678 (+ 212us) write_op.cc:270] Start()
0807 18:16:10.209711 (+ 33us) write_op.cc:276] Timestamp: P: 1786126539857601 usec, L: 0
0807 18:16:10.209899 (+ 188us) write_op.cc:270] Start()
0807 18:16:10.209921 (+ 22us) write_op.cc:276] Timestamp: P: 1786126539872058 usec, L: 0
0807 18:16:10.210058 (+ 137us) write_op.cc:270] Start()
0807 18:16:10.210079 (+ 21us) write_op.cc:276] Timestamp: P: 1786126539902149 usec, L: 0
0807 18:16:10.210259 (+ 180us) write_op.cc:270] Start()
0807 18:16:10.210282 (+ 23us) write_op.cc:276] Timestamp: P: 1786126539943447 usec, L: 0
0807 18:16:10.210427 (+ 145us) write_op.cc:270] Start()
0807 18:16:10.210447 (+ 20us) write_op.cc:276] Timestamp: P: 1786126539963921 usec, L: 0
0807 18:16:10.210730 (+ 283us) write_op.cc:270] Start()
0807 18:16:10.210814 (+ 84us) write_op.cc:276] Timestamp: P: 1786126540004538 usec, L: 0
0807 18:16:10.211006 (+ 192us) write_op.cc:270] Start()
0807 18:16:10.211027 (+ 21us) write_op.cc:276] Timestamp: P: 1786126540005826 usec, L: 0
0807 18:16:10.234592 (+ 23565us) write_op.cc:270] Start()
0807 18:16:10.234661 (+ 69us) write_op.cc:276] Timestamp: P: 1786126540032266 usec, L: 0
0807 18:16:10.234946 (+ 285us) write_op.cc:270] Start()
0807 18:16:10.234974 (+ 28us) write_op.cc:276] Timestamp: P: 1786126540057927 usec, L: 0
0807 18:16:10.235178 (+ 204us) write_op.cc:270] Start()
0807 18:16:10.235204 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540076021 usec, L: 0
0807 18:16:10.235374 (+ 170us) write_op.cc:270] Start()
0807 18:16:10.235399 (+ 25us) write_op.cc:276] Timestamp: P: 1786126540077675 usec, L: 0
0807 18:16:10.235572 (+ 173us) write_op.cc:270] Start()
0807 18:16:10.235598 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540085037 usec, L: 0
0807 18:16:10.235805 (+ 207us) write_op.cc:270] Start()
0807 18:16:10.235830 (+ 25us) write_op.cc:276] Timestamp: P: 1786126540134690 usec, L: 0
0807 18:16:10.236008 (+ 178us) write_op.cc:270] Start()
0807 18:16:10.236029 (+ 21us) write_op.cc:276] Timestamp: P: 1786126540151326 usec, L: 0
0807 18:16:10.236188 (+ 159us) write_op.cc:270] Start()
0807 18:16:10.236209 (+ 21us) write_op.cc:276] Timestamp: P: 1786126540153434 usec, L: 0
0807 18:16:10.236367 (+ 158us) write_op.cc:270] Start()
0807 18:16:10.236387 (+ 20us) write_op.cc:276] Timestamp: P: 1786126540214371 usec, L: 0
0807 18:16:10.236516 (+ 129us) write_op.cc:270] Start()
0807 18:16:10.236534 (+ 18us) write_op.cc:276] Timestamp: P: 1786126540216649 usec, L: 0
0807 18:16:10.236742 (+ 208us) write_op.cc:270] Start()
0807 18:16:10.236766 (+ 24us) write_op.cc:276] Timestamp: P: 1786126540224043 usec, L: 0
0807 18:16:10.236949 (+ 183us) write_op.cc:270] Start()
0807 18:16:10.236972 (+ 23us) write_op.cc:276] Timestamp: P: 1786126540227596 usec, L: 0
0807 18:16:10.237155 (+ 183us) write_op.cc:270] Start()
0807 18:16:10.237181 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540299367 usec, L: 0
0807 18:16:10.237339 (+ 158us) write_op.cc:270] Start()
0807 18:16:10.237361 (+ 22us) write_op.cc:276] Timestamp: P: 1786126540330134 usec, L: 0
0807 18:16:10.237513 (+ 152us) write_op.cc:270] Start()
0807 18:16:10.237536 (+ 23us) write_op.cc:276] Timestamp: P: 1786126540331571 usec, L: 0
0807 18:16:10.237932 (+ 396us) write_op.cc:270] Start()
0807 18:16:10.237965 (+ 33us) write_op.cc:276] Timestamp: P: 1786126540334175 usec, L: 0
0807 18:16:10.238291 (+ 326us) write_op.cc:270] Start()
0807 18:16:10.238323 (+ 32us) write_op.cc:276] Timestamp: P: 1786126540366449 usec, L: 0
0807 18:16:10.238571 (+ 248us) write_op.cc:270] Start()
0807 18:16:10.238708 (+ 137us) write_op.cc:276] Timestamp: P: 1786126540395106 usec, L: 0
0807 18:16:10.254648 (+ 15940us) write_op.cc:270] Start()
0807 18:16:10.254702 (+ 54us) write_op.cc:276] Timestamp: P: 1786126540405646 usec, L: 0
0807 18:16:10.254990 (+ 288us) write_op.cc:270] Start()
0807 18:16:10.255017 (+ 27us) write_op.cc:276] Timestamp: P: 1786126540406910 usec, L: 0
0807 18:16:10.255232 (+ 215us) write_op.cc:270] Start()
0807 18:16:10.255256 (+ 24us) write_op.cc:276] Timestamp: P: 1786126540443879 usec, L: 0
0807 18:16:10.255572 (+ 316us) write_op.cc:270] Start()
0807 18:16:10.255644 (+ 72us) write_op.cc:276] Timestamp: P: 1786126540446592 usec, L: 0
0807 18:16:10.255840 (+ 196us) write_op.cc:270] Start()
0807 18:16:10.255864 (+ 24us) write_op.cc:276] Timestamp: P: 1786126540481776 usec, L: 0
0807 18:16:10.256496 (+ 632us) write_op.cc:270] Start()
0807 18:16:10.256522 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540513478 usec, L: 0
0807 18:16:10.256685 (+ 163us) write_op.cc:270] Start()
0807 18:16:10.256710 (+ 25us) write_op.cc:276] Timestamp: P: 1786126540520998 usec, L: 0
0807 18:16:10.256850 (+ 140us) write_op.cc:270] Start()
0807 18:16:10.256869 (+ 19us) write_op.cc:276] Timestamp: P: 1786126540535455 usec, L: 0
0807 18:16:10.257060 (+ 191us) write_op.cc:270] Start()
0807 18:16:10.257084 (+ 24us) write_op.cc:276] Timestamp: P: 1786126540557414 usec, L: 0
0807 18:16:10.257299 (+ 215us) write_op.cc:270] Start()
0807 18:16:10.257323 (+ 24us) write_op.cc:276] Timestamp: P: 1786126540613221 usec, L: 0
0807 18:16:10.257527 (+ 204us) write_op.cc:270] Start()
0807 18:16:10.257553 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540615529 usec, L: 0
0807 18:16:10.257743 (+ 190us) write_op.cc:270] Start()
0807 18:16:10.257773 (+ 30us) write_op.cc:276] Timestamp: P: 1786126540619971 usec, L: 0
0807 18:16:10.257957 (+ 184us) write_op.cc:270] Start()
0807 18:16:10.257983 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540651297 usec, L: 0
0807 18:16:10.258180 (+ 197us) write_op.cc:270] Start()
0807 18:16:10.258204 (+ 24us) write_op.cc:276] Timestamp: P: 1786126540691035 usec, L: 0
0807 18:16:10.258367 (+ 163us) write_op.cc:270] Start()
0807 18:16:10.258387 (+ 20us) write_op.cc:276] Timestamp: P: 1786126540710815 usec, L: 0
0807 18:16:10.258568 (+ 181us) write_op.cc:270] Start()
0807 18:16:10.258589 (+ 21us) write_op.cc:276] Timestamp: P: 1786126540715016 usec, L: 0
0807 18:16:10.258755 (+ 166us) write_op.cc:270] Start()
0807 18:16:10.258802 (+ 47us) write_op.cc:276] Timestamp: P: 1786126540784858 usec, L: 0
0807 18:16:10.258966 (+ 164us) write_op.cc:270] Start()
0807 18:16:10.258987 (+ 21us) write_op.cc:276] Timestamp: P: 1786126540786157 usec, L: 0
0807 18:16:10.259225 (+ 238us) write_op.cc:270] Start()
0807 18:16:10.259261 (+ 36us) write_op.cc:276] Timestamp: P: 1786126540810342 usec, L: 0
0807 18:16:10.259446 (+ 185us) write_op.cc:270] Start()
0807 18:16:10.259466 (+ 20us) write_op.cc:276] Timestamp: P: 1786126540828534 usec, L: 0
0807 18:16:10.259597 (+ 131us) write_op.cc:270] Start()
0807 18:16:10.259616 (+ 19us) write_op.cc:276] Timestamp: P: 1786126540851349 usec, L: 0
0807 18:16:10.259775 (+ 159us) write_op.cc:270] Start()
0807 18:16:10.259795 (+ 20us) write_op.cc:276] Timestamp: P: 1786126540888565 usec, L: 0
0807 18:16:10.259976 (+ 181us) write_op.cc:270] Start()
0807 18:16:10.259998 (+ 22us) write_op.cc:276] Timestamp: P: 1786126540892898 usec, L: 0
0807 18:16:10.260195 (+ 197us) write_op.cc:270] Start()
0807 18:16:10.260231 (+ 36us) write_op.cc:276] Timestamp: P: 1786126540908923 usec, L: 0
0807 18:16:10.260475 (+ 244us) write_op.cc:270] Start()
0807 18:16:10.260500 (+ 25us) write_op.cc:276] Timestamp: P: 1786126540913966 usec, L: 0
0807 18:16:10.260641 (+ 141us) write_op.cc:270] Start()
0807 18:16:10.260660 (+ 19us) write_op.cc:276] Timestamp: P: 1786126540964830 usec, L: 0
0807 18:16:10.260833 (+ 173us) write_op.cc:270] Start()
0807 18:16:10.260854 (+ 21us) write_op.cc:276] Timestamp: P: 1786126540999517 usec, L: 0
0807 18:16:10.266586 (+ 5732us) write_op.cc:270] Start()
0807 18:16:10.266643 (+ 57us) write_op.cc:276] Timestamp: P: 1786126541007738 usec, L: 0
0807 18:16:10.266896 (+ 253us) write_op.cc:270] Start()
0807 18:16:10.266921 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541008664 usec, L: 0
0807 18:16:10.267264 (+ 343us) write_op.cc:270] Start()
0807 18:16:10.267292 (+ 28us) write_op.cc:276] Timestamp: P: 1786126541027265 usec, L: 0
0807 18:16:10.267582 (+ 290us) write_op.cc:270] Start()
0807 18:16:10.267609 (+ 27us) write_op.cc:276] Timestamp: P: 1786126541041511 usec, L: 0
0807 18:16:10.267798 (+ 189us) write_op.cc:270] Start()
0807 18:16:10.267822 (+ 24us) write_op.cc:276] Timestamp: P: 1786126541114818 usec, L: 0
0807 18:16:10.268106 (+ 284us) write_op.cc:270] Start()
0807 18:16:10.268255 (+ 149us) write_op.cc:276] Timestamp: P: 1786126541117719 usec, L: 0
0807 18:16:10.268457 (+ 202us) write_op.cc:270] Start()
0807 18:16:10.268482 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541130239 usec, L: 0
0807 18:16:10.268822 (+ 340us) write_op.cc:270] Start()
0807 18:16:10.268898 (+ 76us) write_op.cc:276] Timestamp: P: 1786126541140700 usec, L: 0
0807 18:16:10.269255 (+ 357us) write_op.cc:270] Start()
0807 18:16:10.269282 (+ 27us) write_op.cc:276] Timestamp: P: 1786126541186727 usec, L: 0
0807 18:16:10.269448 (+ 166us) write_op.cc:270] Start()
0807 18:16:10.269469 (+ 21us) write_op.cc:276] Timestamp: P: 1786126541192861 usec, L: 0
0807 18:16:10.269651 (+ 182us) write_op.cc:270] Start()
0807 18:16:10.269675 (+ 24us) write_op.cc:276] Timestamp: P: 1786126541206335 usec, L: 0
0807 18:16:10.269863 (+ 188us) write_op.cc:270] Start()
0807 18:16:10.269886 (+ 23us) write_op.cc:276] Timestamp: P: 1786126541221569 usec, L: 0
0807 18:16:10.275170 (+ 5284us) write_op.cc:270] Start()
0807 18:16:10.275205 (+ 35us) write_op.cc:276] Timestamp: P: 1786126541265049 usec, L: 0
0807 18:16:10.275591 (+ 386us) write_op.cc:270] Start()
0807 18:16:10.275620 (+ 29us) write_op.cc:276] Timestamp: P: 1786126541274668 usec, L: 0
0807 18:16:10.275782 (+ 162us) write_op.cc:270] Start()
0807 18:16:10.275802 (+ 20us) write_op.cc:276] Timestamp: P: 1786126541275707 usec, L: 0
0807 18:16:10.276000 (+ 198us) write_op.cc:270] Start()
0807 18:16:10.276027 (+ 27us) write_op.cc:276] Timestamp: P: 1786126541291522 usec, L: 0
0807 18:16:10.276248 (+ 221us) write_op.cc:270] Start()
0807 18:16:10.276271 (+ 23us) write_op.cc:276] Timestamp: P: 1786126541325006 usec, L: 0
0807 18:16:10.276548 (+ 277us) write_op.cc:270] Start()
0807 18:16:10.276572 (+ 24us) write_op.cc:276] Timestamp: P: 1786126541351928 usec, L: 0
0807 18:16:10.276825 (+ 253us) write_op.cc:270] Start()
0807 18:16:10.276849 (+ 24us) write_op.cc:276] Timestamp: P: 1786126541372323 usec, L: 0
0807 18:16:10.277023 (+ 174us) write_op.cc:270] Start()
0807 18:16:10.277066 (+ 43us) write_op.cc:276] Timestamp: P: 1786126541388832 usec, L: 0
0807 18:16:10.277241 (+ 175us) write_op.cc:270] Start()
0807 18:16:10.277275 (+ 34us) write_op.cc:276] Timestamp: P: 1786126541399536 usec, L: 0
0807 18:16:10.277455 (+ 180us) write_op.cc:270] Start()
0807 18:16:10.277479 (+ 24us) write_op.cc:276] Timestamp: P: 1786126541421707 usec, L: 0
0807 18:16:10.277680 (+ 201us) write_op.cc:270] Start()
0807 18:16:10.277703 (+ 23us) write_op.cc:276] Timestamp: P: 1786126541471650 usec, L: 0
0807 18:16:10.277844 (+ 141us) write_op.cc:270] Start()
0807 18:16:10.277863 (+ 19us) write_op.cc:276] Timestamp: P: 1786126541479023 usec, L: 0
0807 18:16:10.278050 (+ 187us) write_op.cc:270] Start()
0807 18:16:10.278074 (+ 24us) write_op.cc:276] Timestamp: P: 1786126541514871 usec, L: 0
0807 18:16:10.278298 (+ 224us) write_op.cc:270] Start()
0807 18:16:10.278320 (+ 22us) write_op.cc:276] Timestamp: P: 1786126541516550 usec, L: 0
0807 18:16:10.278910 (+ 590us) write_op.cc:270] Start()
0807 18:16:10.278942 (+ 32us) write_op.cc:276] Timestamp: P: 1786126541533544 usec, L: 0
0807 18:16:10.279466 (+ 524us) write_op.cc:270] Start()
0807 18:16:10.279494 (+ 28us) write_op.cc:276] Timestamp: P: 1786126541549674 usec, L: 0
0807 18:16:10.279660 (+ 166us) write_op.cc:270] Start()
0807 18:16:10.279682 (+ 22us) write_op.cc:276] Timestamp: P: 1786126541591308 usec, L: 0
0807 18:16:10.279955 (+ 273us) write_op.cc:270] Start()
0807 18:16:10.279984 (+ 29us) write_op.cc:276] Timestamp: P: 1786126541621213 usec, L: 0
0807 18:16:10.280228 (+ 244us) write_op.cc:270] Start()
0807 18:16:10.280254 (+ 26us) write_op.cc:276] Timestamp: P: 1786126541625863 usec, L: 0
0807 18:16:10.280457 (+ 203us) write_op.cc:270] Start()
0807 18:16:10.280481 (+ 24us) write_op.cc:276] Timestamp: P: 1786126541627010 usec, L: 0
0807 18:16:10.280662 (+ 181us) write_op.cc:270] Start()
0807 18:16:10.280686 (+ 24us) write_op.cc:276] Timestamp: P: 1786126541649915 usec, L: 0
0807 18:16:10.280878 (+ 192us) write_op.cc:270] Start()
0807 18:16:10.280903 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541738178 usec, L: 0
0807 18:16:10.281050 (+ 147us) write_op.cc:270] Start()
0807 18:16:10.281070 (+ 20us) write_op.cc:276] Timestamp: P: 1786126541745479 usec, L: 0
0807 18:16:10.281285 (+ 215us) write_op.cc:270] Start()
0807 18:16:10.281309 (+ 24us) write_op.cc:276] Timestamp: P: 1786126541775431 usec, L: 0
0807 18:16:10.281558 (+ 249us) write_op.cc:270] Start()
0807 18:16:10.281583 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541778207 usec, L: 0
0807 18:16:10.281739 (+ 156us) write_op.cc:270] Start()
0807 18:16:10.281760 (+ 21us) write_op.cc:276] Timestamp: P: 1786126541810769 usec, L: 0
0807 18:16:10.281911 (+ 151us) write_op.cc:270] Start()
0807 18:16:10.281930 (+ 19us) write_op.cc:276] Timestamp: P: 1786126541851379 usec, L: 0
0807 18:16:10.282075 (+ 145us) write_op.cc:270] Start()
0807 18:16:10.282094 (+ 19us) write_op.cc:276] Timestamp: P: 1786126541853854 usec, L: 0
0807 18:16:10.282275 (+ 181us) write_op.cc:270] Start()
0807 18:16:10.282297 (+ 22us) write_op.cc:276] Timestamp: P: 1786126541865910 usec, L: 0
0807 18:16:10.282474 (+ 177us) write_op.cc:270] Start()
0807 18:16:10.289171 (+ 6697us) write_op.cc:276] Timestamp: P: 1786126541904522 usec, L: 0
0807 18:16:10.289516 (+ 345us) write_op.cc:270] Start()
0807 18:16:10.289547 (+ 31us) write_op.cc:276] Timestamp: P: 1786126541958565 usec, L: 0
0807 18:16:10.289717 (+ 170us) write_op.cc:270] Start()
0807 18:16:10.289739 (+ 22us) write_op.cc:276] Timestamp: P: 1786126541960101 usec, L: 0
0807 18:16:10.289954 (+ 215us) write_op.cc:270] Start()
0807 18:16:10.289979 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541965322 usec, L: 0
0807 18:16:10.290414 (+ 435us) write_op.cc:270] Start()
0807 18:16:10.290449 (+ 35us) write_op.cc:276] Timestamp: P: 1786126541992093 usec, L: 0
0807 18:16:10.290696 (+ 247us) write_op.cc:270] Start()
0807 18:16:10.290832 (+ 136us) write_op.cc:276] Timestamp: P: 1786126542096477 usec, L: 0
0807 18:16:10.291125 (+ 293us) write_op.cc:270] Start()
0807 18:16:10.291166 (+ 41us) write_op.cc:276] Timestamp: P: 1786126542129100 usec, L: 0
0807 18:16:10.291489 (+ 323us) write_op.cc:270] Start()
0807 18:16:10.291528 (+ 39us) write_op.cc:276] Timestamp: P: 1786126542164965 usec, L: 0
0807 18:16:10.291792 (+ 264us) write_op.cc:270] Start()
0807 18:16:10.291825 (+ 33us) write_op.cc:276] Timestamp: P: 1786126542166217 usec, L: 0
0807 18:16:10.292025 (+ 200us) write_op.cc:270] Start()
0807 18:16:10.292053 (+ 28us) write_op.cc:276] Timestamp: P: 1786126542202798 usec, L: 0
0807 18:16:10.296867 (+ 4814us) write_op.cc:270] Start()
0807 18:16:10.296948 (+ 81us) write_op.cc:276] Timestamp: P: 1786126542207962 usec, L: 0
0807 18:16:10.305871 (+ 8923us) write_op.cc:270] Start()
0807 18:16:10.305919 (+ 48us) write_op.cc:276] Timestamp: P: 1786126542232496 usec, L: 0
0807 18:16:10.306266 (+ 347us) write_op.cc:270] Start()
0807 18:16:10.306294 (+ 28us) write_op.cc:276] Timestamp: P: 1786126542253512 usec, L: 0
0807 18:16:10.306513 (+ 219us) write_op.cc:270] Start()
0807 18:16:10.306563 (+ 50us) write_op.cc:276] Timestamp: P: 1786126542292401 usec, L: 0
0807 18:16:10.306747 (+ 184us) write_op.cc:270] Start()
0807 18:16:10.306771 (+ 24us) write_op.cc:276] Timestamp: P: 1786126542297201 usec, L: 0
0807 18:16:10.307315 (+ 544us) write_op.cc:270] Start()
0807 18:16:10.307344 (+ 29us) write_op.cc:276] Timestamp: P: 1786126542332068 usec, L: 0
0807 18:16:10.307520 (+ 176us) write_op.cc:270] Start()
0807 18:16:10.307543 (+ 23us) write_op.cc:276] Timestamp: P: 1786126542341796 usec, L: 0
0807 18:16:10.307741 (+ 198us) write_op.cc:270] Start()
0807 18:16:10.307766 (+ 25us) write_op.cc:276] Timestamp: P: 1786126542389459 usec, L: 0
0807 18:16:10.307940 (+ 174us) write_op.cc:270] Start()
0807 18:16:10.307964 (+ 24us) write_op.cc:276] Timestamp: P: 1786126542432409 usec, L: 0
0807 18:16:10.308138 (+ 174us) write_op.cc:270] Start()
0807 18:16:10.308162 (+ 24us) write_op.cc:276] Timestamp: P: 1786126542449029 usec, L: 0
0807 18:16:10.308348 (+ 186us) write_op.cc:270] Start()
0807 18:16:10.308372 (+ 24us) write_op.cc:276] Timestamp: P: 1786126542460866 usec, L: 0
0807 18:16:10.308595 (+ 223us) write_op.cc:270] Start()
0807 18:16:10.308624 (+ 29us) write_op.cc:276] Timestamp: P: 1786126542537950 usec, L: 0
0807 18:16:10.308805 (+ 181us) write_op.cc:270] Start()
0807 18:16:10.308838 (+ 33us) write_op.cc:276] Timestamp: P: 1786126542543527 usec, L: 0
0807 18:16:10.308993 (+ 155us) write_op.cc:270] Start()
0807 18:16:10.309026 (+ 33us) write_op.cc:276] Timestamp: P: 1786126542549626 usec, L: 0
0807 18:16:10.309240 (+ 214us) write_op.cc:270] Start()
0807 18:16:10.309265 (+ 25us) write_op.cc:276] Timestamp: P: 1786126542558000 usec, L: 0
0807 18:16:10.309454 (+ 189us) write_op.cc:270] Start()
0807 18:16:10.309480 (+ 26us) write_op.cc:276] Timestamp: P: 1786126542607360 usec, L: 0
0807 18:16:10.309665 (+ 185us) write_op.cc:270] Start()
0807 18:16:10.309696 (+ 31us) write_op.cc:276] Timestamp: P: 1786126542641584 usec, L: 0
0807 18:16:10.309896 (+ 200us) write_op.cc:270] Start()
0807 18:16:10.309922 (+ 26us) write_op.cc:276] Timestamp: P: 1786126542647493 usec, L: 0
0807 18:16:10.367260 (+ 57338us) write_op.cc:270] Start()
0807 18:16:10.367308 (+ 48us) write_op.cc:276] Timestamp: P: 1786126542663083 usec, L: 0
0807 18:16:10.367555 (+ 247us) write_op.cc:270] Start()
0807 18:16:10.367687 (+ 132us) write_op.cc:276] Timestamp: P: 1786126542720054 usec, L: 0
0807 18:16:10.367938 (+ 251us) write_op.cc:270] Start()
0807 18:16:10.367967 (+ 29us) write_op.cc:276] Timestamp: P: 178612
W20260807 18:16:16.811564 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260807 18:16:16.978547 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260807 18:16:17.034458 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 61: this message will repeat every 5th retry.
I20260807 18:16:17.171376 13122 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=229 overwritten=1 applied=228 ignored=0} inserts{seen=3756 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:16:17.177322 13122 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Bootstrap complete.
I20260807 18:16:17.192920 13122 ts_tablet_manager.cc:1397] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Time spent bootstrapping tablet: real 7.872s user 0.765s sys 0.208s
W20260807 18:16:17.238428 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:17.243546 13122 raft_consensus.cc:348] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:17.243913 13122 raft_consensus.cc:729] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Initialized, Role: FOLLOWER
I20260807 18:16:17.244539 13122 consensus_queue.cc:260] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 228, Last appended: 2.228, Last appended by leader: 228, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:17.280499 13122 ts_tablet_manager.cc:1428] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Time spent starting tablet: real 0.038s user 0.001s sys 0.011s
I20260807 18:16:17.283878 13489 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:17.284670 13489 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:16:17.290604 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:17.291276 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:17.306236 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 815 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:17.314473 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:17.315798 13491 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:17.290017 13489 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559)
I20260807 18:16:17.372381 13496 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:17.373464 13496 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1244 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
I20260807 18:16:17.375811 13496 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077)
I20260807 18:16:17.378291 11884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1436 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:17.379508 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1436 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:16:17.390561 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260807 18:16:17.434094 12163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:17.470132 12163 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:17.472399 12163 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca; no voters: 22052958d03d426ebdc2fc310637c846, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:16:17.473517 13496 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 18:16:17.484828 13118 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:17.490854 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1436 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:17.501168 13261 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 228. Preceding OpId from leader: term: 2 index: 1155. (index mismatch)
I20260807 18:16:17.501570 13491 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:17.501945 13491 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:17.504673 13491 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:16:17.506642 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:17.507093 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
W20260807 18:16:17.511822 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260807 18:16:17.512075 12249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
W20260807 18:16:17.513077 13118 leader_election.cc:334] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:17.513358 13118 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:16:17.513974 13491 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 18:16:17.531232 13053 consensus_queue.cc:1037] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1156, Last known committed idx: 228, Time since last communication: 0.001s
W20260807 18:16:17.603921 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260807 18:16:17.680433 13053 consensus_queue.cc:786] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Peer 50da72adf57546f5bab0a028672a51dd is lagging by at least 206 ops behind the committed index
I20260807 18:16:18.029763 13513 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:18.030102 13513 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:18.032060 13513 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:16:18.034693 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:18.035672 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:18.042053 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:18.058518 13107 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:18.059280 13513 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 18:16:18.099232 13118 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 8 similar messages]
W20260807 18:16:18.193430 13442 op_tracker.cc:283] OpTracker waiting for 146 outstanding ops to complete now for 3.486s
I20260807 18:16:18.193998 13442 op_tracker.cc:285] Dumping up to 50 currently running ops:
I20260807 18:16:18.194988 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d8c00 [op_id=(term: 1 index: 728), ts=7315974359838609408, rows=[]]]
I20260807 18:16:18.195554 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d8880 [op_id=(term: 1 index: 727), ts=7315974359621193728, rows=[]]]
I20260807 18:16:18.195852 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d8500 [op_id=(term: 1 index: 726), ts=7315974359532466176, rows=[]]]
I20260807 18:16:18.196945 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d8180 [op_id=(term: 1 index: 725), ts=7315974359212392448, rows=[]]]
I20260807 18:16:18.197188 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d7e00 [op_id=(term: 1 index: 724), ts=7315974359207419904, rows=[]]]
I20260807 18:16:18.197417 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d7a80 [op_id=(term: 1 index: 723), ts=7315974358939705344, rows=[]]]
I20260807 18:16:18.197618 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d7700 [op_id=(term: 1 index: 722), ts=7315974358912446464, rows=[]]]
I20260807 18:16:18.197896 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d7380 [op_id=(term: 1 index: 721), ts=7315974358601814016, rows=[]]]
I20260807 18:16:18.198243 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d7000 [op_id=(term: 1 index: 720), ts=7315974358596976640, rows=[]]]
I20260807 18:16:18.198465 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d6c80 [op_id=(term: 1 index: 719), ts=7315974358080045056, rows=[]]]
I20260807 18:16:18.198696 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d6900 [op_id=(term: 1 index: 718), ts=7315974357995487232, rows=[]]]
I20260807 18:16:18.198930 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d6580 [op_id=(term: 1 index: 717), ts=7315974357942947840, rows=[]]]
I20260807 18:16:18.199681 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d6200 [op_id=(term: 1 index: 716), ts=7315974357545668608, rows=[]]]
I20260807 18:16:18.200011 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d5e80 [op_id=(term: 1 index: 715), ts=7315974357334421504, rows=[]]]
I20260807 18:16:18.200618 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d5b00 [op_id=(term: 1 index: 714), ts=7315974357191561216, rows=[]]]
I20260807 18:16:18.200984 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d5780 [op_id=(term: 1 index: 713), ts=7315974357081862144, rows=[]]]
I20260807 18:16:18.201599 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d5400 [op_id=(term: 1 index: 712), ts=7315974356744785920, rows=[]]]
I20260807 18:16:18.202142 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d5080 [op_id=(term: 1 index: 711), ts=7315974356441669632, rows=[]]]
I20260807 18:16:18.202472 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d4d00 [op_id=(term: 1 index: 710), ts=7315974356432740352, rows=[]]]
I20260807 18:16:18.207085 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d4980 [op_id=(term: 1 index: 709), ts=7315974356388265984, rows=[]]]
I20260807 18:16:18.207531 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d4600 [op_id=(term: 1 index: 708), ts=7315974355832102912, rows=[]]]
I20260807 18:16:18.207863 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d4280 [op_id=(term: 1 index: 707), ts=7315974355496189952, rows=[]]]
I20260807 18:16:18.208132 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d3f00 [op_id=(term: 1 index: 706), ts=7315974355348664320, rows=[]]]
I20260807 18:16:18.208498 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001afa00 [op_id=(term: 1 index: 614), ts=7315974340180762624, rows=[]]]
I20260807 18:16:18.208738 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001af680 [op_id=(term: 1 index: 613), ts=7315974340170629120, rows=[]]]
I20260807 18:16:18.209055 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001af300 [op_id=(term: 1 index: 612), ts=7315974339923423232, rows=[]]]
I20260807 18:16:18.209260 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001aef80 [op_id=(term: 1 index: 611), ts=7315974339521355776, rows=[]]]
I20260807 18:16:18.209538 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001aec00 [op_id=(term: 1 index: 610), ts=7315974339121430528, rows=[]]]
I20260807 18:16:18.209733 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ae880 [op_id=(term: 1 index: 609), ts=7315974339083530240, rows=[]]]
I20260807 18:16:18.210028 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ae500 [op_id=(term: 1 index: 608), ts=7315974339053342720, rows=[]]]
I20260807 18:16:18.210259 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ae180 [op_id=(term: 1 index: 607), ts=7315974338681466880, rows=[]]]
I20260807 18:16:18.219918 13260 raft_consensus.cc:858] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }.
Pending config: opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }:
New config: opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:18.228121 13260 raft_consensus.cc:1565] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Could not prepare op 'term: 1 index: 896' and following 536 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 515 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }.
Pending config: opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }:
New config: opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:18.262678 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260807 18:16:18.225941 13118 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 129366us
I20260807 18:16:18.236923 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ade00 [op_id=(term: 1 index: 606), ts=7315974338587009024, rows=[]]]
I20260807 18:16:18.289480 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ada80 [op_id=(term: 1 index: 605), ts=7315974338486616064, rows=[]]]
I20260807 18:16:18.289873 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ad700 [op_id=(term: 1 index: 604), ts=7315974338473861120, rows=[]]]
I20260807 18:16:18.290026 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001ad380 [op_id=(term: 1 index: 603), ts=7315974338335264768, rows=[]]]
I20260807 18:16:18.290161 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d3b80 [op_id=(term: 1 index: 705), ts=7315974355225174016, rows=[]]]
I20260807 18:16:18.290261 13442 op_tracker.cc:289] RD-P WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001a9480 [op_id=(term: 1 index: 585), ts=7315974336109117440, rows=[]]]
I20260807 18:16:18.290401 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d3800 [op_id=(term: 1 index: 704), ts=7315974355146313728, rows=[]]]
I20260807 18:16:18.290511 13442 op_tracker.cc:289] RD-P WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001a9100 [op_id=(term: 1 index: 584), ts=7315974335925092352, rows=[]]]
I20260807 18:16:18.291141 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d3480 [op_id=(term: 1 index: 703), ts=7315974354518777856, rows=[]]]
I20260807 18:16:18.291290 13442 op_tracker.cc:289] RD-P WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001a8d80 [op_id=(term: 1 index: 583), ts=7315974335706959872, rows=[]]]
I20260807 18:16:18.291610 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d3100 [op_id=(term: 1 index: 702), ts=7315974354403966976, rows=[]]]
I20260807 18:16:18.291805 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d2d80 [op_id=(term: 1 index: 701), ts=7315974354388254720, rows=[]]]
I20260807 18:16:18.291980 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d2a00 [op_id=(term: 1 index: 700), ts=7315974354374422528, rows=[]]]
I20260807 18:16:18.292203 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d2680 [op_id=(term: 1 index: 699), ts=7315974353832734720, rows=[]]]
I20260807 18:16:18.292685 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d2300 [op_id=(term: 1 index: 698), ts=7315974353767395328, rows=[]]]
I20260807 18:16:18.292953 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d1f80 [op_id=(term: 1 index: 697), ts=7315974353598414848, rows=[]]]
I20260807 18:16:18.293241 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d1c00 [op_id=(term: 1 index: 696), ts=7315974353587785728, rows=[]]]
I20260807 18:16:18.296317 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d1500 [op_id=(term: 1 index: 694), ts=7315974353198764032, rows=[]]]
I20260807 18:16:18.296926 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:13, state=WriteOpState 0x6170001d1180 [op_id=(term: 1 index: 693), ts=7315974353082011648, rows=[]]]
W20260807 18:16:18.373189 13118 leader_election.cc:334] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:18.432654 13513 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:18.433020 13513 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:18.434711 13513 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:16:18.437369 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:18.444591 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
W20260807 18:16:18.457609 13118 leader_election.cc:334] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:18.460474 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:16:18.468397 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260807 18:16:18.475855 13118 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9, b5bb27271da74b1a909d982e6fb2d470
I20260807 18:16:18.485807 13513 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 18:16:18.501194 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260807 18:16:18.553727 13260 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Committing config change with OpId 1.816: config changed from index 515 to 816, 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) changed from NON_VOTER to VOTER. New config: { opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
W20260807 18:16:18.674156 13522 log.cc:924] Time spent T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Append to log took a long time: real 0.121s user 0.002s sys 0.000s
W20260807 18:16:18.787508 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 111 similar messages]
W20260807 18:16:18.791445 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260807 18:16:18.812227 13260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.253.68:42039 (request call id 52) took 1782 ms. Trace:
I20260807 18:16:18.814854 13161 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:55268 (request call id 15) took 1111 ms. Trace:
I20260807 18:16:18.814893 13491 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:18.815086 13161 rpcz_store.cc:276] 0807 18:16:17.700609 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:17.700991 (+ 382us) service_pool.cc:227] Handling call
0807 18:16:18.812055 (+1111064us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x615000043424. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6018bb630 00007fa605493c7f 00007fa5fffff016 00007fa5ffffed45 00007fa5fceef9be 00007fa5fceee79e 00007fa5fcef4b25 00007fa5fcef554f 00007fa5fcef5378 00000000009edb7c
0807 18:16:18.812312 (+ 257us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2552513792}
I20260807 18:16:18.815876 13491 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
I20260807 18:16:18.817819 13491 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077)
I20260807 18:16:18.818804 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 895 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:18.820175 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 895 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:18.828033 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 895 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:18.871615 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 6 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:18.922019 13491 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:19.070683 12674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 895 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
W20260807 18:16:19.078002 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260807 18:16:19.140427 13118 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 99343us
I20260807 18:16:19.159238 13491 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:19.160699 13491 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }
I20260807 18:16:19.162035 13491 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:16:19.162989 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:19.163304 11884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:19.188088 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 228 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:19.236598 13107 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
W20260807 18:16:19.297935 13118 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:19.319315 13536 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:19.319733 13536 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
I20260807 18:16:19.321557 12249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 895 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:19.323673 11883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 895 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:19.324234 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 895 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:19.325451 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 6 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:19.332875 13536 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077)
I20260807 18:16:19.333439 13536 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:19.338194 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 895 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:18.951490 13260 rpcz_store.cc:276] 0807 18:16:17.029910 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:17.030847 (+ 937us) service_pool.cc:227] Handling call
0807 18:16:17.317194 (+286347us) raft_consensus.cc:1457] Updating replica for 617 ops
0807 18:16:17.496470 (+179276us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 18:16:17.496478 (+ 8us) raft_consensus.cc:1525] Triggering prepare for 617 ops
0807 18:16:17.512133 (+ 15655us) write_op.cc:270] Start()
0807 18:16:17.512177 (+ 44us) write_op.cc:276] Timestamp: P: 1786126556074420 usec, L: 0
0807 18:16:17.515690 (+ 3513us) write_op.cc:270] Start()
0807 18:16:17.515729 (+ 39us) write_op.cc:276] Timestamp: P: 1786126556079467 usec, L: 0
0807 18:16:17.516814 (+ 1085us) write_op.cc:270] Start()
0807 18:16:17.516846 (+ 32us) write_op.cc:276] Timestamp: P: 1786126556084003 usec, L: 0
0807 18:16:17.518227 (+ 1381us) write_op.cc:270] Start()
0807 18:16:17.518259 (+ 32us) write_op.cc:276] Timestamp: P: 1786126556182587 usec, L: 0
0807 18:16:17.521920 (+ 3661us) write_op.cc:270] Start()
0807 18:16:17.521976 (+ 56us) write_op.cc:276] Timestamp: P: 1786126556216257 usec, L: 0
0807 18:16:17.548103 (+ 26127us) write_op.cc:270] Start()
0807 18:16:17.548149 (+ 46us) write_op.cc:276] Timestamp: P: 1786126556240078 usec, L: 0
0807 18:16:17.548903 (+ 754us) write_op.cc:270] Start()
0807 18:16:17.548968 (+ 65us) write_op.cc:276] Timestamp: P: 1786126556264893 usec, L: 0
0807 18:16:17.549149 (+ 181us) write_op.cc:270] Start()
0807 18:16:17.549173 (+ 24us) write_op.cc:276] Timestamp: P: 1786126556345007 usec, L: 0
0807 18:16:17.549602 (+ 429us) write_op.cc:270] Start()
0807 18:16:17.549664 (+ 62us) write_op.cc:276] Timestamp: P: 1786126556347337 usec, L: 0
0807 18:16:17.549974 (+ 310us) write_op.cc:270] Start()
0807 18:16:17.550003 (+ 29us) write_op.cc:276] Timestamp: P: 1786126556348661 usec, L: 0
0807 18:16:17.550185 (+ 182us) write_op.cc:270] Start()
0807 18:16:17.550207 (+ 22us) write_op.cc:276] Timestamp: P: 1786126556349704 usec, L: 0
0807 18:16:17.550344 (+ 137us) write_op.cc:270] Start()
0807 18:16:17.550364 (+ 20us) write_op.cc:276] Timestamp: P: 1786126556476316 usec, L: 0
0807 18:16:17.550630 (+ 266us) write_op.cc:270] Start()
0807 18:16:17.617591 (+ 66961us) write_op.cc:276] Timestamp: P: 1786126556487912 usec, L: 0
0807 18:16:17.617910 (+ 319us) write_op.cc:270] Start()
0807 18:16:17.617998 (+ 88us) write_op.cc:276] Timestamp: P: 1786126556491097 usec, L: 0
0807 18:16:17.618385 (+ 387us) write_op.cc:270] Start()
0807 18:16:17.618416 (+ 31us) write_op.cc:276] Timestamp: P: 1786126556553802 usec, L: 0
0807 18:16:17.618664 (+ 248us) write_op.cc:270] Start()
0807 18:16:17.618690 (+ 26us) write_op.cc:276] Timestamp: P: 1786126556557642 usec, L: 0
0807 18:16:17.619514 (+ 824us) write_op.cc:270] Start()
0807 18:16:17.619550 (+ 36us) write_op.cc:276] Timestamp: P: 1786126556615774 usec, L: 0
0807 18:16:17.620147 (+ 597us) write_op.cc:270] Start()
0807 18:16:17.620192 (+ 45us) write_op.cc:276] Timestamp: P: 1786126556622618 usec, L: 0
0807 18:16:17.753536 (+133344us) write_op.cc:270] Start()
0807 18:16:17.753579 (+ 43us) write_op.cc:276] Timestamp: P: 1786126556659499 usec, L: 0
0807 18:16:17.753787 (+ 208us) write_op.cc:270] Start()
0807 18:16:17.753811 (+ 24us) write_op.cc:276] Timestamp: P: 1786126556680550 usec, L: 0
0807 18:16:17.756446 (+ 2635us) write_op.cc:270] Start()
0807 18:16:17.756478 (+ 32us) write_op.cc:276] Timestamp: P: 1786126556709511 usec, L: 0
0807 18:16:17.756647 (+ 169us) write_op.cc:270] Start()
0807 18:16:17.756669 (+ 22us) write_op.cc:276] Timestamp: P: 1786126556714376 usec, L: 0
0807 18:16:17.756962 (+ 293us) write_op.cc:270] Start()
0807 18:16:17.756990 (+ 28us) write_op.cc:276] Timestamp: P: 1786126556791078 usec, L: 0
0807 18:16:17.757195 (+ 205us) write_op.cc:270] Start()
0807 18:16:17.757217 (+ 22us) write_op.cc:276] Timestamp: P: 1786126556824721 usec, L: 0
0807 18:16:17.757894 (+ 677us) write_op.cc:270] Start()
0807 18:16:17.757928 (+ 34us) write_op.cc:276] Timestamp: P: 1786126556839045 usec, L: 0
0807 18:16:17.758242 (+ 314us) write_op.cc:270] Start()
0807 18:16:17.758275 (+ 33us) write_op.cc:276] Timestamp: P: 1786126556840410 usec, L: 0
0807 18:16:17.758630 (+ 355us) write_op.cc:270] Start()
0807 18:16:17.758662 (+ 32us) write_op.cc:276] Timestamp: P: 1786126556866260 usec, L: 0
0807 18:16:17.758862 (+ 200us) write_op.cc:270] Start()
0807 18:16:17.758885 (+ 23us) write_op.cc:276] Timestamp: P: 1786126556931564 usec, L: 0
0807 18:16:17.759053 (+ 168us) write_op.cc:270] Start()
0807 18:16:17.759078 (+ 25us) write_op.cc:276] Timestamp: P: 1786126556934586 usec, L: 0
0807 18:16:17.759318 (+ 240us) write_op.cc:270] Start()
0807 18:16:17.759345 (+ 27us) write_op.cc:276] Timestamp: P: 1786126556946320 usec, L: 0
0807 18:16:17.759588 (+ 243us) write_op.cc:270] Start()
0807 18:16:17.759613 (+ 25us) write_op.cc:276] Timestamp: P: 1786126556980703 usec, L: 0
0807 18:16:17.759783 (+ 170us) write_op.cc:270] Start()
0807 18:16:17.759806 (+ 23us) write_op.cc:276] Timestamp: P: 1786126557033739 usec, L: 0
0807 18:16:17.760070 (+ 264us) write_op.cc:270] Start()
0807 18:16:17.760096 (+ 26us) write_op.cc:276] Timestamp: P: 1786126557036288 usec, L: 0
0807 18:16:17.760305 (+ 209us) write_op.cc:270] Start()
0807 18:16:17.760331 (+ 26us) write_op.cc:276] Timestamp: P: 1786126557039983 usec, L: 0
0807 18:16:17.760484 (+ 153us) write_op.cc:270] Start()
0807 18:16:17.760507 (+ 23us) write_op.cc:276] Timestamp: P: 1786126557061061 usec, L: 0
0807 18:16:17.760673 (+ 166us) write_op.cc:270] Start()
0807 18:16:17.760697 (+ 24us) write_op.cc:276] Timestamp: P: 1786126557136383 usec, L: 0
0807 18:16:17.760880 (+ 183us) write_op.cc:270] Start()
0807 18:16:17.760905 (+ 25us) write_op.cc:276] Timestamp: P: 1786126557143030 usec, L: 0
0807 18:16:17.761064 (+ 159us) write_op.cc:270] Start()
0807 18:16:17.761087 (+ 23us) write_op.cc:276] Timestamp: P: 1786126557145027 usec, L: 0
0807 18:16:17.761432 (+ 345us) write_op.cc:270] Start()
0807 18:16:17.761463 (+ 31us) write_op.cc:276] Timestamp: P: 1786126557172255 usec, L: 0
0807 18:16:17.761634 (+ 171us) write_op.cc:270] Start()
0807 18:16:17.761653 (+ 19us) write_op.cc:276] Timestamp: P: 1786126557213461 usec, L: 0
0807 18:16:17.761787 (+ 134us) write_op.cc:270] Start()
0807 18:16:17.761811 (+ 24us) write_op.cc:276] Timestamp: P: 1786126557214632 usec, L: 0
0807 18:16:17.761996 (+ 185us) write_op.cc:270] Start()
0807 18:16:17.762021 (+ 25us) write_op.cc:276] Timestamp: P: 1786126557276314 usec, L: 0
0807 18:16:17.762253 (+ 232us) write_op.cc:270] Start()
0807 18:16:17.762281 (+ 28us) write_op.cc:276] Timestamp: P: 1786126557313766 usec, L: 0
0807 18:16:17.762440 (+ 159us) write_op.cc:270] Start()
0807 18:16:17.762463 (+ 23us) write_op.cc:276] Timestamp: P: 1786126557317552 usec, L: 0
0807 18:16:17.783970 (+ 21507us) write_op.cc:270] Start()
0807 18:16:17.784014 (+ 44us) write_op.cc:276] Timestamp: P: 1786126557324203 usec, L: 0
0807 18:16:17.821543 (+ 37529us) write_op.cc:270] Start()
0807 18:16:17.821587 (+ 44us) write_op.cc:276] Timestamp: P: 1786126557354267 usec, L: 0
0807 18:16:17.821927 (+ 340us) write_op.cc:270] Start()
0807 18:16:17.821957 (+ 30us) write_op.cc:276] Timestamp: P: 1786126557413085 usec, L: 0
0807 18:16:17.822214 (+ 257us) write_op.cc:270] Start()
0807 18:16:17.822245 (+ 31us) write_op.cc:276] Timestamp: P: 1786126557420156 usec, L: 0
0807 18:16:17.822399 (+ 154us) write_op.cc:270] Start()
0807 18:16:17.822422 (+ 23us) write_op.cc:276] Timestamp: P: 1786126557421218 usec, L: 0
0807 18:16:17.822782 (+ 360us) write_op.cc:270] Start()
0807 18:16:17.822821 (+ 39us) write_op.cc:276] Timestamp: P: 1786126557440085 usec, L: 0
0807 18:16:17.823088 (+ 267us) write_op.cc:270] Start()
0807 18:16:17.823123 (+ 35us) write_op.cc:276] Timestamp: P: 1786126557470171 usec, L: 0
0807 18:16:17.823350 (+ 227us) write_op.cc:270] Start()
0807 18:16:17.823374 (+ 24us) write_op.cc:276] Timestamp: P: 1786126557517115 usec, L: 0
0807 18:16:17.823625 (+ 251us) write_op.cc:270] Start()
0807 18:16:17.823654 (+ 29us) write_op.cc:276] Timestamp: P: 1786126557518252 usec, L: 0
0807 18:16:17.823884 (+ 230us) write_op.cc:270] Start()
0807 18:16:17.823933 (+ 49us) write_op.cc:276] Timestamp: P: 1786126557547717 usec, L: 0
0807 18:16:17.824170 (+ 237us) write_op.cc:270] Start()
0807 18:16:17.824196 (+ 26us) write_op.cc:276] Timestamp: P: 1786126557549698 usec, L: 0
0807 18:16:17.824382 (+ 186us) write_op.cc:270] Start()
0807 18:16:17.824406 (+ 24us) write_op.cc:276] Timestamp: P: 1786126557612399 usec, L: 0
0807 18:16:17.824764 (+ 358us) write_op.cc:270] Start()
0807 18:16:17.824814 (+ 50us) write_op.cc:276] Timestamp: P: 1786126557616549 usec, L: 0
0807 18:16:17.825038 (+ 224us) write_op.cc:270] Start()
0807 18:16:17.825065 (+ 27us) write_op.cc:276] Timestamp: P: 1786126557652532 usec, L: 0
0807 18:16:17.825359 (+ 294us) write_op.cc:270] Start()
0807 18:16:17.825420 (+ 61us) write_op.cc:276] Timestamp: P: 1786126557681440 usec, L: 0
0807 18:16:17.825805 (+ 385us) write_op.cc:270] Start()
0807 18:16:17.825892 (+ 87us) write_op.cc:276] Timestamp: P: 1786126557730084 usec, L: 0
0807 18:16:17.826145 (+ 253us) write_op.cc:270] Start()
0807 18:16:17.826174 (+ 29us) write_op.cc:276] Timestamp: P: 1786126557734215 usec, L: 0
0807 18:16:17.826346 (+ 172us) write_op.cc:270] Start()
0807 18:16:17.826367 (+ 21us) write_op.cc:276] Timestamp: P: 1786126557737141 usec, L: 0
0807 18:16:17.931049 (+104682us) write_op.cc:270] Start()
0807 18:16:17.931123 (+ 74us) write_op.cc:276] Timestamp: P: 1786126557770059 usec, L: 0
0807 18:16:17.931470 (+ 347us) write_op.cc:270] Start()
0807 18:16:17.931499 (+ 29us) write_op.cc:276] Timestamp: P: 1786126557803915 usec, L: 0
0807 18:16:18.041856 (+110357us) write_op.cc:270] Start()
0807 18:16:18.041943 (+ 87us) write_op.cc:276] Timestamp: P: 1786126557818448 usec, L: 0
0807 18:16:18.042267 (+ 324us) write_op.cc:270] Start()
0807 18:16:18.042292 (+ 25us) write_op.cc:276] Timestamp: P: 1786126557831451 usec, L: 0
0807 18:16:18.062354 (+ 20062us) write_op.cc:270] Start()
0807 18:16:18.070782 (+ 8428us) write_op.cc:276] Timestamp: P: 1786126557859994 usec, L: 0
0807 18:16:18.073609 (+ 2827us) write_op.cc:270] Start()
0807 18:16:18.073678 (+ 69us) write_op.cc:276] Timestamp: P: 1786126557893984 usec, L: 0
0807 18:16:18.084543 (+ 10865us) write_op.cc:270] Start()
0807 18:16:18.084585 (+ 42us) write_op.cc:276] Timestamp: P: 1786126557915809 usec, L: 0
0807 18:16:18.085703 (+ 1118us) write_op.cc:270] Start()
0807 18:16:18.086039 (+ 336us) write_op.cc:276] Timestamp: P: 1786126557931877 usec, L: 0
0807 18:16:18.086872 (+ 833us) write_op.cc:270] Start()
0807 18:16:18.086912 (+ 40us) write_op.cc:276] Timestamp: P: 1786126557989071 usec, L: 0
0807 18:16:18.092608 (+ 5696us) write_op.cc:270] Start()
0807 18:16:18.092654 (+ 46us) write_op.cc:276] Timestamp: P: 1786126557998894 usec, L: 0
0807 18:16:18.104968 (+ 12314us) write_op.cc:270] Start()
0807 18:16:18.105017 (+ 49us) write_op.cc:276] Timestamp: P: 1786126558024700 usec, L: 0
0807 18:16:18.168830 (+ 63813us) write_op.cc:270] Start()
0807 18:16:18.168882 (+ 52us) write_op.cc:276] Timestamp: P: 1786126558043659 usec, L: 0
0807 18:16:18.169352 (+ 470us) write_op.cc:270] Start()
0807 18:16:18.169402 (+ 50us) write_op.cc:276] Timestamp: P: 1786126558085219 usec, L: 0
0807 18:16:18.169753 (+ 351us) write_op.cc:270] Start()
0807 18:16:18.169784 (+ 31us) write_op.cc:276] Timestamp: P: 1786126558123637 usec, L: 0
0807 18:16:18.170068 (+ 284us) write_op.cc:270] Start()
0807 18:16:18.170096 (+ 28us) write_op.cc:276] Timestamp: P: 1786126558125253 usec, L: 0
0807 18:16:18.170621 (+ 525us) write_op.cc:270] Start()
0807 18:16:18.170652 (+ 31us) write_op.cc:276] Timestamp: P: 1786126558152109 usec, L: 0
0807 18:16:18.170951 (+ 299us) write_op.cc:270] Start()
0807 18:16:18.170980 (+ 29us) write_op.cc:276] Timestamp: P: 1786126558162453 usec, L: 0
0807 18:16:18.532676 (+361696us) log.cc:842] Serialized 80706 byte log entry
0807 18:16:18.553505 (+ 20829us) raft_consensus.cc:1631] Marking committed up to 895
0807 18:16:18.561532 (+ 8027us) log.cc:842] Serialized 15 byte log entry
0807 18:16:18.811726 (+250194us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 18:16:18.812013 (+ 287us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x615000043424. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6018d100f 00007fa6018ccee9 00007fa605473a6c 00007fa5ffd5efa6 00007fa5ffd5ecd5 00007fa5fceef9be 00007fa5fceee79e 00007fa5fcef4b25 00007fa5fcef554f 00007fa5fcef5378
0807 18:16:18.812024 (+ 11us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 18:16:18.812038 (+ 14us) raft_consensus.cc:1671] finished
0807 18:16:18.812041 (+ 3us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 18:16:18.812130 (+ 89us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 18:16:17.514233 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:17.514364 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:17.514383 (+ 19us) write_op.cc:435] Acquired schema lock
0807 18:16:17.514386 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:17.514761 (+ 375us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:17.514783 (+ 22us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:17.514789 (+ 6us) tablet.cc:683] Acquiring locks for 20 operations
0807 18:16:17.515158 (+ 369us) tablet.cc:699] Row locks acquired
0807 18:16:17.515162 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:18.612775 (+1097613us) op_driver.cc:444] REPLICATION: finished
0807 18:16:18.612907 (+ 132us) write_op.cc:301] APPLY: starting
0807 18:16:18.612923 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:18.612995 (+ 72us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:18.612997 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:18.617563 (+ 4566us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:18.617733 (+ 170us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:18.617747 (+ 14us) write_op.cc:312] APPLY: finished
0807 18:16:18.617921 (+ 174us) log.cc:842] Serialized 139 byte log entry
0807 18:16:18.618003 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.618037 (+ 34us) write_op.cc:454] Released schema lock
0807 18:16:18.618045 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:18.618286 (+ 241us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.618293 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:17.515881 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:17.515985 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:17.515991 (+ 6us) write_op.cc:435] Acquired schema lock
0807 18:16:17.515994 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:17.516307 (+ 313us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:17.516324 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:17.516330 (+ 6us) tablet.cc:683] Acquiring locks for 9 operations
0807 18:16:17.516541 (+ 211us) tablet.cc:699] Row locks acquired
0807 18:16:17.516544 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:18.613306 (+1096762us) op_driver.cc:444] REPLICATION: finished
0807 18:16:18.615014 (+ 1708us) write_op.cc:301] APPLY: starting
0807 18:16:18.615038 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:18.615137 (+ 99us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:18.615140 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:18.615524 (+ 384us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:18.615587 (+ 63us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:18.615633 (+ 46us) write_op.cc:312] APPLY: finished
0807 18:16:18.615840 (+ 207us) log.cc:842] Serialized 71 byte log entry
0807 18:16:18.616069 (+ 229us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.616099 (+ 30us) write_op.cc:454] Released schema lock
0807 18:16:18.616112 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:18.616550 (+ 438us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.616558 (+ 8us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:17.517333 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:17.517429 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:17.517434 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:17.517436 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:17.517613 (+ 177us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:17.517631 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:17.517639 (+ 8us) tablet.cc:683] Acquiring locks for 16 operations
0807 18:16:17.517926 (+ 287us) tablet.cc:699] Row locks acquired
0807 18:16:17.517929 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:18.621082 (+1103153us) op_driver.cc:444] REPLICATION: finished
0807 18:16:18.621529 (+ 447us) write_op.cc:301] APPLY: starting
0807 18:16:18.621548 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:18.621659 (+ 111us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:18.621662 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:18.622344 (+ 682us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:18.622615 (+ 271us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:18.622626 (+ 11us) write_op.cc:312] APPLY: finished
0807 18:16:18.622820 (+ 194us) log.cc:842] Serialized 113 byte log entry
0807 18:16:18.622923 (+ 103us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.622965 (+ 42us) write_op.cc:454] Released schema lock
0807 18:16:18.622980 (+ 15us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:18.623101 (+ 121us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.623108 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:17.519139 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:17.519518 (+ 379us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:17.519526 (+ 8us) write_op.cc:435] Acquired schema lock
0807 18:16:17.519529 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:17.520899 (+ 1370us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:17.520925 (+ 26us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:17.520932 (+ 7us) tablet.cc:683] Acquiring locks for 14 operations
0807 18:16:17.521401 (+ 469us) tablet.cc:699] Row locks acquired
0807 18:16:17.521405 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:18.623469 (+1102064us) op_driver.cc:444] REPLICATION: finished
0807 18:16:18.624755 (+ 1286us) write_op.cc:301] APPLY: starting
0807 18:16:18.624770 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:18.624844 (+ 74us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:18.624847 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:18.625349 (+ 502us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:18.625428 (+ 79us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:18.625437 (+ 9us) write_op.cc:312] APPLY: finished
0807 18:16:18.625551 (+ 114us) log.cc:842] Serialized 101 byte log entry
0807 18:16:18.625629 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.625657 (+ 28us) write_op.cc:454] Released schema lock
0807 18:16:18.625667 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:18.625765 (+ 98us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.625769 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:17.546553 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:17.546712 (+ 159us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:17.546722 (+ 10us) write_op.cc:435] Acquired schema lock
0807 18:16:17.546725 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:17.546925 (+ 200us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:17.546945 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:17.546951 (+ 6us) tablet.cc:683] Acquiring locks for 11 operations
0807 18:16:17.547284 (+ 333us) tablet.cc:699] Row locks acquired
0807 18:16:17.547301 (+ 17us) write_op.cc:260] PREPARE: finished
0807 18:16:18.624636 (+1077335us) op_driver.cc:444] REPLICATION: finished
0807 18:16:18.625881 (+ 1245us) write_op.cc:301] APPLY: starting
0807 18:16:18.625895 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:18.625970 (+ 75us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:18.625973 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:18.626323 (+ 350us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:18.626480 (+ 157us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:18.626489 (+ 9us) write_op.cc:312] APPLY: finished
0807 18:16:18.626617 (+ 128us) log.cc:842] Serialized 83 byte log entry
0807 18:16:18.626712 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.626738 (+ 26us) write_op.cc:454] Released schema lock
0807 18:16:18.626746 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:18.626825 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.626829 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:17.550862 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:17.550988 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:17.550995 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:17.550998 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:17.551202 (+ 204us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:17.551216 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:17.551221 (+ 5us) tablet.cc:683] Acquiring locks for 14 operations
0807 18:16:17.551412 (+ 191us) tablet.cc:699] Row locks acquired
0807 18:16:17.551415 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:18.673910 (+1122495us) op_driver.cc:444] REPLICATION: finished
0807 18:16:18.676758 (+ 2848us) write_op.cc:301] APPLY: starting
0807 18:16:18.676779 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:18.676859 (+ 80us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:18.676865 (+ 6us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:18.677230 (+ 365us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:18.677515 (+ 285us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:18.677530 (+ 15us) write_op.cc:312] APPLY: finished
0807 18:16:18.677652 (+ 122us) log.cc:842] Serialized 101 byte log entry
0807 18:16:18.677727 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.677758 (+ 31us) write_op.cc:454] Released schema lock
0807 18:16:18.677769 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:18.683202 (+ 5433us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x61100006eb98. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa5fce86f25 00007fa602bfe076 00007fa602bfa7b2 00007fa602bf89fc 00007fa602bfb77b 00007fa602bfb5f8 00000000009edb7c 00007fa5f63f9344 00007fa5f63fc91b 00007fa5f63fc798
0807 18:16:18.683379 (+ 177us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.683386 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:17.551545 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:17.551639 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:17.551644 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:17.551646 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:17.552100 (+ 454us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:17.552116 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:17.552122 (+ 6us) tablet.cc:683] Acquiring locks for 16 operations
0807 18:16:17.552592 (+ 470us) tablet.cc:699] Row locks acquired
0807 18:16:17.552596 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:18.673976 (+1121380us) op_driver.cc:444] REPLICATION: finished
0807 18:16:18.678002 (+ 4026us) write_op.cc:301] APPLY: starting
0807 18:16:18.678017 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:18.678122 (+ 105us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:18.678124 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:18.678858 (+ 734us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:18.679715 (+ 857us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:18.679741 (+ 26us) write_op.cc:312] APPLY: finished
0807 18:16:18.679873 (+ 132us) log.cc:842] Serialized 113 byte log entry
0807 18:16:18.679946 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.680140 (+ 194us) write_op.cc:454] Released schema lock
0807 18:16:18.680246 (+ 106us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:18.685811 (+ 5565us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x61100006eb98. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa5fce86f25 00007fa602bfe076 00007fa602bfa7b2 00007fa602bf89fc 00007fa602bfb77b 00007fa602bfb5f8 00000000009edb7c 00007fa5f63f9344 00007fa5f63fc91b 00007fa5f63fc798
0807 18:16:18.685854 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.685860 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:17.552769 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:17.553292 (+ 523us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:17.553300 (+ 8us) write_op.cc:435] Acquired schema lock
0807 18:16:17.553303 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:17.553575 (+ 272us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:17.553594 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:17.553600 (+ 6us) tablet.cc:683] Acquiring locks for 13 operations
0807 18:16:17.553929 (+ 329us) tablet.cc:699] Row locks acquired
0807 18:16:17.553932 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:18.674017 (+1120085us) op_driver.cc:444] REPLICATION: finished
0807 18:16:18.680455 (+ 6438us) write_op.cc:301] APPLY: starting
0807 18:16:18.680857 (+ 402us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:18.680929 (+ 72us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:18.680933 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:18.681486 (+ 553us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:18.681564 (+ 78us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:18.681572 (+ 8us) write_op.cc:312] APPLY: finished
0807 18:16:18.681671 (+ 99us) log.cc:842] Serialized 95 byte log entry
0807 18:16:18.681739 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.681765 (+ 26us) write_op.cc:454] Released schema lock
0807 18:16:18.681774 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:18.681880 (+ 106us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:18.681884 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:17.554075 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:17.557388 (+ 3313us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:17.557395 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:17.557397 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:17.557841 (+ 444us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:17.557863 (+ 22us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:17.557869 (+ 6us) tablet.cc:683] Acquiring locks for 18 operations
0807 18:16:17.558119 (+ 250us) tablet.cc:699] Row locks acquired
0807 18:16:17.558122 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:18.674058 (+1
W20260807 18:16:19.367225 13118 leader_election.cc:334] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:19.376780 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260807 18:16:19.418705 13107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.67:33793, user_credentials={real_user=slave}} blocked reactor thread for 93220.6us
W20260807 18:16:19.447516 13118 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:19.472368 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260807 18:16:19.773779 13442 tablet_replica.cc:348] Time spent TabletReplica: tablet 4c7eca40645d4ee29079ced64fa54d37: Waiting for Ops to complete: real 5.066s user 0.060s sys 0.043s
W20260807 18:16:19.843946 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
I20260807 18:16:19.890867 13442 ts_tablet_manager.cc:1905] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 18:16:20.106133 13442 ts_tablet_manager.cc:1918] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.728
I20260807 18:16:20.109684 13442 log.cc:1196] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Deleting WAL directory at /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal/wals/4c7eca40645d4ee29079ced64fa54d37
I20260807 18:16:20.144709 13442 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51654 (request call id 0) took 7526 ms. Trace:
I20260807 18:16:20.155169 13442 rpcz_store.cc:276] 0807 18:16:12.616139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:12.616297 (+ 158us) service_pool.cc:227] Handling call
0807 18:16:12.849276 (+232979us) ts_tablet_manager.cc:1145] Deleting tablet 4c7eca40645d4ee29079ced64fa54d37
0807 18:16:12.849363 (+ 87us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 18:16:14.588748 (+1739385us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x6150000431a4. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6018ee74a 00007fa60551df16 00007fa605550404 00007fa605531870 00007fa6055315fd 00000000009edb7c 00007fa5f63f9344 00007fa5f63fc91b 00007fa5f63fc798 00000000009edb7c
0807 18:16:14.664774 (+ 76026us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x6150000431a4. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6018eb04d 00007fa602b8f5ec 00007fa60551e2e6 00007fa605550404 00007fa605531870 00007fa6055315fd 00000000009edb7c 00007fa5f63f9344 00007fa5f63fc91b 00007fa5f63fc798
0807 18:16:14.737088 (+ 72314us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.737129 (+ 41us) write_op.cc:454] Released schema lock
0807 18:16:14.743174 (+ 6045us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.743183 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:14.764946 (+ 21763us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.764956 (+ 10us) write_op.cc:454] Released schema lock
0807 18:16:14.765087 (+ 131us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.765092 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:14.772482 (+ 7390us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.772488 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:14.786074 (+ 13586us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.786081 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:14.818804 (+ 32723us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.818813 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:14.867180 (+ 48367us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.867185 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:14.867287 (+ 102us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.867290 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:14.867350 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.867354 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:14.867757 (+ 403us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.867767 (+ 10us) write_op.cc:454] Released schema lock
0807 18:16:14.867851 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.867854 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:14.867899 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.867901 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:14.868035 (+ 134us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.868039 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:14.875875 (+ 7836us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.875885 (+ 10us) write_op.cc:454] Released schema lock
0807 18:16:14.876131 (+ 246us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.876138 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:14.876219 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.878804 (+ 2585us) write_op.cc:454] Released schema lock
0807 18:16:14.920484 (+ 41680us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.920490 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:14.920684 (+ 194us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.920691 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:14.932816 (+ 12125us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.932823 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:14.932971 (+ 148us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.932975 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:14.933044 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.933048 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:14.933103 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.933110 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:14.941518 (+ 8408us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.941524 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:14.941627 (+ 103us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.941631 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:14.941709 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.941713 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:14.941763 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.941766 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:14.966303 (+ 24537us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.966311 (+ 8us) write_op.cc:454] Released schema lock
0807 18:16:14.966461 (+ 150us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.966465 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:14.966519 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.966523 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:14.987665 (+ 21142us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.987672 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:14.987876 (+ 204us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.987889 (+ 13us) write_op.cc:454] Released schema lock
0807 18:16:14.987993 (+ 104us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.988003 (+ 10us) write_op.cc:454] Released schema lock
0807 18:16:14.988075 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.988079 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:14.988216 (+ 137us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.988220 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:14.988280 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.988284 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:14.988345 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:14.988349 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.011584 (+ 23235us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.011590 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:15.011689 (+ 99us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.011692 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.011764 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.011767 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.011816 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.011819 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.011898 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.011901 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.041987 (+ 30086us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.041992 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:15.042237 (+ 245us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.042241 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.042323 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.042326 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.042442 (+ 116us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.042446 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.042491 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.042494 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.042569 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.042578 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:15.042688 (+ 110us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.042693 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:15.042914 (+ 221us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.042920 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:15.042990 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.042993 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.043046 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.043050 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.043103 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.043122 (+ 19us) write_op.cc:454] Released schema lock
0807 18:16:15.043178 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.043184 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:15.078357 (+ 35173us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.078367 (+ 10us) write_op.cc:454] Released schema lock
0807 18:16:15.078512 (+ 145us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.078516 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.078591 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.078594 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.078640 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.078643 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.161996 (+ 83353us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.162006 (+ 10us) write_op.cc:454] Released schema lock
0807 18:16:15.163954 (+ 1948us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.163967 (+ 13us) write_op.cc:454] Released schema lock
0807 18:16:15.164070 (+ 103us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.164076 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:15.164135 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.164140 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:15.165384 (+ 1244us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.165393 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:15.165521 (+ 128us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.165526 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:15.165581 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.165584 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.165635 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.165639 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.226641 (+ 61002us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.226653 (+ 12us) write_op.cc:454] Released schema lock
0807 18:16:15.226837 (+ 184us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.226842 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:15.226903 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.226906 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.226985 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.226989 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.248454 (+ 21465us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.248460 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:15.248607 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.248610 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.248883 (+ 273us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.248894 (+ 11us) write_op.cc:454] Released schema lock
0807 18:16:15.248961 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.248964 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.249004 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.249007 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.356965 (+107958us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.356971 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:15.357060 (+ 89us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357064 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.357111 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357115 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.357183 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357186 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.357242 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357246 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.357290 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357294 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.357347 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357409 (+ 62us) write_op.cc:454] Released schema lock
0807 18:16:15.357462 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357466 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.357512 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357516 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.357561 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357565 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.357615 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357619 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.357663 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357666 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.357707 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357710 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.357747 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357751 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.357788 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357791 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.357830 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.357836 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:15.358328 (+ 492us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.358335 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:15.358643 (+ 308us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.358649 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:15.358695 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.358698 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.358741 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.358744 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.358784 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.358788 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.358831 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.358834 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.358872 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.358875 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.358919 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.358922 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.358962 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.358965 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.359003 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.359006 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.442600 (+ 83594us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.442606 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:15.442717 (+ 111us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.442722 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:15.442768 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.442771 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.442824 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.442827 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.442881 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.442884 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.442929 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.442933 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.442988 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.442991 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.443049 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.443052 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.443101 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.443104 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.443147 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.443151 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.443193 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.443197 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.443246 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.443249 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.443296 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.443299 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.443590 (+ 291us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.443601 (+ 11us) write_op.cc:454] Released schema lock
0807 18:16:15.548472 (+104871us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.548481 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:15.548609 (+ 128us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.548613 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.548666 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.548670 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.548720 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.548724 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.548777 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.548781 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.548827 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.548831 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.548872 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.548875 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.548936 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.548940 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.548985 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.548988 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.700011 (+151023us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.700023 (+ 12us) write_op.cc:454] Released schema lock
0807 18:16:15.700302 (+ 279us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.700307 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:15.700363 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.700366 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.700404 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.700407 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.700445 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.700448 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.700485 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.700491 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:15.700533 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.700537 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.862717 (+162180us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.862725 (+ 8us) write_op.cc:454] Released schema lock
0807 18:16:15.862979 (+ 254us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.862986 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:15.863068 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.863072 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.863127 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.863130 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.863187 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.863193 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:15.863334 (+ 141us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.863339 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:15.863397 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.863401 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.863447 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.863450 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:15.863498 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.863502 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.863549 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.863553 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.863708 (+ 155us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.863715 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:15.863818 (+ 103us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.863822 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:15.863882 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:15.863889 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:16.715232 (+851343us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.715242 (+ 10us) write_op.cc:454] Released schema lock
0807 18:16:16.715369 (+ 127us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.715373 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:16.715433 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.715503 (+ 70us) write_op.cc:454] Released schema lock
0807 18:16:16.715571 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.715577 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:16.715626 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.715629 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.715681 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.715684 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.715730 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.715733 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.715802 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.715807 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:16.715873 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.715876 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.715991 (+ 115us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.715995 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:16.716055 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.716059 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:16.716105 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.716108 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.716155 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.716158 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.716206 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.716211 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:16.716350 (+ 139us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.716354 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:16.716407 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.716410 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.716480 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.716583 (+ 103us) write_op.cc:454] Released schema lock
0807 18:16:16.716761 (+ 178us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.716765 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:16.716878 (+ 113us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.716882 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:16.717122 (+ 240us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.717128 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:16.717358 (+ 230us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.717363 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:16.717415 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.717418 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.717465 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.717469 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:16.717516 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.717522 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:16.717572 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.717575 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.717622 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.717624 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:16.717678 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.717681 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.717726 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.717728 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:16.718049 (+ 321us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.718054 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:16.718130 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.718138 (+ 8us) write_op.cc:454] Released schema lock
0807 18:16:16.718184 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.718187 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.718230 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.718233 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:16.718282 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:16.718285 (+ 3us) write_op.cc:454] Released schema
I20260807 18:16:20.204478 11285 catalog_manager.cc:4841] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): tablet 4c7eca40645d4ee29079ced64fa54d37 (table test-workload [id=8bd0c38a73b949c3a98e549c83519895]) successfully deleted
W20260807 18:16:20.293702 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260807 18:16:20.304092 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 6: this message will repeat every 5th retry.
I20260807 18:16:20.334029 13260 raft_consensus.cc:858] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }.
Pending config: opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }:
New config: opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
W20260807 18:16:20.334666 13260 raft_consensus.cc:1565] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 998' and following 497 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 816 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }.
Pending config: opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }:
New config: opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
W20260807 18:16:20.370187 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260807 18:16:20.471053 13260 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.896: config changed from index 816 to 896, VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
W20260807 18:16:20.475208 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260807 18:16:20.496099 13540 ts_tablet_manager.cc:927] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Initiating tablet copy from peer 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889)
I20260807 18:16:20.531656 13540 tablet_copy_client.cc:316] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: tablet copy: Beginning tablet copy session from remote peer at address 127.10.253.68:43889
I20260807 18:16:20.569357 12103 tablet_copy_service.cc:140] P 22052958d03d426ebdc2fc310637c846: Received BeginTabletCopySession request for tablet 4c7eca40645d4ee29079ced64fa54d37 from peer 50da72adf57546f5bab0a028672a51dd ({username='slave'} at 127.10.253.65:40915)
I20260807 18:16:20.569592 12103 tablet_copy_service.cc:161] P 22052958d03d426ebdc2fc310637c846: Beginning new tablet copy session on tablet 4c7eca40645d4ee29079ced64fa54d37 from peer 50da72adf57546f5bab0a028672a51dd at {username='slave'} at 127.10.253.65:40915: session id = 50da72adf57546f5bab0a028672a51dd-4c7eca40645d4ee29079ced64fa54d37
I20260807 18:16:20.588502 12103 tablet_copy_source_session.cc:205] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 18:16:20.589048 13260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.253.68:42039 (request call id 60) took 1033 ms. Trace:
I20260807 18:16:20.613375 13540 ts_tablet_manager.cc:1905] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 18:16:20.650163 13540 ts_tablet_manager.cc:1918] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.728
I20260807 18:16:20.669924 13540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c7eca40645d4ee29079ced64fa54d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:16:20.718248 13540 tablet_copy_client.cc:791] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: tablet copy: Starting download of 0 data blocks...
I20260807 18:16:20.722481 13540 tablet_copy_client.cc:655] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: tablet copy: Starting download of 1 WAL segments...
W20260807 18:16:20.951375 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20260807 18:16:21.006464 13540 tablet_copy_client.cc:531] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 18:16:21.013577 13540 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Bootstrap starting.
W20260807 18:16:21.015599 13107 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletCopyService.FetchData -> {remote=127.10.253.68:43889, user_credentials={real_user=slave}} blocked reactor thread for 46154.2us
I20260807 18:16:20.589455 13260 rpcz_store.cc:276] 0807 18:16:19.555386 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:19.557027 (+ 1641us) service_pool.cc:227] Handling call
0807 18:16:19.821043 (+264016us) raft_consensus.cc:1457] Updating replica for 600 ops
0807 18:16:19.874830 (+ 53787us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 18:16:19.874836 (+ 6us) raft_consensus.cc:1525] Triggering prepare for 600 ops
0807 18:16:19.875188 (+ 352us) write_op.cc:270] Start()
0807 18:16:19.875228 (+ 40us) write_op.cc:276] Timestamp: P: 1786126558271410 usec, L: 0
0807 18:16:19.953410 (+ 78182us) write_op.cc:270] Start()
0807 18:16:19.953445 (+ 35us) write_op.cc:276] Timestamp: P: 1786126558279220 usec, L: 0
0807 18:16:19.963654 (+ 10209us) write_op.cc:270] Start()
0807 18:16:19.963704 (+ 50us) write_op.cc:276] Timestamp: P: 1786126558289560 usec, L: 0
0807 18:16:19.983742 (+ 20038us) write_op.cc:270] Start()
0807 18:16:19.983806 (+ 64us) write_op.cc:276] Timestamp: P: 1786126558301611 usec, L: 0
0807 18:16:19.990347 (+ 6541us) write_op.cc:270] Start()
0807 18:16:19.991081 (+ 734us) write_op.cc:276] Timestamp: P: 1786126558398431 usec, L: 0
0807 18:16:20.012930 (+ 21849us) write_op.cc:270] Start()
0807 18:16:20.012963 (+ 33us) write_op.cc:276] Timestamp: P: 1786126558404855 usec, L: 0
0807 18:16:20.019540 (+ 6577us) write_op.cc:270] Start()
0807 18:16:20.019652 (+ 112us) write_op.cc:276] Timestamp: P: 1786126558406078 usec, L: 0
0807 18:16:20.020060 (+ 408us) write_op.cc:270] Start()
0807 18:16:20.020090 (+ 30us) write_op.cc:276] Timestamp: P: 1786126558450804 usec, L: 0
0807 18:16:20.048330 (+ 28240us) write_op.cc:270] Start()
0807 18:16:20.048391 (+ 61us) write_op.cc:276] Timestamp: P: 1786126558559324 usec, L: 0
0807 18:16:20.048770 (+ 379us) write_op.cc:270] Start()
0807 18:16:20.048797 (+ 27us) write_op.cc:276] Timestamp: P: 1786126558563711 usec, L: 0
0807 18:16:20.049112 (+ 315us) write_op.cc:270] Start()
0807 18:16:20.049139 (+ 27us) write_op.cc:276] Timestamp: P: 1786126558583294 usec, L: 0
0807 18:16:20.049576 (+ 437us) write_op.cc:270] Start()
0807 18:16:20.049604 (+ 28us) write_op.cc:276] Timestamp: P: 1786126558595554 usec, L: 0
0807 18:16:20.049777 (+ 173us) write_op.cc:270] Start()
0807 18:16:20.049802 (+ 25us) write_op.cc:276] Timestamp: P: 1786126558708667 usec, L: 0
0807 18:16:20.050036 (+ 234us) write_op.cc:270] Start()
0807 18:16:20.050063 (+ 27us) write_op.cc:276] Timestamp: P: 1786126558733341 usec, L: 0
0807 18:16:20.050382 (+ 319us) write_op.cc:270] Start()
0807 18:16:20.050416 (+ 34us) write_op.cc:276] Timestamp: P: 1786126558777512 usec, L: 0
0807 18:16:20.050735 (+ 319us) write_op.cc:270] Start()
0807 18:16:20.050766 (+ 31us) write_op.cc:276] Timestamp: P: 1786126558785869 usec, L: 0
0807 18:16:20.050963 (+ 197us) write_op.cc:270] Start()
0807 18:16:20.050993 (+ 30us) write_op.cc:276] Timestamp: P: 1786126558844865 usec, L: 0
0807 18:16:20.051162 (+ 169us) write_op.cc:270] Start()
0807 18:16:20.051185 (+ 23us) write_op.cc:276] Timestamp: P: 1786126558849762 usec, L: 0
0807 18:16:20.076504 (+ 25319us) write_op.cc:270] Start()
0807 18:16:20.076535 (+ 31us) write_op.cc:276] Timestamp: P: 1786126558866564 usec, L: 0
0807 18:16:20.103304 (+ 26769us) write_op.cc:270] Start()
0807 18:16:20.103341 (+ 37us) write_op.cc:276] Timestamp: P: 1786126558872217 usec, L: 0
0807 18:16:20.103542 (+ 201us) write_op.cc:270] Start()
0807 18:16:20.103564 (+ 22us) write_op.cc:276] Timestamp: P: 1786126558940656 usec, L: 0
0807 18:16:20.103768 (+ 204us) write_op.cc:270] Start()
0807 18:16:20.103792 (+ 24us) write_op.cc:276] Timestamp: P: 1786126558943446 usec, L: 0
0807 18:16:20.104002 (+ 210us) write_op.cc:270] Start()
0807 18:16:20.104028 (+ 26us) write_op.cc:276] Timestamp: P: 1786126558946165 usec, L: 0
0807 18:16:20.104575 (+ 547us) write_op.cc:270] Start()
0807 18:16:20.104614 (+ 39us) write_op.cc:276] Timestamp: P: 1786126558947475 usec, L: 0
0807 18:16:20.104913 (+ 299us) write_op.cc:270] Start()
0807 18:16:20.104944 (+ 31us) write_op.cc:276] Timestamp: P: 1786126559014677 usec, L: 0
0807 18:16:20.105213 (+ 269us) write_op.cc:270] Start()
0807 18:16:20.105242 (+ 29us) write_op.cc:276] Timestamp: P: 1786126559020463 usec, L: 0
0807 18:16:20.106381 (+ 1139us) write_op.cc:270] Start()
0807 18:16:20.106411 (+ 30us) write_op.cc:276] Timestamp: P: 1786126559030658 usec, L: 0
0807 18:16:20.106934 (+ 523us) write_op.cc:270] Start()
0807 18:16:20.106966 (+ 32us) write_op.cc:276] Timestamp: P: 1786126559072868 usec, L: 0
0807 18:16:20.107726 (+ 760us) write_op.cc:270] Start()
0807 18:16:20.107772 (+ 46us) write_op.cc:276] Timestamp: P: 1786126559104688 usec, L: 0
0807 18:16:20.108068 (+ 296us) write_op.cc:270] Start()
0807 18:16:20.108093 (+ 25us) write_op.cc:276] Timestamp: P: 1786126559107060 usec, L: 0
0807 18:16:20.108253 (+ 160us) write_op.cc:270] Start()
0807 18:16:20.108275 (+ 22us) write_op.cc:276] Timestamp: P: 1786126559111994 usec, L: 0
0807 18:16:20.108431 (+ 156us) write_op.cc:270] Start()
0807 18:16:20.108446 (+ 15us) write_op.cc:276] Timestamp: P: 1786126559158460 usec, L: 0
0807 18:16:20.108657 (+ 211us) write_op.cc:270] Start()
0807 18:16:20.113807 (+ 5150us) write_op.cc:276] Timestamp: P: 1786126559179972 usec, L: 0
0807 18:16:20.114070 (+ 263us) write_op.cc:270] Start()
0807 18:16:20.114097 (+ 27us) write_op.cc:276] Timestamp: P: 1786126559183454 usec, L: 0
0807 18:16:20.114364 (+ 267us) write_op.cc:270] Start()
0807 18:16:20.114391 (+ 27us) write_op.cc:276] Timestamp: P: 1786126559184377 usec, L: 0
0807 18:16:20.114610 (+ 219us) write_op.cc:270] Start()
0807 18:16:20.114635 (+ 25us) write_op.cc:276] Timestamp: P: 1786126559219869 usec, L: 0
0807 18:16:20.114792 (+ 157us) write_op.cc:270] Start()
0807 18:16:20.114811 (+ 19us) write_op.cc:276] Timestamp: P: 1786126559242819 usec, L: 0
0807 18:16:20.115029 (+ 218us) write_op.cc:270] Start()
0807 18:16:20.115049 (+ 20us) write_op.cc:276] Timestamp: P: 1786126559253246 usec, L: 0
0807 18:16:20.115167 (+ 118us) write_op.cc:270] Start()
0807 18:16:20.115183 (+ 16us) write_op.cc:276] Timestamp: P: 1786126559261040 usec, L: 0
0807 18:16:20.115346 (+ 163us) write_op.cc:270] Start()
0807 18:16:20.115364 (+ 18us) write_op.cc:276] Timestamp: P: 1786126559301378 usec, L: 0
0807 18:16:20.116104 (+ 740us) write_op.cc:270] Start()
0807 18:16:20.116129 (+ 25us) write_op.cc:276] Timestamp: P: 1786126559303483 usec, L: 0
0807 18:16:20.116310 (+ 181us) write_op.cc:270] Start()
0807 18:16:20.116329 (+ 19us) write_op.cc:276] Timestamp: P: 1786126559333231 usec, L: 0
0807 18:16:20.116921 (+ 592us) write_op.cc:270] Start()
0807 18:16:20.116962 (+ 41us) write_op.cc:276] Timestamp: P: 1786126559354726 usec, L: 0
0807 18:16:20.174835 (+ 57873us) write_op.cc:270] Start()
0807 18:16:20.174896 (+ 61us) write_op.cc:276] Timestamp: P: 1786126559368947 usec, L: 0
0807 18:16:20.175193 (+ 297us) write_op.cc:270] Start()
0807 18:16:20.175408 (+ 215us) write_op.cc:276] Timestamp: P: 1786126559407987 usec, L: 0
0807 18:16:20.175847 (+ 439us) write_op.cc:270] Start()
0807 18:16:20.175889 (+ 42us) write_op.cc:276] Timestamp: P: 1786126559413751 usec, L: 0
0807 18:16:20.176189 (+ 300us) write_op.cc:270] Start()
0807 18:16:20.176218 (+ 29us) write_op.cc:276] Timestamp: P: 1786126559468757 usec, L: 0
0807 18:16:20.176423 (+ 205us) write_op.cc:270] Start()
0807 18:16:20.176449 (+ 26us) write_op.cc:276] Timestamp: P: 1786126559469770 usec, L: 0
0807 18:16:20.184556 (+ 8107us) write_op.cc:270] Start()
0807 18:16:20.184593 (+ 37us) write_op.cc:276] Timestamp: P: 1786126559518340 usec, L: 0
0807 18:16:20.184802 (+ 209us) write_op.cc:270] Start()
0807 18:16:20.184823 (+ 21us) write_op.cc:276] Timestamp: P: 1786126559544960 usec, L: 0
0807 18:16:20.184947 (+ 124us) write_op.cc:270] Start()
0807 18:16:20.184964 (+ 17us) write_op.cc:276] Timestamp: P: 1786126559547081 usec, L: 0
0807 18:16:20.194450 (+ 9486us) write_op.cc:270] Start()
0807 18:16:20.194479 (+ 29us) write_op.cc:276] Timestamp: P: 1786126559610358 usec, L: 0
0807 18:16:20.194659 (+ 180us) write_op.cc:270] Start()
0807 18:16:20.194680 (+ 21us) write_op.cc:276] Timestamp: P: 1786126559619698 usec, L: 0
0807 18:16:20.195231 (+ 551us) write_op.cc:270] Start()
0807 18:16:20.195253 (+ 22us) write_op.cc:276] Timestamp: P: 1786126559622746 usec, L: 0
0807 18:16:20.196962 (+ 1709us) write_op.cc:270] Start()
0807 18:16:20.196993 (+ 31us) write_op.cc:276] Timestamp: P: 1786126559628690 usec, L: 0
0807 18:16:20.199514 (+ 2521us) write_op.cc:270] Start()
0807 18:16:20.199541 (+ 27us) write_op.cc:276] Timestamp: P: 1786126559732227 usec, L: 0
0807 18:16:20.222121 (+ 22580us) write_op.cc:270] Start()
0807 18:16:20.222157 (+ 36us) write_op.cc:276] Timestamp: P: 1786126559735836 usec, L: 0
0807 18:16:20.222453 (+ 296us) write_op.cc:270] Start()
0807 18:16:20.222479 (+ 26us) write_op.cc:276] Timestamp: P: 1786126559760337 usec, L: 0
0807 18:16:20.222704 (+ 225us) write_op.cc:270] Start()
0807 18:16:20.222729 (+ 25us) write_op.cc:276] Timestamp: P: 1786126559807659 usec, L: 0
0807 18:16:20.222939 (+ 210us) write_op.cc:270] Start()
0807 18:16:20.223025 (+ 86us) write_op.cc:276] Timestamp: P: 1786126559826762 usec, L: 0
0807 18:16:20.223258 (+ 233us) write_op.cc:270] Start()
0807 18:16:20.223282 (+ 24us) write_op.cc:276] Timestamp: P: 1786126559833708 usec, L: 0
0807 18:16:20.223487 (+ 205us) write_op.cc:270] Start()
0807 18:16:20.223511 (+ 24us) write_op.cc:276] Timestamp: P: 1786126559846008 usec, L: 0
0807 18:16:20.223740 (+ 229us) write_op.cc:270] Start()
0807 18:16:20.223763 (+ 23us) write_op.cc:276] Timestamp: P: 1786126559876883 usec, L: 0
0807 18:16:20.223962 (+ 199us) write_op.cc:270] Start()
0807 18:16:20.228180 (+ 4218us) write_op.cc:276] Timestamp: P: 1786126559905454 usec, L: 0
0807 18:16:20.233474 (+ 5294us) write_op.cc:270] Start()
0807 18:16:20.233505 (+ 31us) write_op.cc:276] Timestamp: P: 1786126559926241 usec, L: 0
0807 18:16:20.237833 (+ 4328us) write_op.cc:270] Start()
0807 18:16:20.237871 (+ 38us) write_op.cc:276] Timestamp: P: 1786126559928709 usec, L: 0
0807 18:16:20.238138 (+ 267us) write_op.cc:270] Start()
0807 18:16:20.238165 (+ 27us) write_op.cc:276] Timestamp: P: 1786126559947295 usec, L: 0
0807 18:16:20.238399 (+ 234us) write_op.cc:270] Start()
0807 18:16:20.238428 (+ 29us) write_op.cc:276] Timestamp: P: 1786126559974729 usec, L: 0
0807 18:16:20.238761 (+ 333us) write_op.cc:270] Start()
0807 18:16:20.238788 (+ 27us) write_op.cc:276] Timestamp: P: 1786126559999257 usec, L: 0
0807 18:16:20.248308 (+ 9520us) write_op.cc:270] Start()
0807 18:16:20.248342 (+ 34us) write_op.cc:276] Timestamp: P: 1786126560003352 usec, L: 0
0807 18:16:20.248537 (+ 195us) write_op.cc:270] Start()
0807 18:16:20.248573 (+ 36us) write_op.cc:276] Timestamp: P: 1786126560038421 usec, L: 0
0807 18:16:20.248766 (+ 193us) write_op.cc:270] Start()
0807 18:16:20.248789 (+ 23us) write_op.cc:276] Timestamp: P: 1786126560059291 usec, L: 0
0807 18:16:20.248959 (+ 170us) write_op.cc:270] Start()
0807 18:16:20.248981 (+ 22us) write_op.cc:276] Timestamp: P: 1786126560088083 usec, L: 0
0807 18:16:20.249152 (+ 171us) write_op.cc:270] Start()
0807 18:16:20.249173 (+ 21us) write_op.cc:276] Timestamp: P: 1786126560103759 usec, L: 0
0807 18:16:20.249385 (+ 212us) write_op.cc:270] Start()
0807 18:16:20.249410 (+ 25us) write_op.cc:276] Timestamp: P: 1786126560130025 usec, L: 0
0807 18:16:20.249600 (+ 190us) write_op.cc:270] Start()
0807 18:16:20.249624 (+ 24us) write_op.cc:276] Timestamp: P: 1786126560148515 usec, L: 0
0807 18:16:20.249821 (+ 197us) write_op.cc:270] Start()
0807 18:16:20.249847 (+ 26us) write_op.cc:276] Timestamp: P: 1786126560150164 usec, L: 0
0807 18:16:20.250043 (+ 196us) write_op.cc:270] Start()
0807 18:16:20.250065 (+ 22us) write_op.cc:276] Timestamp: P: 1786126560190256 usec, L: 0
0807 18:16:20.250223 (+ 158us) write_op.cc:270] Start()
0807 18:16:20.250245 (+ 22us) write_op.cc:276] Timestamp: P: 1786126560223108 usec, L: 0
0807 18:16:20.250402 (+ 157us) write_op.cc:270] Start()
0807 18:16:20.250423 (+ 21us) write_op.cc:276] Timestamp: P: 1786126560225405 usec, L: 0
0807 18:16:20.250669 (+ 246us) write_op.cc:270] Start()
0807 18:16:20.250714 (+ 45us) write_op.cc:276] Timestamp: P: 1786126560239456 usec, L: 0
0807 18:16:20.252491 (+ 1777us) write_op.cc:270] Start()
0807 18:16:20.252544 (+ 53us) write_op.cc:276] Timestamp: P: 1786126560259356 usec, L: 0
0807 18:16:20.256214 (+ 3670us) write_op.cc:270] Start()
0807 18:16:20.256247 (+ 33us) write_op.cc:276] Timestamp: P: 1786126560325559 usec, L: 0
0807 18:16:20.298894 (+ 42647us) write_op.cc:270] Start()
0807 18:16:20.298982 (+ 88us) write_op.cc:276] Timestamp: P: 1786126560329263 usec, L: 0
0807 18:16:20.299273 (+ 291us) write_op.cc:270] Start()
0807 18:16:20.299299 (+ 26us) write_op.cc:276] Timestamp: P: 1786126560368969 usec, L: 0
0807 18:16:20.299511 (+ 212us) write_op.cc:270] Start()
0807 18:16:20.299533 (+ 22us) write_op.cc:276] Timestamp: P: 1786126560403077 usec, L: 0
0807 18:16:20.299701 (+ 168us) write_op.cc:270] Start()
0807 18:16:20.299722 (+ 21us) write_op.cc:276] Timestamp: P: 1786126560407339 usec, L: 0
0807 18:16:20.300848 (+ 1126us) write_op.cc:270] Start()
0807 18:16:20.300900 (+ 52us) write_op.cc:276] Timestamp: P: 1786126560420836 usec, L: 0
0807 18:16:20.301198 (+ 298us) write_op.cc:270] Start()
0807 18:16:20.301382 (+ 184us) write_op.cc:276] Timestamp: P: 1786126560473303 usec, L: 0
0807 18:16:20.301595 (+ 213us) write_op.cc:270] Start()
0807 18:16:20.301616 (+ 21us) write_op.cc:276] Timestamp: P: 1786126560497928 usec, L: 0
0807 18:16:20.301778 (+ 162us) write_op.cc:270] Start()
0807 18:16:20.301797 (+ 19us) write_op.cc:276] Timestamp: P: 1786126560520400 usec, L: 0
0807 18:16:20.301993 (+ 196us) write_op.cc:270] Start()
0807 18:16:20.302011 (+ 18us) write_op.cc:276] Timestamp: P: 1786126560527833 usec, L: 0
0807 18:16:20.302149 (+ 138us) write_op.cc:270] Start()
0807 18:16:20.302166 (+ 17us) write_op.cc:276] Timestamp: P: 1786126560546409 usec, L: 0
0807 18:16:20.302282 (+ 116us) write_op.cc:270] Start()
0807 18:16:20.302297 (+ 15us) write_op.cc:276] Timestamp: P: 1786126560663716 usec, L: 0
0807 18:16:20.302398 (+ 101us) write_op.cc:270] Start()
0807 18:16:20.302417 (+ 19us) write_op.cc:276] Timestamp: P: 1786126560671766 usec, L: 0
0807 18:16:20.303079 (+ 662us) write_op.cc:270] Start()
0807 18:16:20.303118 (+ 39us) write_op.cc:276] Timestamp: P: 1786126560683831 usec, L: 0
0807 18:16:20.303339 (+ 221us) write_op.cc:270] Start()
0807 18:16:20.303364 (+ 25us) write_op.cc:276] Timestamp: P: 1786126560689884 usec, L: 0
0807 18:16:20.303729 (+ 365us) write_op.cc:270] Start()
0807 18:16:20.303759 (+ 30us) write_op.cc:276] Timestamp: P: 1786126560770900 usec, L: 0
0807 18:16:20.308143 (+ 4384us) write_op.cc:270] Start()
0807 18:16:20.308175 (+ 32us) write_op.cc:276] Timestamp: P: 1786126560774074 usec, L: 0
0807 18:16:20.308455 (+ 280us) write_op.cc:270] Start()
0807 18:16:20.308480 (+ 25us) write_op.cc:276] Timestamp: P: 1786126560787842 usec, L: 0
0807 18:16:20.308715 (+ 235us) write_op.cc:270] Start()
0807 18:16:20.308742 (+ 27us) write_op.cc:276] Timestamp: P: 1786126560802527 usec, L: 0
0807 18:16:20.428283 (+119541us) log.cc:842] Serialized 102628 byte log entry
0807 18:16:20.470915 (+ 42632us) raft_consensus.cc:1631] Marking committed up to 997
0807 18:16:20.499788 (+ 28873us) log.cc:842] Serialized 15 byte log entry
0807 18:16:20.588680 (+ 88892us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 18:16:20.588710 (+ 30us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 18:16:20.588721 (+ 11us) raft_consensus.cc:1671] finished
0807 18:16:20.588723 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 18:16:20.588846 (+ 123us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 18:16:19.907163 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:19.907317 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:19.907324 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:19.907328 (+ 4us) tablet.cc:660] Decoding operations
0807 18:16:19.953518 (+ 46190us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:19.953551 (+ 33us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:19.953559 (+ 8us) tablet.cc:683] Acquiring locks for 24 operations
0807 18:16:19.953846 (+ 287us) tablet.cc:699] Row locks acquired
0807 18:16:19.953850 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:20.523123 (+569273us) op_driver.cc:444] REPLICATION: finished
0807 18:16:20.540104 (+ 16981us) write_op.cc:301] APPLY: starting
0807 18:16:20.540125 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:20.540435 (+ 310us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:20.540438 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:20.542145 (+ 1707us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:20.542284 (+ 139us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:20.542299 (+ 15us) write_op.cc:312] APPLY: finished
0807 18:16:20.542794 (+ 495us) log.cc:842] Serialized 164 byte log entry
0807 18:16:20.543655 (+ 861us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.543714 (+ 59us) write_op.cc:454] Released schema lock
0807 18:16:20.543735 (+ 21us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:20.544551 (+ 816us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.544561 (+ 10us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:19.958175 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:19.958322 (+ 147us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:19.958329 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:19.958331 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:19.963094 (+ 4763us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:19.963104 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:19.963108 (+ 4us) tablet.cc:683] Acquiring locks for 14 operations
0807 18:16:19.963333 (+ 225us) tablet.cc:699] Row locks acquired
0807 18:16:19.963336 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:20.539954 (+576618us) op_driver.cc:444] REPLICATION: finished
0807 18:16:20.544738 (+ 4784us) write_op.cc:301] APPLY: starting
0807 18:16:20.544760 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:20.544929 (+ 169us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:20.544935 (+ 6us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:20.545667 (+ 732us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:20.545791 (+ 124us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:20.545800 (+ 9us) write_op.cc:312] APPLY: finished
0807 18:16:20.546013 (+ 213us) log.cc:842] Serialized 101 byte log entry
0807 18:16:20.546352 (+ 339us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.546413 (+ 61us) write_op.cc:454] Released schema lock
0807 18:16:20.546427 (+ 14us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:20.546558 (+ 131us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.546564 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:19.963875 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:19.964005 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:19.964014 (+ 9us) write_op.cc:435] Acquired schema lock
0807 18:16:19.964018 (+ 4us) tablet.cc:660] Decoding operations
0807 18:16:19.989979 (+ 25961us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:19.990003 (+ 24us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:19.990011 (+ 8us) tablet.cc:683] Acquiring locks for 15 operations
0807 18:16:19.991539 (+ 1528us) tablet.cc:699] Row locks acquired
0807 18:16:19.991545 (+ 6us) write_op.cc:260] PREPARE: finished
0807 18:16:20.547382 (+555837us) op_driver.cc:444] REPLICATION: finished
0807 18:16:20.547488 (+ 106us) write_op.cc:301] APPLY: starting
0807 18:16:20.547502 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:20.547575 (+ 73us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:20.547579 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:20.548177 (+ 598us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:20.548329 (+ 152us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:20.548342 (+ 13us) write_op.cc:312] APPLY: finished
0807 18:16:20.548512 (+ 170us) log.cc:842] Serialized 107 byte log entry
0807 18:16:20.548897 (+ 385us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.548938 (+ 41us) write_op.cc:454] Released schema lock
0807 18:16:20.548952 (+ 14us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:20.549047 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.549054 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:19.992277 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:19.993931 (+ 1654us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:19.993938 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:19.993940 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:19.998969 (+ 5029us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:19.998995 (+ 26us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:19.999002 (+ 7us) tablet.cc:683] Acquiring locks for 10 operations
0807 18:16:19.999183 (+ 181us) tablet.cc:699] Row locks acquired
0807 18:16:19.999186 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:20.547487 (+548301us) op_driver.cc:444] REPLICATION: finished
0807 18:16:20.549990 (+ 2503us) write_op.cc:301] APPLY: starting
0807 18:16:20.550012 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:20.550099 (+ 87us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:20.550105 (+ 6us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:20.550672 (+ 567us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:20.550838 (+ 166us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:20.550852 (+ 14us) write_op.cc:312] APPLY: finished
0807 18:16:20.550989 (+ 137us) log.cc:842] Serialized 77 byte log entry
0807 18:16:20.551400 (+ 411us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.551434 (+ 34us) write_op.cc:454] Released schema lock
0807 18:16:20.551446 (+ 12us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:20.551537 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.551541 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:20.012594 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:20.012756 (+ 162us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:20.012776 (+ 20us) write_op.cc:435] Acquired schema lock
0807 18:16:20.012778 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:20.013398 (+ 620us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:20.013469 (+ 71us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:20.013477 (+ 8us) tablet.cc:683] Acquiring locks for 13 operations
0807 18:16:20.013820 (+ 343us) tablet.cc:699] Row locks acquired
0807 18:16:20.013823 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:20.547525 (+533702us) op_driver.cc:444] REPLICATION: finished
0807 18:16:20.551632 (+ 4107us) write_op.cc:301] APPLY: starting
0807 18:16:20.551643 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:20.551832 (+ 189us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:20.551835 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:20.552433 (+ 598us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:20.552560 (+ 127us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:20.552573 (+ 13us) write_op.cc:312] APPLY: finished
0807 18:16:20.552882 (+ 309us) log.cc:842] Serialized 95 byte log entry
0807 18:16:20.553371 (+ 489us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.553418 (+ 47us) write_op.cc:454] Released schema lock
0807 18:16:20.553431 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:20.553536 (+ 105us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.553550 (+ 14us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:20.013992 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:20.014095 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:20.014101 (+ 6us) write_op.cc:435] Acquired schema lock
0807 18:16:20.014103 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:20.014891 (+ 788us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:20.014908 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:20.014914 (+ 6us) tablet.cc:683] Acquiring locks for 18 operations
0807 18:16:20.015121 (+ 207us) tablet.cc:699] Row locks acquired
0807 18:16:20.015125 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:20.555398 (+540273us) op_driver.cc:444] REPLICATION: finished
0807 18:16:20.555520 (+ 122us) write_op.cc:301] APPLY: starting
0807 18:16:20.555536 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:20.556449 (+ 913us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:20.556452 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:20.558137 (+ 1685us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:20.558224 (+ 87us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:20.558231 (+ 7us) write_op.cc:312] APPLY: finished
0807 18:16:20.558469 (+ 238us) log.cc:842] Serialized 125 byte log entry
0807 18:16:20.559028 (+ 559us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.559057 (+ 29us) write_op.cc:454] Released schema lock
0807 18:16:20.559065 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:20.559632 (+ 567us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.559639 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:20.020867 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:20.021033 (+ 166us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:20.021040 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:20.021043 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:20.021411 (+ 368us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:20.021426 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:20.021431 (+ 5us) tablet.cc:683] Acquiring locks for 10 operations
0807 18:16:20.021558 (+ 127us) tablet.cc:699] Row locks acquired
0807 18:16:20.021561 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:20.555504 (+533943us) op_driver.cc:444] REPLICATION: finished
0807 18:16:20.555579 (+ 75us) write_op.cc:301] APPLY: starting
0807 18:16:20.555587 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:20.555646 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:20.555649 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:20.555972 (+ 323us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:20.556247 (+ 275us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:20.556257 (+ 10us) write_op.cc:312] APPLY: finished
0807 18:16:20.556470 (+ 213us) log.cc:842] Serialized 77 byte log entry
0807 18:16:20.556549 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.556578 (+ 29us) write_op.cc:454] Released schema lock
0807 18:16:20.556602 (+ 24us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:20.556710 (+ 108us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:20.556718 (+ 8us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:20.021718 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:20.021804 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:20.021809 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:20.021811 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:20.026459 (+ 4648us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:20.026474 (+ 15us) write_op.cc:641] Partit
I20260807 18:16:21.168608 13260 raft_consensus.cc:1467] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Allowing update even though not a member of the config
W20260807 18:16:21.174510 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
I20260807 18:16:21.273478 13261 raft_consensus.cc:858] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }.
Pending config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }:
New config: opid_index: 751 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:21.279532 13261 raft_consensus.cc:1565] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Could not prepare op 'term: 2 index: 751' and following 487 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } }.
Pending config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }:
New config: opid_index: 751 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:21.344614 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260807 18:16:21.509533 13573 log.cc:924] Time spent T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Append to log took a long time: real 0.058s user 0.008s sys 0.000s
W20260807 18:16:21.646498 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
I20260807 18:16:21.665205 13260 raft_consensus.cc:858] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }.
Pending config: opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }:
New config: opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:21.665650 13260 raft_consensus.cc:1565] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Could not prepare op 'term: 1 index: 1066' and following 482 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 896 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }.
Pending config: opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }:
New config: opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:21.793953 12327 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.10.253.68:43889, user_credentials={real_user=slave}} blocked reactor thread for 46671us
W20260807 18:16:21.810050 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20260807 18:16:21.914114 13261 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Committing config change with OpId 2.518: config changed from index -1 to 518, NON_VOTER 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) added. New config: { opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } } }
I20260807 18:16:22.087818 13260 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Committing config change with OpId 1.998: config changed from index 896 to 998, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:22.267277 13260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.253.68:42039 (request call id 64) took 1119 ms. Trace:
I20260807 18:16:22.301595 13161 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:55268 (request call id 16) took 2478 ms. Trace:
I20260807 18:16:22.301759 13161 rpcz_store.cc:276] 0807 18:16:19.818196 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:19.818279 (+ 83us) service_pool.cc:227] Handling call
0807 18:16:22.296362 (+2478083us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x6150000436a4. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6018bb630 00007fa605493c7f 00007fa5fffff016 00007fa5ffffed45 00007fa5fceef9be 00007fa5fceee79e 00007fa5fcef4b25 00007fa5fcef554f 00007fa5fcef5378 00000000009edb7c
0807 18:16:22.296972 (+ 610us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5697295232}
I20260807 18:16:22.306365 13491 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 18:16:22.319941 13542 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
W20260807 18:16:22.327260 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
I20260807 18:16:22.330518 13442 tablet_replica.cc:330] stopping tablet replica
I20260807 18:16:22.320365 13542 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 518 OBSOLETE_local: false peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: NON_VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: true } }
I20260807 18:16:22.337435 12249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 750 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:22.338757 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 750 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:22.355120 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 750 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:22.362694 13442 raft_consensus.cc:2229] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 18:16:22.366489 13442 raft_consensus.cc:2258] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 18:16:22.368183 13261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.253.68:42039 (request call id 57) took 3957 ms. Trace:
I20260807 18:16:22.382804 13542 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839)
I20260807 18:16:22.382867 13107 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
W20260807 18:16:22.389932 13107 raft_consensus.cc:2670] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260807 18:16:22.398131 11975 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.70:40077, user_credentials={real_user=slave}} blocked reactor thread for 51227.9us
W20260807 18:16:22.472132 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20260807 18:16:22.474263 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260807 18:16:22.704838 13118 leader_election.cc:334] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:22.288420 13260 rpcz_store.cc:276] 0807 18:16:21.137044 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:21.137123 (+ 79us) service_pool.cc:227] Handling call
0807 18:16:21.168446 (+ 31323us) raft_consensus.cc:1457] Updating replica for 551 ops
0807 18:16:21.366147 (+197701us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 18:16:21.366155 (+ 8us) raft_consensus.cc:1525] Triggering prepare for 551 ops
0807 18:16:21.366515 (+ 360us) write_op.cc:270] Start()
0807 18:16:21.366585 (+ 70us) write_op.cc:276] Timestamp: P: 1786126560969396 usec, L: 0
0807 18:16:21.367325 (+ 740us) write_op.cc:270] Start()
0807 18:16:21.367357 (+ 32us) write_op.cc:276] Timestamp: P: 1786126560975659 usec, L: 0
0807 18:16:21.367693 (+ 336us) write_op.cc:270] Start()
0807 18:16:21.367720 (+ 27us) write_op.cc:276] Timestamp: P: 1786126561005650 usec, L: 0
0807 18:16:21.367940 (+ 220us) write_op.cc:270] Start()
0807 18:16:21.367962 (+ 22us) write_op.cc:276] Timestamp: P: 1786126561008384 usec, L: 0
0807 18:16:21.376442 (+ 8480us) write_op.cc:270] Start()
0807 18:16:21.376488 (+ 46us) write_op.cc:276] Timestamp: P: 1786126561083002 usec, L: 0
0807 18:16:21.394280 (+ 17792us) write_op.cc:270] Start()
0807 18:16:21.394322 (+ 42us) write_op.cc:276] Timestamp: P: 1786126561085136 usec, L: 0
0807 18:16:21.411290 (+ 16968us) write_op.cc:270] Start()
0807 18:16:21.411373 (+ 83us) write_op.cc:276] Timestamp: P: 1786126561105819 usec, L: 0
0807 18:16:21.419811 (+ 8438us) write_op.cc:270] Start()
0807 18:16:21.419851 (+ 40us) write_op.cc:276] Timestamp: P: 1786126561140938 usec, L: 0
0807 18:16:21.420793 (+ 942us) write_op.cc:270] Start()
0807 18:16:21.420823 (+ 30us) write_op.cc:276] Timestamp: P: 1786126561172356 usec, L: 0
0807 18:16:21.421052 (+ 229us) write_op.cc:270] Start()
0807 18:16:21.421078 (+ 26us) write_op.cc:276] Timestamp: P: 1786126561188586 usec, L: 0
0807 18:16:21.421306 (+ 228us) write_op.cc:270] Start()
0807 18:16:21.421334 (+ 28us) write_op.cc:276] Timestamp: P: 1786126561254297 usec, L: 0
0807 18:16:21.421578 (+ 244us) write_op.cc:270] Start()
0807 18:16:21.421605 (+ 27us) write_op.cc:276] Timestamp: P: 1786126561269252 usec, L: 0
0807 18:16:21.421834 (+ 229us) write_op.cc:270] Start()
0807 18:16:21.421863 (+ 29us) write_op.cc:276] Timestamp: P: 1786126561280807 usec, L: 0
0807 18:16:21.422049 (+ 186us) write_op.cc:270] Start()
0807 18:16:21.422071 (+ 22us) write_op.cc:276] Timestamp: P: 1786126561316607 usec, L: 0
0807 18:16:21.422217 (+ 146us) write_op.cc:270] Start()
0807 18:16:21.422239 (+ 22us) write_op.cc:276] Timestamp: P: 1786126561358327 usec, L: 0
0807 18:16:21.422432 (+ 193us) write_op.cc:270] Start()
0807 18:16:21.422472 (+ 40us) write_op.cc:276] Timestamp: P: 1786126561365273 usec, L: 0
0807 18:16:21.422724 (+ 252us) write_op.cc:270] Start()
0807 18:16:21.422753 (+ 29us) write_op.cc:276] Timestamp: P: 1786126561405026 usec, L: 0
0807 18:16:21.422984 (+ 231us) write_op.cc:270] Start()
0807 18:16:21.423012 (+ 28us) write_op.cc:276] Timestamp: P: 1786126561409627 usec, L: 0
0807 18:16:21.423171 (+ 159us) write_op.cc:270] Start()
0807 18:16:21.423254 (+ 83us) write_op.cc:276] Timestamp: P: 1786126561467659 usec, L: 0
0807 18:16:21.424141 (+ 887us) write_op.cc:270] Start()
0807 18:16:21.424208 (+ 67us) write_op.cc:276] Timestamp: P: 1786126561470627 usec, L: 0
0807 18:16:21.470700 (+ 46492us) write_op.cc:270] Start()
0807 18:16:21.470784 (+ 84us) write_op.cc:276] Timestamp: P: 1786126561472408 usec, L: 0
0807 18:16:21.471182 (+ 398us) write_op.cc:270] Start()
0807 18:16:21.471214 (+ 32us) write_op.cc:276] Timestamp: P: 1786126561527954 usec, L: 0
0807 18:16:21.471461 (+ 247us) write_op.cc:270] Start()
0807 18:16:21.471491 (+ 30us) write_op.cc:276] Timestamp: P: 1786126561555027 usec, L: 0
0807 18:16:21.471752 (+ 261us) write_op.cc:270] Start()
0807 18:16:21.471781 (+ 29us) write_op.cc:276] Timestamp: P: 1786126561563423 usec, L: 0
0807 18:16:21.472014 (+ 233us) write_op.cc:270] Start()
0807 18:16:21.472045 (+ 31us) write_op.cc:276] Timestamp: P: 1786126561571251 usec, L: 0
0807 18:16:21.472257 (+ 212us) write_op.cc:270] Start()
0807 18:16:21.472287 (+ 30us) write_op.cc:276] Timestamp: P: 1786126561601504 usec, L: 0
0807 18:16:21.472473 (+ 186us) write_op.cc:270] Start()
0807 18:16:21.472499 (+ 26us) write_op.cc:276] Timestamp: P: 1786126561670413 usec, L: 0
0807 18:16:21.472702 (+ 203us) write_op.cc:270] Start()
0807 18:16:21.472728 (+ 26us) write_op.cc:276] Timestamp: P: 1786126561673047 usec, L: 0
0807 18:16:21.472945 (+ 217us) write_op.cc:270] Start()
0807 18:16:21.472976 (+ 31us) write_op.cc:276] Timestamp: P: 1786126561679471 usec, L: 0
0807 18:16:21.473184 (+ 208us) write_op.cc:270] Start()
0807 18:16:21.473233 (+ 49us) write_op.cc:276] Timestamp: P: 1786126561760719 usec, L: 0
0807 18:16:21.473420 (+ 187us) write_op.cc:270] Start()
0807 18:16:21.473448 (+ 28us) write_op.cc:276] Timestamp: P: 1786126561828995 usec, L: 0
0807 18:16:21.473717 (+ 269us) write_op.cc:270] Start()
0807 18:16:21.473747 (+ 30us) write_op.cc:276] Timestamp: P: 1786126561840985 usec, L: 0
0807 18:16:21.474007 (+ 260us) write_op.cc:270] Start()
0807 18:16:21.474037 (+ 30us) write_op.cc:276] Timestamp: P: 1786126561859118 usec, L: 0
0807 18:16:21.474260 (+ 223us) write_op.cc:270] Start()
0807 18:16:21.474289 (+ 29us) write_op.cc:276] Timestamp: P: 1786126561895669 usec, L: 0
0807 18:16:21.534633 (+ 60344us) write_op.cc:270] Start()
0807 18:16:21.534686 (+ 53us) write_op.cc:276] Timestamp: P: 1786126561910726 usec, L: 0
0807 18:16:21.535341 (+ 655us) write_op.cc:270] Start()
0807 18:16:21.535373 (+ 32us) write_op.cc:276] Timestamp: P: 1786126561922827 usec, L: 0
0807 18:16:21.535554 (+ 181us) write_op.cc:270] Start()
0807 18:16:21.535578 (+ 24us) write_op.cc:276] Timestamp: P: 1786126561955677 usec, L: 0
0807 18:16:21.535760 (+ 182us) write_op.cc:270] Start()
0807 18:16:21.535783 (+ 23us) write_op.cc:276] Timestamp: P: 1786126562054132 usec, L: 0
0807 18:16:21.536109 (+ 326us) write_op.cc:270] Start()
0807 18:16:21.536137 (+ 28us) write_op.cc:276] Timestamp: P: 1786126562063953 usec, L: 0
0807 18:16:21.536288 (+ 151us) write_op.cc:270] Start()
0807 18:16:21.536310 (+ 22us) write_op.cc:276] Timestamp: P: 1786126562147274 usec, L: 0
0807 18:16:21.536518 (+ 208us) write_op.cc:270] Start()
0807 18:16:21.536542 (+ 24us) write_op.cc:276] Timestamp: P: 1786126562148344 usec, L: 0
0807 18:16:21.536847 (+ 305us) write_op.cc:270] Start()
0807 18:16:21.536886 (+ 39us) write_op.cc:276] Timestamp: P: 1786126562170033 usec, L: 0
0807 18:16:21.537115 (+ 229us) write_op.cc:270] Start()
0807 18:16:21.537140 (+ 25us) write_op.cc:276] Timestamp: P: 1786126562186472 usec, L: 0
0807 18:16:21.537292 (+ 152us) write_op.cc:270] Start()
0807 18:16:21.537316 (+ 24us) write_op.cc:276] Timestamp: P: 1786126562296192 usec, L: 0
0807 18:16:21.538104 (+ 788us) write_op.cc:270] Start()
0807 18:16:21.538130 (+ 26us) write_op.cc:276] Timestamp: P: 1786126562314920 usec, L: 0
0807 18:16:21.538317 (+ 187us) write_op.cc:270] Start()
0807 18:16:21.538344 (+ 27us) write_op.cc:276] Timestamp: P: 1786126562316447 usec, L: 0
0807 18:16:21.543970 (+ 5626us) write_op.cc:270] Start()
0807 18:16:21.544027 (+ 57us) write_op.cc:276] Timestamp: P: 1786126562365741 usec, L: 0
0807 18:16:21.544496 (+ 469us) write_op.cc:270] Start()
0807 18:16:21.544527 (+ 31us) write_op.cc:276] Timestamp: P: 1786126562468914 usec, L: 0
0807 18:16:21.544715 (+ 188us) write_op.cc:270] Start()
0807 18:16:21.544739 (+ 24us) write_op.cc:276] Timestamp: P: 1786126562477700 usec, L: 0
0807 18:16:21.544939 (+ 200us) write_op.cc:270] Start()
0807 18:16:21.544965 (+ 26us) write_op.cc:276] Timestamp: P: 1786126562546478 usec, L: 0
0807 18:16:21.545190 (+ 225us) write_op.cc:270] Start()
0807 18:16:21.545220 (+ 30us) write_op.cc:276] Timestamp: P: 1786126562551218 usec, L: 0
0807 18:16:21.545426 (+ 206us) write_op.cc:270] Start()
0807 18:16:21.545450 (+ 24us) write_op.cc:276] Timestamp: P: 1786126562557356 usec, L: 0
0807 18:16:21.545648 (+ 198us) write_op.cc:270] Start()
0807 18:16:21.545674 (+ 26us) write_op.cc:276] Timestamp: P: 1786126562614253 usec, L: 0
0807 18:16:21.590908 (+ 45234us) write_op.cc:270] Start()
0807 18:16:21.590958 (+ 50us) write_op.cc:276] Timestamp: P: 1786126562686914 usec, L: 0
0807 18:16:21.591338 (+ 380us) write_op.cc:270] Start()
0807 18:16:21.591363 (+ 25us) write_op.cc:276] Timestamp: P: 1786126562704715 usec, L: 0
0807 18:16:21.591694 (+ 331us) write_op.cc:270] Start()
0807 18:16:21.591720 (+ 26us) write_op.cc:276] Timestamp: P: 1786126562716754 usec, L: 0
0807 18:16:21.591911 (+ 191us) write_op.cc:270] Start()
0807 18:16:21.591942 (+ 31us) write_op.cc:276] Timestamp: P: 1786126562735542 usec, L: 0
0807 18:16:21.592177 (+ 235us) write_op.cc:270] Start()
0807 18:16:21.592205 (+ 28us) write_op.cc:276] Timestamp: P: 1786126562774255 usec, L: 0
0807 18:16:21.592379 (+ 174us) write_op.cc:270] Start()
0807 18:16:21.592402 (+ 23us) write_op.cc:276] Timestamp: P: 1786126562775645 usec, L: 0
0807 18:16:21.592543 (+ 141us) write_op.cc:270] Start()
0807 18:16:21.594515 (+ 1972us) write_op.cc:276] Timestamp: P: 1786126562846426 usec, L: 0
0807 18:16:21.594890 (+ 375us) write_op.cc:270] Start()
0807 18:16:21.594916 (+ 26us) write_op.cc:276] Timestamp: P: 1786126562854851 usec, L: 0
0807 18:16:21.609715 (+ 14799us) write_op.cc:270] Start()
0807 18:16:21.609766 (+ 51us) write_op.cc:276] Timestamp: P: 1786126562894143 usec, L: 0
0807 18:16:21.637282 (+ 27516us) write_op.cc:270] Start()
0807 18:16:21.637337 (+ 55us) write_op.cc:276] Timestamp: P: 1786126562899742 usec, L: 0
0807 18:16:21.641838 (+ 4501us) write_op.cc:270] Start()
0807 18:16:21.641882 (+ 44us) write_op.cc:276] Timestamp: P: 1786126562934079 usec, L: 0
0807 18:16:21.653132 (+ 11250us) write_op.cc:270] Start()
0807 18:16:21.653315 (+ 183us) write_op.cc:276] Timestamp: P: 1786126562994324 usec, L: 0
0807 18:16:21.653713 (+ 398us) write_op.cc:270] Start()
0807 18:16:21.653758 (+ 45us) write_op.cc:276] Timestamp: P: 1786126563022901 usec, L: 0
0807 18:16:21.656389 (+ 2631us) write_op.cc:270] Start()
0807 18:16:21.656426 (+ 37us) write_op.cc:276] Timestamp: P: 1786126563023876 usec, L: 0
0807 18:16:21.953926 (+297500us) log.cc:842] Serialized 71515 byte log entry
0807 18:16:22.031214 (+ 77288us) raft_consensus.cc:1631] Marking committed up to 1065
0807 18:16:22.158150 (+126936us) log.cc:842] Serialized 15 byte log entry
0807 18:16:22.256669 (+ 98519us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 18:16:22.256699 (+ 30us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 18:16:22.256712 (+ 13us) raft_consensus.cc:1671] finished
0807 18:16:22.256717 (+ 5us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 18:16:22.256797 (+ 80us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 18:16:21.366844 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.366960 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.366965 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:21.366968 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.367165 (+ 197us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.367184 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.367189 (+ 5us) tablet.cc:683] Acquiring locks for 11 operations
0807 18:16:21.367494 (+ 305us) tablet.cc:699] Row locks acquired
0807 18:16:21.367498 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:22.224785 (+857287us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.368568 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.368733 (+ 165us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.368740 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:21.368743 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.369009 (+ 266us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.369026 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.369032 (+ 6us) tablet.cc:683] Acquiring locks for 13 operations
0807 18:16:21.369259 (+ 227us) tablet.cc:699] Row locks acquired
0807 18:16:21.369262 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:22.224890 (+855628us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.369393 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.369523 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.369528 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:21.369530 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:21.374831 (+ 5301us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.374852 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.374862 (+ 10us) tablet.cc:683] Acquiring locks for 20 operations
0807 18:16:21.375087 (+ 225us) tablet.cc:699] Row locks acquired
0807 18:16:21.375090 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:22.224936 (+849846us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.375238 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.375319 (+ 81us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.375324 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:21.375326 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:21.375572 (+ 246us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.375597 (+ 25us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.375602 (+ 5us) tablet.cc:683] Acquiring locks for 20 operations
0807 18:16:21.376129 (+ 527us) tablet.cc:699] Row locks acquired
0807 18:16:21.376133 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:22.224982 (+848849us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.376652 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.376929 (+ 277us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.376935 (+ 6us) write_op.cc:435] Acquired schema lock
0807 18:16:21.376938 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.377122 (+ 184us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.377133 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.377138 (+ 5us) tablet.cc:683] Acquiring locks for 16 operations
0807 18:16:21.377416 (+ 278us) tablet.cc:699] Row locks acquired
0807 18:16:21.377419 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:22.225026 (+847607us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.405618 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.405824 (+ 206us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.405832 (+ 8us) write_op.cc:435] Acquired schema lock
0807 18:16:21.405835 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.406154 (+ 319us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.406171 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.406177 (+ 6us) tablet.cc:683] Acquiring locks for 21 operations
0807 18:16:21.406443 (+ 266us) tablet.cc:699] Row locks acquired
0807 18:16:21.406447 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:22.225072 (+818625us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.418680 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.418766 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.418770 (+ 4us) write_op.cc:435] Acquired schema lock
0807 18:16:21.418773 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.418964 (+ 191us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.418977 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.418983 (+ 6us) tablet.cc:683] Acquiring locks for 17 operations
0807 18:16:21.419422 (+ 439us) tablet.cc:699] Row locks acquired
0807 18:16:21.419426 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:22.225112 (+805686us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.420017 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.420104 (+ 87us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.420109 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:21.420112 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.420313 (+ 201us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.420326 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.420331 (+ 5us) tablet.cc:683] Acquiring locks for 15 operations
0807 18:16:21.420535 (+ 204us) tablet.cc:699] Row locks acquired
0807 18:16:21.420538 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:22.225159 (+804621us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.424027 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.427233 (+ 3206us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.427241 (+ 8us) write_op.cc:435] Acquired schema lock
0807 18:16:21.427244 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.450326 (+ 23082us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.450352 (+ 26us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.450359 (+ 7us) tablet.cc:683] Acquiring locks for 20 operations
0807 18:16:21.452484 (+ 2125us) tablet.cc:699] Row locks acquired
0807 18:16:21.452490 (+ 6us) write_op.cc:260] PREPARE: finished
0807 18:16:22.225398 (+772908us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.452675 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.452843 (+ 168us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.452851 (+ 8us) write_op.cc:435] Acquired schema lock
0807 18:16:21.452853 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:21.453071 (+ 218us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.453093 (+ 22us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.453100 (+ 7us) tablet.cc:683] Acquiring locks for 14 operations
0807 18:16:21.453564 (+ 464us) tablet.cc:699] Row locks acquired
0807 18:16:21.453567 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:22.225774 (+772207us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.453995 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.454177 (+ 182us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.454186 (+ 9us) write_op.cc:435] Acquired schema lock
0807 18:16:21.454189 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.454452 (+ 263us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.454471 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.454479 (+ 8us) tablet.cc:683] Acquiring locks for 22 operations
0807 18:16:21.455685 (+ 1206us) tablet.cc:699] Row locks acquired
0807 18:16:21.455690 (+ 5us) write_op.cc:260] PREPARE: finished
0807 18:16:22.225841 (+770151us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.455835 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.455933 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.455938 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:21.455941 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.456194 (+ 253us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.456208 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.456213 (+ 5us) tablet.cc:683] Acquiring locks for 17 operations
0807 18:16:21.457411 (+ 1198us) tablet.cc:699] Row locks acquired
0807 18:16:21.457415 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:22.225887 (+768472us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.457572 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.457855 (+ 283us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.457864 (+ 9us) write_op.cc:435] Acquired schema lock
0807 18:16:21.457867 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.458093 (+ 226us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.458110 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.458116 (+ 6us) tablet.cc:683] Acquiring locks for 16 operations
0807 18:16:21.458433 (+ 317us) tablet.cc:699] Row locks acquired
0807 18:16:21.458437 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:22.225934 (+767497us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.458629 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.458742 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.458749 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:21.458752 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.459073 (+ 321us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.459090 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.459095 (+ 5us) tablet.cc:683] Acquiring locks for 19 operations
0807 18:16:21.459311 (+ 216us) tablet.cc:699] Row locks acquired
0807 18:16:21.459315 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:22.225978 (+766663us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.460171 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.460276 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.460281 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:21.460283 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:21.460554 (+ 271us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.460571 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.460578 (+ 7us) tablet.cc:683] Acquiring locks for 22 operations
0807 18:16:21.460811 (+ 233us) tablet.cc:699] Row locks acquired
0807 18:16:21.460814 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:22.228836 (+768022us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.460916 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.461008 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.461014 (+ 6us) write_op.cc:435] Acquired schema lock
0807 18:16:21.461016 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:21.461155 (+ 139us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.461166 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.461171 (+ 5us) tablet.cc:683] Acquiring locks for 10 operations
0807 18:16:21.461300 (+ 129us) tablet.cc:699] Row locks acquired
0807 18:16:21.461303 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:22.228952 (+767649us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.461394 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.461476 (+ 82us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.461488 (+ 12us) write_op.cc:435] Acquired schema lock
0807 18:16:21.461491 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.461924 (+ 433us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.461944 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.461953 (+ 9us) tablet.cc:683] Acquiring locks for 17 operations
0807 18:16:21.462436 (+ 483us) tablet.cc:699] Row locks acquired
0807 18:16:21.462442 (+ 6us) write_op.cc:260] PREPARE: finished
0807 18:16:22.241925 (+779483us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.512583 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.512722 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.512729 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:21.512732 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:21.513153 (+ 421us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.513173 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.513179 (+ 6us) tablet.cc:683] Acquiring locks for 22 operations
0807 18:16:21.513538 (+ 359us) tablet.cc:699] Row locks acquired
0807 18:16:21.513542 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:22.242037 (+728495us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.513665 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.513754 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.513759 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:21.513761 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:21.514109 (+ 348us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.514126 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.514132 (+ 6us) tablet.cc:683] Acquiring locks for 19 operations
0807 18:16:21.514314 (+ 182us) tablet.cc:699] Row locks acquired
0807 18:16:21.514317 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:22.242094 (+727777us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.514428 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.514514 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.514519 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:21.514521 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:21.514743 (+ 222us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.514757 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.514761 (+ 4us) tablet.cc:683] Acquiring locks for 16 operations
0807 18:16:21.514941 (+ 180us) tablet.cc:699] Row locks acquired
0807 18:16:21.514944 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:22.242123 (+727179us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.515078 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.515155 (+ 77us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.515160 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:21.515162 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:21.515296 (+ 134us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.515308 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.515313 (+ 5us) tablet.cc:683] Acquiring locks for 12 operations
0807 18:16:21.515525 (+ 212us) tablet.cc:699] Row locks acquired
0807 18:16:21.515529 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:22.242153 (+726624us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.515619 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.515723 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.515728 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:21.515730 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:21.517543 (+ 1813us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.517566 (+ 23us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.517571 (+ 5us) tablet.cc:683] Acquiring locks for 16 operations
0807 18:16:21.517878 (+ 307us) tablet.cc:699] Row locks acquired
0807 18:16:21.517881 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:22.242178 (+724297us) op_driver.cc:444] REPLICATION: finished
Related trace 'op':
0807 18:16:21.518097 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:21.518176 (+ 79us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:21.518180 (+ 4us) write_op.cc:435] Acquired schema lock
0807 18:16:21.518182 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:21.518379 (+ 197us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:21.518391 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:21.518396 (+ 5us) tablet.cc:683] Acquiring locks for 12 operations
0807 18:16:21.518580 (+ 18
I20260807 18:16:22.802734 13258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.253.68:42039 (request call id 65) took 1169 ms. Trace:
I20260807 18:16:22.804077 13258 rpcz_store.cc:276] 0807 18:16:21.627857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:21.627931 (+ 74us) service_pool.cc:227] Handling call
0807 18:16:22.797481 (+1169550us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 18:16:23.110356 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260807 18:16:23.210139 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260807 18:16:23.247849 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20260807 18:16:23.391825 13442 op_tracker.cc:283] OpTracker waiting for 254 outstanding ops to complete now for 1.006s
I20260807 18:16:23.392026 13442 op_tracker.cc:285] Dumping up to 50 currently running ops:
I20260807 18:16:23.398659 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000290f00 [op_id=(term: 2 index: 687), ts=7315974352158269440, rows=[]]]
I20260807 18:16:23.399032 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000290b80 [op_id=(term: 2 index: 686), ts=7315974351969427456, rows=[]]]
I20260807 18:16:23.429392 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000290800 [op_id=(term: 2 index: 685), ts=7315974351907966976, rows=[]]]
I20260807 18:16:23.429692 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000290480 [op_id=(term: 2 index: 684), ts=7315974351819202560, rows=[]]]
I20260807 18:16:23.431020 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000290100 [op_id=(term: 2 index: 683), ts=7315974351670616064, rows=[]]]
I20260807 18:16:23.431483 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028fd80 [op_id=(term: 2 index: 682), ts=7315974351511552000, rows=[]]]
I20260807 18:16:23.435905 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028fa00 [op_id=(term: 2 index: 681), ts=7315974351457296384, rows=[]]]
I20260807 18:16:23.436532 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028f680 [op_id=(term: 2 index: 680), ts=7315974351375626240, rows=[]]]
I20260807 18:16:23.442921 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028f300 [op_id=(term: 2 index: 679), ts=7315974350960717824, rows=[]]]
I20260807 18:16:23.510905 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028ef80 [op_id=(term: 2 index: 678), ts=7315974350951645184, rows=[]]]
I20260807 18:16:23.540975 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028ec00 [op_id=(term: 2 index: 677), ts=7315974350932058112, rows=[]]]
I20260807 18:16:23.541260 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028e880 [op_id=(term: 2 index: 676), ts=7315974350546743296, rows=[]]]
I20260807 18:16:23.541467 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028e500 [op_id=(term: 2 index: 675), ts=7315974350231404544, rows=[]]]
I20260807 18:16:23.541646 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028e180 [op_id=(term: 2 index: 674), ts=7315974350176530432, rows=[]]]
I20260807 18:16:23.541846 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028de00 [op_id=(term: 2 index: 673), ts=7315974349933682688, rows=[]]]
I20260807 18:16:23.542049 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028da80 [op_id=(term: 2 index: 672), ts=7315974349678227456, rows=[]]]
I20260807 18:16:23.542349 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028d700 [op_id=(term: 2 index: 671), ts=7315974349660323840, rows=[]]]
I20260807 18:16:23.542644 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028d380 [op_id=(term: 2 index: 670), ts=7315974349530103808, rows=[]]]
I20260807 18:16:23.543023 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028d000 [op_id=(term: 2 index: 669), ts=7315974349288095744, rows=[]]]
I20260807 18:16:23.543258 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028cc80 [op_id=(term: 2 index: 668), ts=7315974349226852352, rows=[]]]
I20260807 18:16:23.543514 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028c900 [op_id=(term: 2 index: 667), ts=7315974349093548032, rows=[]]]
I20260807 18:16:23.543694 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028c580 [op_id=(term: 2 index: 666), ts=7315974348847411200, rows=[]]]
I20260807 18:16:23.544129 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028c200 [op_id=(term: 2 index: 665), ts=7315974348827365376, rows=[]]]
I20260807 18:16:23.572130 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028be80 [op_id=(term: 2 index: 664), ts=7315974348765708288, rows=[]]]
I20260807 18:16:23.592350 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028bb00 [op_id=(term: 2 index: 663), ts=7315974348523757568, rows=[]]]
I20260807 18:16:23.592991 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028b780 [op_id=(term: 2 index: 662), ts=7315974348439973888, rows=[]]]
I20260807 18:16:23.593456 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028b400 [op_id=(term: 2 index: 661), ts=7315974348368969728, rows=[]]]
I20260807 18:16:23.593765 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028b080 [op_id=(term: 2 index: 660), ts=7315974347980980224, rows=[]]]
I20260807 18:16:23.595228 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028ad00 [op_id=(term: 2 index: 659), ts=7315974347832041472, rows=[]]]
I20260807 18:16:23.596045 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028a980 [op_id=(term: 2 index: 658), ts=7315974347643928576, rows=[]]]
I20260807 18:16:23.599589 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028a600 [op_id=(term: 2 index: 657), ts=7315974347630350336, rows=[]]]
I20260807 18:16:23.599905 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x61700028a280 [op_id=(term: 2 index: 656), ts=7315974347500650496, rows=[]]]
I20260807 18:16:23.601142 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000289f00 [op_id=(term: 2 index: 655), ts=7315974347115360256, rows=[]]]
I20260807 18:16:23.601346 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000289b80 [op_id=(term: 2 index: 654), ts=7315974347076186112, rows=[]]]
I20260807 18:16:23.635605 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000289800 [op_id=(term: 2 index: 653), ts=7315974347007934464, rows=[]]]
I20260807 18:16:23.646324 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000289480 [op_id=(term: 2 index: 652), ts=7315974346780323840, rows=[]]]
I20260807 18:16:23.651664 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000289100 [op_id=(term: 2 index: 651), ts=7315974346536382464, rows=[]]]
I20260807 18:16:23.652256 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000288d80 [op_id=(term: 2 index: 650), ts=7315974346439950336, rows=[]]]
I20260807 18:16:23.653010 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000288a00 [op_id=(term: 2 index: 649), ts=7315974346413383680, rows=[]]]
I20260807 18:16:23.654398 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000288680 [op_id=(term: 2 index: 648), ts=7315974345873727488, rows=[]]]
I20260807 18:16:23.659464 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000288300 [op_id=(term: 2 index: 647), ts=7315974345853624320, rows=[]]]
I20260807 18:16:23.659796 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000287f80 [op_id=(term: 2 index: 646), ts=7315974345805590528, rows=[]]]
I20260807 18:16:23.660104 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000287c00 [op_id=(term: 2 index: 645), ts=7315974345791647744, rows=[]]]
I20260807 18:16:23.670769 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000287880 [op_id=(term: 2 index: 644), ts=7315974345235042304, rows=[]]]
I20260807 18:16:23.712543 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000287500 [op_id=(term: 2 index: 643), ts=7315974345021558784, rows=[]]]
I20260807 18:16:23.718739 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000287180 [op_id=(term: 2 index: 642), ts=7315974345013501952, rows=[]]]
I20260807 18:16:23.721593 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000286e00 [op_id=(term: 2 index: 641), ts=7315974344895868928, rows=[]]]
I20260807 18:16:23.723717 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000286a80 [op_id=(term: 2 index: 640), ts=7315974344845848576, rows=[]]]
I20260807 18:16:23.727483 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000286700 [op_id=(term: 2 index: 639), ts=7315974344320311296, rows=[]]]
I20260807 18:16:23.728240 13442 op_tracker.cc:289] RD-NP WriteOp [type=FOLLOWER, start_time=2026-08-07 18:16:20, state=WriteOpState 0x617000286380 [op_id=(term: 2 index: 638), ts=7315974344256331776, rows=[]]]
W20260807 18:16:23.787099 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260807 18:16:23.870203 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 98 similar messages]
I20260807 18:16:24.024989 13258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.253.68:42039 (request call id 66) took 1080 ms. Trace:
I20260807 18:16:24.025957 13258 rpcz_store.cc:276] 0807 18:16:22.941677 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:22.942633 (+ 956us) service_pool.cc:227] Handling call
0807 18:16:24.022101 (+1079468us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 18:16:24.051620 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20260807 18:16:24.275497 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
I20260807 18:16:24.307667 13260 raft_consensus.cc:858] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }.
Pending config: opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }:
New config: opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
W20260807 18:16:24.321103 13260 raft_consensus.cc:1565] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 1132' and following 467 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 998 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }.
Pending config: opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }:
New config: opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
W20260807 18:16:24.561380 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
I20260807 18:16:24.580273 13260 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.1066: config changed from index 998 to 1066, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
W20260807 18:16:24.799258 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
I20260807 18:16:24.888826 13260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.253.68:42039 (request call id 67) took 1815 ms. Trace:
W20260807 18:16:25.186012 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
I20260807 18:16:24.889083 13260 rpcz_store.cc:276] 0807 18:16:23.061062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:23.062413 (+ 1351us) service_pool.cc:227] Handling call
0807 18:16:23.690863 (+628450us) raft_consensus.cc:1457] Updating replica for 534 ops
0807 18:16:23.917526 (+226663us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 18:16:23.917533 (+ 7us) raft_consensus.cc:1525] Triggering prepare for 534 ops
0807 18:16:23.933559 (+ 16026us) write_op.cc:270] Start()
0807 18:16:23.933621 (+ 62us) write_op.cc:276] Timestamp: P: 1786126563090755 usec, L: 0
0807 18:16:24.020417 (+ 86796us) write_op.cc:270] Start()
0807 18:16:24.020466 (+ 49us) write_op.cc:276] Timestamp: P: 1786126563101702 usec, L: 0
0807 18:16:24.020735 (+ 269us) write_op.cc:270] Start()
0807 18:16:24.020762 (+ 27us) write_op.cc:276] Timestamp: P: 1786126563129790 usec, L: 0
0807 18:16:24.020913 (+ 151us) write_op.cc:270] Start()
0807 18:16:24.020933 (+ 20us) write_op.cc:276] Timestamp: P: 1786126563130791 usec, L: 0
0807 18:16:24.021092 (+ 159us) write_op.cc:270] Start()
0807 18:16:24.021117 (+ 25us) write_op.cc:276] Timestamp: P: 1786126563273208 usec, L: 0
0807 18:16:24.021298 (+ 181us) write_op.cc:270] Start()
0807 18:16:24.021321 (+ 23us) write_op.cc:276] Timestamp: P: 1786126563279394 usec, L: 0
0807 18:16:24.026720 (+ 5399us) write_op.cc:270] Start()
0807 18:16:24.026797 (+ 77us) write_op.cc:276] Timestamp: P: 1786126563285119 usec, L: 0
0807 18:16:24.027055 (+ 258us) write_op.cc:270] Start()
0807 18:16:24.027082 (+ 27us) write_op.cc:276] Timestamp: P: 1786126563289742 usec, L: 0
0807 18:16:24.027297 (+ 215us) write_op.cc:270] Start()
0807 18:16:24.027322 (+ 25us) write_op.cc:276] Timestamp: P: 1786126563368676 usec, L: 0
0807 18:16:24.027495 (+ 173us) write_op.cc:270] Start()
0807 18:16:24.027517 (+ 22us) write_op.cc:276] Timestamp: P: 1786126563405700 usec, L: 0
0807 18:16:24.027663 (+ 146us) write_op.cc:270] Start()
0807 18:16:24.027685 (+ 22us) write_op.cc:276] Timestamp: P: 1786126563407239 usec, L: 0
0807 18:16:24.027840 (+ 155us) write_op.cc:270] Start()
0807 18:16:24.027863 (+ 23us) write_op.cc:276] Timestamp: P: 1786126563409400 usec, L: 0
0807 18:16:24.028031 (+ 168us) write_op.cc:270] Start()
0807 18:16:24.028084 (+ 53us) write_op.cc:276] Timestamp: P: 1786126563504012 usec, L: 0
0807 18:16:24.062766 (+ 34682us) write_op.cc:270] Start()
0807 18:16:24.062812 (+ 46us) write_op.cc:276] Timestamp: P: 1786126563536764 usec, L: 0
0807 18:16:24.063097 (+ 285us) write_op.cc:270] Start()
0807 18:16:24.063122 (+ 25us) write_op.cc:276] Timestamp: P: 1786126563548172 usec, L: 0
0807 18:16:24.063315 (+ 193us) write_op.cc:270] Start()
0807 18:16:24.063339 (+ 24us) write_op.cc:276] Timestamp: P: 1786126563568144 usec, L: 0
0807 18:16:24.063514 (+ 175us) write_op.cc:270] Start()
0807 18:16:24.063538 (+ 24us) write_op.cc:276] Timestamp: P: 1786126563640400 usec, L: 0
0807 18:16:24.063699 (+ 161us) write_op.cc:270] Start()
0807 18:16:24.063723 (+ 24us) write_op.cc:276] Timestamp: P: 1786126563659986 usec, L: 0
0807 18:16:24.063860 (+ 137us) write_op.cc:270] Start()
0807 18:16:24.063880 (+ 20us) write_op.cc:276] Timestamp: P: 1786126563666442 usec, L: 0
0807 18:16:24.064022 (+ 142us) write_op.cc:270] Start()
0807 18:16:24.064045 (+ 23us) write_op.cc:276] Timestamp: P: 1786126563677754 usec, L: 0
0807 18:16:24.064189 (+ 144us) write_op.cc:270] Start()
0807 18:16:24.064209 (+ 20us) write_op.cc:276] Timestamp: P: 1786126563717013 usec, L: 0
0807 18:16:24.064378 (+ 169us) write_op.cc:270] Start()
0807 18:16:24.064398 (+ 20us) write_op.cc:276] Timestamp: P: 1786126563814060 usec, L: 0
0807 18:16:24.064551 (+ 153us) write_op.cc:270] Start()
0807 18:16:24.064572 (+ 21us) write_op.cc:276] Timestamp: P: 1786126563815979 usec, L: 0
0807 18:16:24.064717 (+ 145us) write_op.cc:270] Start()
0807 18:16:24.064739 (+ 22us) write_op.cc:276] Timestamp: P: 1786126563816858 usec, L: 0
0807 18:16:24.064900 (+ 161us) write_op.cc:270] Start()
0807 18:16:24.064922 (+ 22us) write_op.cc:276] Timestamp: P: 1786126563861243 usec, L: 0
0807 18:16:24.065069 (+ 147us) write_op.cc:270] Start()
0807 18:16:24.065090 (+ 21us) write_op.cc:276] Timestamp: P: 1786126563908509 usec, L: 0
0807 18:16:24.065234 (+ 144us) write_op.cc:270] Start()
0807 18:16:24.065255 (+ 21us) write_op.cc:276] Timestamp: P: 1786126563916470 usec, L: 0
0807 18:16:24.065402 (+ 147us) write_op.cc:270] Start()
0807 18:16:24.065423 (+ 21us) write_op.cc:276] Timestamp: P: 1786126563931036 usec, L: 0
0807 18:16:24.065576 (+ 153us) write_op.cc:270] Start()
0807 18:16:24.065597 (+ 21us) write_op.cc:276] Timestamp: P: 1786126564053694 usec, L: 0
0807 18:16:24.065770 (+ 173us) write_op.cc:270] Start()
0807 18:16:24.065792 (+ 22us) write_op.cc:276] Timestamp: P: 1786126564061298 usec, L: 0
0807 18:16:24.065972 (+ 180us) write_op.cc:270] Start()
0807 18:16:24.065992 (+ 20us) write_op.cc:276] Timestamp: P: 1786126564084138 usec, L: 0
0807 18:16:24.066132 (+ 140us) write_op.cc:270] Start()
0807 18:16:24.066151 (+ 19us) write_op.cc:276] Timestamp: P: 1786126564086794 usec, L: 0
0807 18:16:24.066289 (+ 138us) write_op.cc:270] Start()
0807 18:16:24.066308 (+ 19us) write_op.cc:276] Timestamp: P: 1786126564140988 usec, L: 0
0807 18:16:24.066497 (+ 189us) write_op.cc:270] Start()
0807 18:16:24.066519 (+ 22us) write_op.cc:276] Timestamp: P: 1786126564147695 usec, L: 0
0807 18:16:24.091775 (+ 25256us) write_op.cc:270] Start()
0807 18:16:24.091828 (+ 53us) write_op.cc:276] Timestamp: P: 1786126564187504 usec, L: 0
0807 18:16:24.092906 (+ 1078us) write_op.cc:270] Start()
0807 18:16:24.092937 (+ 31us) write_op.cc:276] Timestamp: P: 1786126564192251 usec, L: 0
0807 18:16:24.093119 (+ 182us) write_op.cc:270] Start()
0807 18:16:24.093142 (+ 23us) write_op.cc:276] Timestamp: P: 1786126564213030 usec, L: 0
0807 18:16:24.111657 (+ 18515us) write_op.cc:270] Start()
0807 18:16:24.111705 (+ 48us) write_op.cc:276] Timestamp: P: 1786126564264034 usec, L: 0
0807 18:16:24.139285 (+ 27580us) write_op.cc:270] Start()
0807 18:16:24.139357 (+ 72us) write_op.cc:276] Timestamp: P: 1786126564276672 usec, L: 0
0807 18:16:24.139779 (+ 422us) write_op.cc:270] Start()
0807 18:16:24.139813 (+ 34us) write_op.cc:276] Timestamp: P: 1786126564357576 usec, L: 0
0807 18:16:24.140056 (+ 243us) write_op.cc:270] Start()
0807 18:16:24.140080 (+ 24us) write_op.cc:276] Timestamp: P: 1786126564379514 usec, L: 0
0807 18:16:24.140234 (+ 154us) write_op.cc:270] Start()
0807 18:16:24.140258 (+ 24us) write_op.cc:276] Timestamp: P: 1786126564396555 usec, L: 0
0807 18:16:24.141157 (+ 899us) write_op.cc:270] Start()
0807 18:16:24.141222 (+ 65us) write_op.cc:276] Timestamp: P: 1786126564408857 usec, L: 0
0807 18:16:24.141833 (+ 611us) write_op.cc:270] Start()
0807 18:16:24.141882 (+ 49us) write_op.cc:276] Timestamp: P: 1786126564510277 usec, L: 0
0807 18:16:24.142118 (+ 236us) write_op.cc:270] Start()
0807 18:16:24.142145 (+ 27us) write_op.cc:276] Timestamp: P: 1786126564511905 usec, L: 0
0807 18:16:24.142417 (+ 272us) write_op.cc:270] Start()
0807 18:16:24.142443 (+ 26us) write_op.cc:276] Timestamp: P: 1786126564530118 usec, L: 0
0807 18:16:24.142768 (+ 325us) write_op.cc:270] Start()
0807 18:16:24.142808 (+ 40us) write_op.cc:276] Timestamp: P: 1786126564531101 usec, L: 0
0807 18:16:24.143020 (+ 212us) write_op.cc:270] Start()
0807 18:16:24.143046 (+ 26us) write_op.cc:276] Timestamp: P: 1786126564628558 usec, L: 0
0807 18:16:24.143257 (+ 211us) write_op.cc:270] Start()
0807 18:16:24.143283 (+ 26us) write_op.cc:276] Timestamp: P: 1786126564629953 usec, L: 0
0807 18:16:24.143449 (+ 166us) write_op.cc:270] Start()
0807 18:16:24.143475 (+ 26us) write_op.cc:276] Timestamp: P: 1786126564636335 usec, L: 0
0807 18:16:24.143725 (+ 250us) write_op.cc:270] Start()
0807 18:16:24.143753 (+ 28us) write_op.cc:276] Timestamp: P: 1786126564648188 usec, L: 0
0807 18:16:24.144027 (+ 274us) write_op.cc:270] Start()
0807 18:16:24.144054 (+ 27us) write_op.cc:276] Timestamp: P: 1786126564726204 usec, L: 0
0807 18:16:24.168276 (+ 24222us) write_op.cc:270] Start()
0807 18:16:24.168313 (+ 37us) write_op.cc:276] Timestamp: P: 1786126564746867 usec, L: 0
0807 18:16:24.172229 (+ 3916us) write_op.cc:270] Start()
0807 18:16:24.172284 (+ 55us) write_op.cc:276] Timestamp: P: 1786126564790740 usec, L: 0
0807 18:16:24.175253 (+ 2969us) write_op.cc:270] Start()
0807 18:16:24.175293 (+ 40us) write_op.cc:276] Timestamp: P: 1786126564808628 usec, L: 0
0807 18:16:24.180401 (+ 5108us) write_op.cc:270] Start()
0807 18:16:24.180452 (+ 51us) write_op.cc:276] Timestamp: P: 1786126564847688 usec, L: 0
0807 18:16:24.193423 (+ 12971us) write_op.cc:270] Start()
0807 18:16:24.193489 (+ 66us) write_op.cc:276] Timestamp: P: 1786126564872786 usec, L: 0
0807 18:16:24.193837 (+ 348us) write_op.cc:270] Start()
0807 18:16:24.193864 (+ 27us) write_op.cc:276] Timestamp: P: 1786126564922038 usec, L: 0
0807 18:16:24.196803 (+ 2939us) write_op.cc:270] Start()
0807 18:16:24.196845 (+ 42us) write_op.cc:276] Timestamp: P: 1786126564925022 usec, L: 0
0807 18:16:24.198817 (+ 1972us) write_op.cc:270] Start()
0807 18:16:24.230436 (+ 31619us) write_op.cc:276] Timestamp: P: 1786126564995730 usec, L: 0
0807 18:16:24.238496 (+ 8060us) write_op.cc:270] Start()
0807 18:16:24.238572 (+ 76us) write_op.cc:276] Timestamp: P: 1786126565008641 usec, L: 0
0807 18:16:24.238856 (+ 284us) write_op.cc:270] Start()
0807 18:16:24.238886 (+ 30us) write_op.cc:276] Timestamp: P: 1786126565021840 usec, L: 0
0807 18:16:24.239141 (+ 255us) write_op.cc:270] Start()
0807 18:16:24.239168 (+ 27us) write_op.cc:276] Timestamp: P: 1786126565062226 usec, L: 0
0807 18:16:24.239402 (+ 234us) write_op.cc:270] Start()
0807 18:16:24.239431 (+ 29us) write_op.cc:276] Timestamp: P: 1786126565101004 usec, L: 0
0807 18:16:24.244058 (+ 4627us) write_op.cc:270] Start()
0807 18:16:24.244109 (+ 51us) write_op.cc:276] Timestamp: P: 1786126565137331 usec, L: 0
0807 18:16:24.539564 (+295455us) log.cc:842] Serialized 68258 byte log entry
0807 18:16:24.539818 (+ 254us) raft_consensus.cc:1631] Marking committed up to 1131
0807 18:16:24.760418 (+220600us) log.cc:842] Serialized 15 byte log entry
0807 18:16:24.876222 (+115804us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 18:16:24.876298 (+ 76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 18:16:24.876312 (+ 14us) raft_consensus.cc:1671] finished
0807 18:16:24.876314 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 18:16:24.876402 (+ 88us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 18:16:23.938811 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:23.939056 (+ 245us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:23.939065 (+ 9us) write_op.cc:435] Acquired schema lock
0807 18:16:23.939068 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:23.939365 (+ 297us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:23.939384 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:23.939389 (+ 5us) tablet.cc:683] Acquiring locks for 12 operations
0807 18:16:23.939753 (+ 364us) tablet.cc:699] Row locks acquired
0807 18:16:23.939757 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:24.770477 (+830720us) op_driver.cc:444] REPLICATION: finished
0807 18:16:24.772462 (+ 1985us) write_op.cc:301] APPLY: starting
0807 18:16:24.772477 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:24.772574 (+ 97us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:24.772578 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:24.772959 (+ 381us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:24.773028 (+ 69us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:24.773036 (+ 8us) write_op.cc:312] APPLY: finished
0807 18:16:24.773122 (+ 86us) log.cc:842] Serialized 89 byte log entry
0807 18:16:24.773191 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.773215 (+ 24us) write_op.cc:454] Released schema lock
0807 18:16:24.773223 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:24.773306 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.773311 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:24.028515 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:24.028798 (+ 283us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:24.028804 (+ 6us) write_op.cc:435] Acquired schema lock
0807 18:16:24.028806 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:24.097817 (+ 69011us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:24.097835 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:24.097842 (+ 7us) tablet.cc:683] Acquiring locks for 15 operations
0807 18:16:24.115968 (+ 18126us) tablet.cc:699] Row locks acquired
0807 18:16:24.115971 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:24.774179 (+658208us) op_driver.cc:444] REPLICATION: finished
0807 18:16:24.774298 (+ 119us) write_op.cc:301] APPLY: starting
0807 18:16:24.774312 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:24.774382 (+ 70us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:24.774386 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:24.774971 (+ 585us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:24.775106 (+ 135us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:24.775116 (+ 10us) write_op.cc:312] APPLY: finished
0807 18:16:24.775218 (+ 102us) log.cc:842] Serialized 107 byte log entry
0807 18:16:24.776646 (+ 1428us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.776674 (+ 28us) write_op.cc:454] Released schema lock
0807 18:16:24.776682 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:24.776773 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.776777 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:24.117896 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:24.118024 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:24.118030 (+ 6us) write_op.cc:435] Acquired schema lock
0807 18:16:24.118033 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:24.118394 (+ 361us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:24.118412 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:24.118417 (+ 5us) tablet.cc:683] Acquiring locks for 16 operations
0807 18:16:24.118740 (+ 323us) tablet.cc:699] Row locks acquired
0807 18:16:24.118744 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:24.776978 (+658234us) op_driver.cc:444] REPLICATION: finished
0807 18:16:24.777153 (+ 175us) write_op.cc:301] APPLY: starting
0807 18:16:24.777165 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:24.777232 (+ 67us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:24.777234 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:24.777682 (+ 448us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:24.777757 (+ 75us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:24.777763 (+ 6us) write_op.cc:312] APPLY: finished
0807 18:16:24.777872 (+ 109us) log.cc:842] Serialized 113 byte log entry
0807 18:16:24.777945 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.777971 (+ 26us) write_op.cc:454] Released schema lock
0807 18:16:24.777982 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:24.779295 (+ 1313us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.779305 (+ 10us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:24.119001 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:24.119115 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:24.119121 (+ 6us) write_op.cc:435] Acquired schema lock
0807 18:16:24.119123 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:24.119303 (+ 180us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:24.119315 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:24.119320 (+ 5us) tablet.cc:683] Acquiring locks for 14 operations
0807 18:16:24.119540 (+ 220us) tablet.cc:699] Row locks acquired
0807 18:16:24.119543 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:24.777074 (+657531us) op_driver.cc:444] REPLICATION: finished
0807 18:16:24.778214 (+ 1140us) write_op.cc:301] APPLY: starting
0807 18:16:24.778226 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:24.778275 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:24.778277 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:24.793674 (+ 15397us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:24.806403 (+ 12729us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:24.806419 (+ 16us) write_op.cc:312] APPLY: finished
0807 18:16:24.806602 (+ 183us) log.cc:842] Serialized 101 byte log entry
0807 18:16:24.806869 (+ 267us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.806899 (+ 30us) write_op.cc:454] Released schema lock
0807 18:16:24.806909 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:24.806990 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.806994 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:24.119802 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:24.119946 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:24.119953 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:24.119955 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:24.120850 (+ 895us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:24.120871 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:24.120878 (+ 7us) tablet.cc:683] Acquiring locks for 21 operations
0807 18:16:24.144278 (+ 23400us) tablet.cc:699] Row locks acquired
0807 18:16:24.144282 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:24.778470 (+634188us) op_driver.cc:444] REPLICATION: finished
0807 18:16:24.778600 (+ 130us) write_op.cc:301] APPLY: starting
0807 18:16:24.778611 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:24.779149 (+ 538us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:24.779151 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:24.795064 (+ 15913us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:24.795200 (+ 136us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:24.795222 (+ 22us) write_op.cc:312] APPLY: finished
0807 18:16:24.795395 (+ 173us) log.cc:842] Serialized 145 byte log entry
0807 18:16:24.795493 (+ 98us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.795538 (+ 45us) write_op.cc:454] Released schema lock
0807 18:16:24.795549 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:24.795643 (+ 94us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.795648 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:24.144733 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:24.144899 (+ 166us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:24.144907 (+ 8us) write_op.cc:435] Acquired schema lock
0807 18:16:24.144910 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:24.145467 (+ 557us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:24.145488 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:24.145496 (+ 8us) tablet.cc:683] Acquiring locks for 21 operations
0807 18:16:24.145801 (+ 305us) tablet.cc:699] Row locks acquired
0807 18:16:24.145804 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:24.778721 (+632917us) op_driver.cc:444] REPLICATION: finished
0807 18:16:24.778795 (+ 74us) write_op.cc:301] APPLY: starting
0807 18:16:24.778805 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:24.779403 (+ 598us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:24.779406 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:24.779944 (+ 538us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:24.789367 (+ 9423us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:24.789385 (+ 18us) write_op.cc:312] APPLY: finished
0807 18:16:24.805093 (+ 15708us) log.cc:842] Serialized 145 byte log entry
0807 18:16:24.805200 (+ 107us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.805257 (+ 57us) write_op.cc:454] Released schema lock
0807 18:16:24.805270 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:24.805395 (+ 125us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.805403 (+ 8us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:24.145911 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:24.146006 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:24.146013 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:24.146016 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:24.146243 (+ 227us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:24.146258 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:24.146263 (+ 5us) tablet.cc:683] Acquiring locks for 16 operations
0807 18:16:24.146643 (+ 380us) tablet.cc:699] Row locks acquired
0807 18:16:24.146646 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:24.778848 (+632202us) op_driver.cc:444] REPLICATION: finished
0807 18:16:24.779465 (+ 617us) write_op.cc:301] APPLY: starting
0807 18:16:24.779488 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:24.779587 (+ 99us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:24.779590 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:24.789876 (+ 10286us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:24.798257 (+ 8381us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:24.798271 (+ 14us) write_op.cc:312] APPLY: finished
0807 18:16:24.798398 (+ 127us) log.cc:842] Serialized 113 byte log entry
0807 18:16:24.798483 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.798507 (+ 24us) write_op.cc:454] Released schema lock
0807 18:16:24.798525 (+ 18us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:24.798631 (+ 106us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.798635 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:24.146749 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:24.146836 (+ 87us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:24.146841 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:24.146844 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:24.147071 (+ 227us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:24.147083 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:24.147088 (+ 5us) tablet.cc:683] Acquiring locks for 13 operations
0807 18:16:24.147284 (+ 196us) tablet.cc:699] Row locks acquired
0807 18:16:24.147286 (+ 2us) write_op.cc:260] PREPARE: finished
0807 18:16:24.778896 (+631610us) op_driver.cc:444] REPLICATION: finished
0807 18:16:24.795768 (+ 16872us) write_op.cc:301] APPLY: starting
0807 18:16:24.795782 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:24.795869 (+ 87us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:24.795872 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:24.796349 (+ 477us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:24.796414 (+ 65us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:24.796423 (+ 9us) write_op.cc:312] APPLY: finished
0807 18:16:24.796539 (+ 116us) log.cc:842] Serialized 95 byte log entry
0807 18:16:24.796597 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.796624 (+ 27us) write_op.cc:454] Released schema lock
0807 18:16:24.796631 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:24.796700 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.796704 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:24.147402 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:24.147545 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:24.147550 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:24.147553 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:24.147769 (+ 216us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:24.147782 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:24.147788 (+ 6us) tablet.cc:683] Acquiring locks for 17 operations
0807 18:16:24.148716 (+ 928us) tablet.cc:699] Row locks acquired
0807 18:16:24.148719 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:24.778925 (+630206us) op_driver.cc:444] REPLICATION: finished
0807 18:16:24.796801 (+ 17876us) write_op.cc:301] APPLY: starting
0807 18:16:24.796828 (+ 27us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:24.796950 (+ 122us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:24.796955 (+ 5us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:24.797461 (+ 506us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:24.797552 (+ 91us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:24.797562 (+ 10us) write_op.cc:312] APPLY: finished
0807 18:16:24.797665 (+ 103us) log.cc:842] Serialized 119 byte log entry
0807 18:16:24.797709 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.797737 (+ 28us) write_op.cc:454] Released schema lock
0807 18:16:24.797745 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:24.797838 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.797842 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:24.148942 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:24.149041 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:24.149045 (+ 4us) write_op.cc:435] Acquired schema lock
0807 18:16:24.149048 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:24.149215 (+ 167us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:24.149226 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:24.149231 (+ 5us) tablet.cc:683] Acquiring locks for 17 operations
0807 18:16:24.150024 (+ 793us) tablet.cc:699] Row locks acquired
0807 18:16:24.150027 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:24.778967 (+628940us) op_driver.cc:444] REPLICATION: finished
0807 18:16:24.797967 (+ 19000us) write_op.cc:301] APPLY: starting
0807 18:16:24.797981 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:24.798057 (+ 76us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:24.798061 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:24.818301 (+ 20240us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:24.821756 (+ 3455us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:24.821766 (+ 10us) write_op.cc:312] APPLY: finished
0807 18:16:24.821921 (+ 155us) log.cc:842] Serialized 119 byte log entry
0807 18:16:24.822504 (+ 583us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.822570 (+ 66us) write_op.cc:454] Released schema lock
0807 18:16:24.822583 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:24.822698 (+ 115us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:24.822702 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:24.150138 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:24.150227 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:24.150232 (
W20260807 18:16:25.435282 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20260807 18:16:25.477586 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:25.572801 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20260807 18:16:25.582198 13442 tablet_replica.cc:348] Time spent TabletReplica: tablet 874ba119c7284c4d8a113d6654e0c39e: Waiting for Ops to complete: real 3.199s user 0.051s sys 0.017s
I20260807 18:16:25.588581 13442 ts_tablet_manager.cc:1905] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 18:16:25.681926 13258 raft_consensus.cc:1467] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Allowing update even though not a member of the config
I20260807 18:16:25.692786 13442 ts_tablet_manager.cc:1918] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.750
I20260807 18:16:25.696689 13442 log.cc:1196] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Deleting WAL directory at /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0/minicluster-data/ts-0/wal/wals/874ba119c7284c4d8a113d6654e0c39e
I20260807 18:16:25.702970 13442 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51654 (request call id 1) took 12432 ms. Trace:
I20260807 18:16:25.717458 13442 rpcz_store.cc:276] 0807 18:16:13.270053 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:13.274663 (+ 4610us) service_pool.cc:227] Handling call
0807 18:16:20.204464 (+6929801us) ts_tablet_manager.cc:1145] Deleting tablet 874ba119c7284c4d8a113d6654e0c39e
0807 18:16:20.204482 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 18:16:22.320760 (+2116278us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x6150000436a4. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6018ee74a 00007fa60551df16 00007fa605550404 00007fa605531870 00007fa6055315fd 00000000009edb7c 00007fa5f63f9344 00007fa5f63fc91b 00007fa5f63fc798 00000000009edb7c
0807 18:16:22.363070 (+ 42310us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x6150000436a4. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6018eb04d 00007fa602b8f5ec 00007fa60551e2e6 00007fa605550404 00007fa605531870 00007fa6055315fd 00000000009edb7c 00007fa5f63f9344 00007fa5f63fc91b 00007fa5f63fc798
0807 18:16:22.439616 (+ 76546us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.439661 (+ 45us) write_op.cc:454] Released schema lock
0807 18:16:22.446479 (+ 6818us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.446488 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:22.488206 (+ 41718us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.488216 (+ 10us) write_op.cc:454] Released schema lock
0807 18:16:22.488333 (+ 117us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.488337 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.488421 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.488424 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.498621 (+ 10197us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.498629 (+ 8us) write_op.cc:454] Released schema lock
0807 18:16:22.498787 (+ 158us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.498793 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:22.508305 (+ 9512us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.508311 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:22.508421 (+ 110us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.508425 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.508476 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.508480 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.508527 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.508530 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.508574 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.508577 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.517571 (+ 8994us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.517578 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:22.529154 (+ 11576us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.529163 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:22.545813 (+ 16650us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.545821 (+ 8us) write_op.cc:454] Released schema lock
0807 18:16:22.545938 (+ 117us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.545941 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.545983 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.571022 (+ 25039us) write_op.cc:454] Released schema lock
0807 18:16:22.571163 (+ 141us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.571170 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:22.632303 (+ 61133us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.632313 (+ 10us) write_op.cc:454] Released schema lock
0807 18:16:22.632446 (+ 133us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.632450 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.632496 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.632499 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.632558 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.632562 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.657135 (+ 24573us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.657141 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:22.657272 (+ 131us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.657276 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.657328 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.657331 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.657374 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.657377 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.657421 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.657424 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.657481 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.657484 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.657535 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.657538 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.720508 (+ 62970us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.720524 (+ 16us) write_op.cc:454] Released schema lock
0807 18:16:22.720649 (+ 125us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.720653 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.720706 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.720710 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.720760 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.720764 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.725588 (+ 4824us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.725596 (+ 8us) write_op.cc:454] Released schema lock
0807 18:16:22.725698 (+ 102us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.725703 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:22.774195 (+ 48492us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.774202 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:22.774314 (+ 112us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.774318 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.774383 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.774387 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.774496 (+ 109us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.774501 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:22.819644 (+ 45143us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.819651 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:22.819793 (+ 142us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.819800 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:22.819851 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.819854 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.819905 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.819908 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.819948 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.819951 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.820014 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820017 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.820058 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820061 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.820097 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820100 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.820139 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820142 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.820179 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820182 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.820269 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820273 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.820316 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820319 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.820357 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820360 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.820400 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820403 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.820443 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820449 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:22.820507 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820511 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.820625 (+ 114us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.820629 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.873897 (+ 53268us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.873907 (+ 10us) write_op.cc:454] Released schema lock
0807 18:16:22.874041 (+ 134us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874047 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:22.874104 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874107 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874146 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874149 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874192 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874197 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:22.874237 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874239 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:22.874282 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874285 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874321 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874323 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:22.874362 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874369 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:22.874437 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874440 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874507 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874510 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874570 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874573 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874612 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874614 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:22.874648 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874651 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874684 (+ 33us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874686 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:22.874719 (+ 33us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874721 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:22.874754 (+ 33us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874757 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874793 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874796 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874830 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874833 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874886 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874889 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874926 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874929 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.874975 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.874978 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.875025 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.875028 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.875069 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.875072 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:22.941885 (+ 66813us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.941891 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:22.942008 (+ 117us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.942071 (+ 63us) write_op.cc:454] Released schema lock
0807 18:16:22.942135 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.942139 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:22.942189 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:22.942193 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.025027 (+ 82834us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.025035 (+ 8us) write_op.cc:454] Released schema lock
0807 18:16:23.025160 (+ 125us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.025164 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.025224 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.025228 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.025280 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.025283 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.025330 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.025334 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.037007 (+ 11673us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.037015 (+ 8us) write_op.cc:454] Released schema lock
0807 18:16:23.037091 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.037095 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.037145 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.037149 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.037198 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.037202 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.037248 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.037252 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.037302 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.037306 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.037354 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.037358 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.037405 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.037409 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.037457 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.037461 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.037512 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.037515 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.037562 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.037565 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.039835 (+ 2270us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.039844 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:23.039940 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.039945 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:23.040019 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.040023 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.040071 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.040075 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.040127 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.040131 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.040180 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.040184 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.040233 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.040237 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.143693 (+103456us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.143700 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:23.143816 (+ 116us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.143820 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.143869 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.143872 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.144327 (+ 455us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.144337 (+ 10us) write_op.cc:454] Released schema lock
0807 18:16:23.184303 (+ 39966us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.184312 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:23.184396 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.184400 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.184454 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.184459 (+ 5us) write_op.cc:454] Released schema lock
0807 18:16:23.188713 (+ 4254us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.188726 (+ 13us) write_op.cc:454] Released schema lock
0807 18:16:23.188838 (+ 112us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.188842 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.343797 (+154955us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.343805 (+ 8us) write_op.cc:454] Released schema lock
0807 18:16:23.343921 (+ 116us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.343925 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.343976 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.343980 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.344168 (+ 188us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.344174 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:23.344256 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.344260 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.344308 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.344311 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.349801 (+ 5490us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.349807 (+ 6us) write_op.cc:454] Released schema lock
0807 18:16:23.349871 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.349875 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.349924 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.349928 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.349980 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.349983 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.350031 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.350035 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.350081 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.350085 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.350130 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.350134 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.350177 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.350181 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.350225 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.350229 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.350273 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.350280 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:23.350346 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.350350 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.366861 (+ 16511us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.366870 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:23.366950 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.366954 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.367004 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.367007 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.367055 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.367058 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.367099 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.367103 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.889265 (+522162us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.889274 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:23.889387 (+ 113us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.889391 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.889440 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.889443 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.889487 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.889490 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.890355 (+ 865us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.890362 (+ 7us) write_op.cc:454] Released schema lock
0807 18:16:23.895495 (+ 5133us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.895504 (+ 9us) write_op.cc:454] Released schema lock
0807 18:16:23.895632 (+ 128us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.895636 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.895695 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.895699 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.895747 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.895830 (+ 83us) write_op.cc:454] Released schema lock
0807 18:16:23.895882 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.895886 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.895933 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.895937 (+ 4us) write_op.cc:454] Released schema lock
0807 18:16:23.895984 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.895987 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896031 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896034 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896078 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896081 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896125 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896128 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896186 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896189 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896229 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896231 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:23.896274 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896277 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896317 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896320 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896363 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896366 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896410 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896412 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:23.896461 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896463 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:23.896513 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896516 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896555 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896558 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896602 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896604 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:23.896668 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896670 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:23.896720 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896723 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896767 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896769 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:23.896812 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896815 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896852 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896854 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:23.896899 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896902 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.896945 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896947 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:23.896988 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.896990 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:23.897033 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.897036 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.897079 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.897081 (+ 2us) write_op.cc:454] Released schema lock
0807 18:16:23.897126 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.897129 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.897171 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.897174 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.897236 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.897239 (+ 3us) write_op.cc:454] Released schema lock
0807 18:16:23.897288 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:23.897290 (+ 2us) write_op.cc:454] Released schem
I20260807 18:16:25.751644 11285 catalog_manager.cc:4841] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): tablet 874ba119c7284c4d8a113d6654e0c39e (table test-workload [id=8bd0c38a73b949c3a98e549c83519895]) successfully deleted
I20260807 18:16:22.388295 13261 rpcz_store.cc:276] 0807 18:16:18.343752 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:18.343850 (+ 98us) service_pool.cc:227] Handling call
0807 18:16:19.208862 (+865012us) raft_consensus.cc:1457] Updating replica for 1010 ops
0807 18:16:19.470253 (+261391us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 18:16:19.470260 (+ 7us) raft_consensus.cc:1525] Triggering prepare for 1010 ops
0807 18:16:19.470425 (+ 165us) write_op.cc:270] Start()
0807 18:16:19.470459 (+ 34us) write_op.cc:276] Timestamp: P: 1786126538011716 usec, L: 0
0807 18:16:19.492784 (+ 22325us) write_op.cc:270] Start()
0807 18:16:19.492819 (+ 35us) write_op.cc:276] Timestamp: P: 1786126538069941 usec, L: 0
0807 18:16:19.496693 (+ 3874us) write_op.cc:270] Start()
0807 18:16:19.496800 (+ 107us) write_op.cc:276] Timestamp: P: 1786126538104684 usec, L: 0
0807 18:16:19.497050 (+ 250us) write_op.cc:270] Start()
0807 18:16:19.497075 (+ 25us) write_op.cc:276] Timestamp: P: 1786126538108733 usec, L: 0
0807 18:16:19.497235 (+ 160us) write_op.cc:270] Start()
0807 18:16:19.497282 (+ 47us) write_op.cc:276] Timestamp: P: 1786126538113748 usec, L: 0
0807 18:16:19.513125 (+ 15843us) write_op.cc:270] Start()
0807 18:16:19.513171 (+ 46us) write_op.cc:276] Timestamp: P: 1786126538161131 usec, L: 0
0807 18:16:19.513372 (+ 201us) write_op.cc:270] Start()
0807 18:16:19.513430 (+ 58us) write_op.cc:276] Timestamp: P: 1786126538242662 usec, L: 0
0807 18:16:19.513564 (+ 134us) write_op.cc:270] Start()
0807 18:16:19.513582 (+ 18us) write_op.cc:276] Timestamp: P: 1786126538264304 usec, L: 0
0807 18:16:19.513755 (+ 173us) write_op.cc:270] Start()
0807 18:16:19.513774 (+ 19us) write_op.cc:276] Timestamp: P: 1786126538319262 usec, L: 0
0807 18:16:19.513941 (+ 167us) write_op.cc:270] Start()
0807 18:16:19.513960 (+ 19us) write_op.cc:276] Timestamp: P: 1786126538364554 usec, L: 0
0807 18:16:19.514090 (+ 130us) write_op.cc:270] Start()
0807 18:16:19.514109 (+ 19us) write_op.cc:276] Timestamp: P: 1786126538395338 usec, L: 0
0807 18:16:19.514305 (+ 196us) write_op.cc:270] Start()
0807 18:16:19.514328 (+ 23us) write_op.cc:276] Timestamp: P: 1786126538425573 usec, L: 0
0807 18:16:19.514490 (+ 162us) write_op.cc:270] Start()
0807 18:16:19.514508 (+ 18us) write_op.cc:276] Timestamp: P: 1786126538505472 usec, L: 0
0807 18:16:19.514704 (+ 196us) write_op.cc:270] Start()
0807 18:16:19.514726 (+ 22us) write_op.cc:276] Timestamp: P: 1786126538511003 usec, L: 0
0807 18:16:19.514851 (+ 125us) write_op.cc:270] Start()
0807 18:16:19.514868 (+ 17us) write_op.cc:276] Timestamp: P: 1786126538513664 usec, L: 0
0807 18:16:19.515077 (+ 209us) write_op.cc:270] Start()
0807 18:16:19.515097 (+ 20us) write_op.cc:276] Timestamp: P: 1786126538565617 usec, L: 0
0807 18:16:19.515531 (+ 434us) write_op.cc:270] Start()
0807 18:16:19.515610 (+ 79us) write_op.cc:276] Timestamp: P: 1786126538600424 usec, L: 0
0807 18:16:19.516118 (+ 508us) write_op.cc:270] Start()
0807 18:16:19.516148 (+ 30us) write_op.cc:276] Timestamp: P: 1786126538603529 usec, L: 0
0807 18:16:19.516333 (+ 185us) write_op.cc:270] Start()
0807 18:16:19.516354 (+ 21us) write_op.cc:276] Timestamp: P: 1786126538605071 usec, L: 0
0807 18:16:19.516648 (+ 294us) write_op.cc:270] Start()
0807 18:16:19.516692 (+ 44us) write_op.cc:276] Timestamp: P: 1786126538641732 usec, L: 0
0807 18:16:19.516842 (+ 150us) write_op.cc:270] Start()
0807 18:16:19.516867 (+ 25us) write_op.cc:276] Timestamp: P: 1786126538704991 usec, L: 0
0807 18:16:19.517014 (+ 147us) write_op.cc:270] Start()
0807 18:16:19.517035 (+ 21us) write_op.cc:276] Timestamp: P: 1786126538707256 usec, L: 0
0807 18:16:19.517178 (+ 143us) write_op.cc:270] Start()
0807 18:16:19.517197 (+ 19us) write_op.cc:276] Timestamp: P: 1786126538733441 usec, L: 0
0807 18:16:19.517376 (+ 179us) write_op.cc:270] Start()
0807 18:16:19.517399 (+ 23us) write_op.cc:276] Timestamp: P: 1786126538804977 usec, L: 0
0807 18:16:19.517839 (+ 440us) write_op.cc:270] Start()
0807 18:16:19.517877 (+ 38us) write_op.cc:276] Timestamp: P: 1786126538820633 usec, L: 0
0807 18:16:19.518058 (+ 181us) write_op.cc:270] Start()
0807 18:16:19.518085 (+ 27us) write_op.cc:276] Timestamp: P: 1786126538838986 usec, L: 0
0807 18:16:19.549310 (+ 31225us) write_op.cc:270] Start()
0807 18:16:19.549352 (+ 42us) write_op.cc:276] Timestamp: P: 1786126538844051 usec, L: 0
0807 18:16:19.549549 (+ 197us) write_op.cc:270] Start()
0807 18:16:19.549574 (+ 25us) write_op.cc:276] Timestamp: P: 1786126538871434 usec, L: 0
0807 18:16:19.549806 (+ 232us) write_op.cc:270] Start()
0807 18:16:19.549831 (+ 25us) write_op.cc:276] Timestamp: P: 1786126538909435 usec, L: 0
0807 18:16:19.550149 (+ 318us) write_op.cc:270] Start()
0807 18:16:19.550181 (+ 32us) write_op.cc:276] Timestamp: P: 1786126538919922 usec, L: 0
0807 18:16:19.550432 (+ 251us) write_op.cc:270] Start()
0807 18:16:19.550459 (+ 27us) write_op.cc:276] Timestamp: P: 1786126538921916 usec, L: 0
0807 18:16:19.550731 (+ 272us) write_op.cc:270] Start()
0807 18:16:19.550767 (+ 36us) write_op.cc:276] Timestamp: P: 1786126538925667 usec, L: 0
0807 18:16:19.551019 (+ 252us) write_op.cc:270] Start()
0807 18:16:19.551049 (+ 30us) write_op.cc:276] Timestamp: P: 1786126539008065 usec, L: 0
0807 18:16:19.552398 (+ 1349us) write_op.cc:270] Start()
0807 18:16:19.552428 (+ 30us) write_op.cc:276] Timestamp: P: 1786126539023203 usec, L: 0
0807 18:16:19.556964 (+ 4536us) write_op.cc:270] Start()
0807 18:16:19.556992 (+ 28us) write_op.cc:276] Timestamp: P: 1786126539036668 usec, L: 0
0807 18:16:19.557181 (+ 189us) write_op.cc:270] Start()
0807 18:16:19.557203 (+ 22us) write_op.cc:276] Timestamp: P: 1786126539040408 usec, L: 0
0807 18:16:19.557354 (+ 151us) write_op.cc:270] Start()
0807 18:16:19.557401 (+ 47us) write_op.cc:276] Timestamp: P: 1786126539081721 usec, L: 0
0807 18:16:19.557585 (+ 184us) write_op.cc:270] Start()
0807 18:16:19.557609 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539092437 usec, L: 0
0807 18:16:19.558606 (+ 997us) write_op.cc:270] Start()
0807 18:16:19.558630 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539121071 usec, L: 0
0807 18:16:19.558821 (+ 191us) write_op.cc:270] Start()
0807 18:16:19.558844 (+ 23us) write_op.cc:276] Timestamp: P: 1786126539124783 usec, L: 0
0807 18:16:19.560029 (+ 1185us) write_op.cc:270] Start()
0807 18:16:19.560058 (+ 29us) write_op.cc:276] Timestamp: P: 1786126539136515 usec, L: 0
0807 18:16:19.564692 (+ 4634us) write_op.cc:270] Start()
0807 18:16:19.564733 (+ 41us) write_op.cc:276] Timestamp: P: 1786126539193489 usec, L: 0
0807 18:16:19.565010 (+ 277us) write_op.cc:270] Start()
0807 18:16:19.565055 (+ 45us) write_op.cc:276] Timestamp: P: 1786126539200895 usec, L: 0
0807 18:16:19.565237 (+ 182us) write_op.cc:270] Start()
0807 18:16:19.565266 (+ 29us) write_op.cc:276] Timestamp: P: 1786126539225681 usec, L: 0
0807 18:16:19.565454 (+ 188us) write_op.cc:270] Start()
0807 18:16:19.565480 (+ 26us) write_op.cc:276] Timestamp: P: 1786126539240486 usec, L: 0
0807 18:16:19.565634 (+ 154us) write_op.cc:270] Start()
0807 18:16:19.565659 (+ 25us) write_op.cc:276] Timestamp: P: 1786126539247486 usec, L: 0
0807 18:16:19.566001 (+ 342us) write_op.cc:270] Start()
0807 18:16:19.566032 (+ 31us) write_op.cc:276] Timestamp: P: 1786126539258787 usec, L: 0
0807 18:16:19.583002 (+ 16970us) write_op.cc:270] Start()
0807 18:16:19.583061 (+ 59us) write_op.cc:276] Timestamp: P: 1786126539302002 usec, L: 0
0807 18:16:19.583652 (+ 591us) write_op.cc:270] Start()
0807 18:16:19.583697 (+ 45us) write_op.cc:276] Timestamp: P: 1786126539355328 usec, L: 0
0807 18:16:19.589059 (+ 5362us) write_op.cc:270] Start()
0807 18:16:19.589101 (+ 42us) write_op.cc:276] Timestamp: P: 1786126539358519 usec, L: 0
0807 18:16:19.589699 (+ 598us) write_op.cc:270] Start()
0807 18:16:19.589729 (+ 30us) write_op.cc:276] Timestamp: P: 1786126539369022 usec, L: 0
0807 18:16:19.590213 (+ 484us) write_op.cc:270] Start()
0807 18:16:19.590250 (+ 37us) write_op.cc:276] Timestamp: P: 1786126539373536 usec, L: 0
0807 18:16:19.590441 (+ 191us) write_op.cc:270] Start()
0807 18:16:19.590461 (+ 20us) write_op.cc:276] Timestamp: P: 1786126539444506 usec, L: 0
0807 18:16:19.590641 (+ 180us) write_op.cc:270] Start()
0807 18:16:19.590666 (+ 25us) write_op.cc:276] Timestamp: P: 1786126539465404 usec, L: 0
0807 18:16:19.590853 (+ 187us) write_op.cc:270] Start()
0807 18:16:19.590875 (+ 22us) write_op.cc:276] Timestamp: P: 1786126539469749 usec, L: 0
0807 18:16:19.591557 (+ 682us) write_op.cc:270] Start()
0807 18:16:19.591595 (+ 38us) write_op.cc:276] Timestamp: P: 1786126539477034 usec, L: 0
0807 18:16:19.607636 (+ 16041us) write_op.cc:270] Start()
0807 18:16:19.607670 (+ 34us) write_op.cc:276] Timestamp: P: 1786126539498729 usec, L: 0
0807 18:16:19.607971 (+ 301us) write_op.cc:270] Start()
0807 18:16:19.607997 (+ 26us) write_op.cc:276] Timestamp: P: 1786126539547256 usec, L: 0
0807 18:16:19.608221 (+ 224us) write_op.cc:270] Start()
0807 18:16:19.608245 (+ 24us) write_op.cc:276] Timestamp: P: 1786126539549675 usec, L: 0
0807 18:16:19.608445 (+ 200us) write_op.cc:270] Start()
0807 18:16:19.610785 (+ 2340us) write_op.cc:276] Timestamp: P: 1786126539564504 usec, L: 0
0807 18:16:19.611035 (+ 250us) write_op.cc:270] Start()
0807 18:16:19.611072 (+ 37us) write_op.cc:276] Timestamp: P: 1786126539575471 usec, L: 0
0807 18:16:19.611176 (+ 104us) write_op.cc:270] Start()
0807 18:16:19.611190 (+ 14us) write_op.cc:276] Timestamp: P: 1786126539651638 usec, L: 0
0807 18:16:19.611289 (+ 99us) write_op.cc:270] Start()
0807 18:16:19.611302 (+ 13us) write_op.cc:276] Timestamp: P: 1786126539653473 usec, L: 0
0807 18:16:19.611409 (+ 107us) write_op.cc:270] Start()
0807 18:16:19.611422 (+ 13us) write_op.cc:276] Timestamp: P: 1786126539664059 usec, L: 0
0807 18:16:19.611617 (+ 195us) write_op.cc:270] Start()
0807 18:16:19.611644 (+ 27us) write_op.cc:276] Timestamp: P: 1786126539680626 usec, L: 0
0807 18:16:19.612039 (+ 395us) write_op.cc:270] Start()
0807 18:16:19.612064 (+ 25us) write_op.cc:276] Timestamp: P: 1786126539707754 usec, L: 0
0807 18:16:19.613945 (+ 1881us) write_op.cc:270] Start()
0807 18:16:19.613982 (+ 37us) write_op.cc:276] Timestamp: P: 1786126539753144 usec, L: 0
0807 18:16:19.614294 (+ 312us) write_op.cc:270] Start()
0807 18:16:19.614323 (+ 29us) write_op.cc:276] Timestamp: P: 1786126539762667 usec, L: 0
0807 18:16:19.614556 (+ 233us) write_op.cc:270] Start()
0807 18:16:19.614583 (+ 27us) write_op.cc:276] Timestamp: P: 1786126539766483 usec, L: 0
0807 18:16:19.614855 (+ 272us) write_op.cc:270] Start()
0807 18:16:19.614911 (+ 56us) write_op.cc:276] Timestamp: P: 1786126539790232 usec, L: 0
0807 18:16:19.615140 (+ 229us) write_op.cc:270] Start()
0807 18:16:19.615167 (+ 27us) write_op.cc:276] Timestamp: P: 1786126539815484 usec, L: 0
0807 18:16:19.615512 (+ 345us) write_op.cc:270] Start()
0807 18:16:19.615612 (+ 100us) write_op.cc:276] Timestamp: P: 1786126539831856 usec, L: 0
0807 18:16:19.615943 (+ 331us) write_op.cc:270] Start()
0807 18:16:19.615993 (+ 50us) write_op.cc:276] Timestamp: P: 1786126539840039 usec, L: 0
0807 18:16:19.616345 (+ 352us) write_op.cc:270] Start()
0807 18:16:19.616375 (+ 30us) write_op.cc:276] Timestamp: P: 1786126539856372 usec, L: 0
0807 18:16:19.618506 (+ 2131us) write_op.cc:270] Start()
0807 18:16:19.638868 (+ 20362us) write_op.cc:276] Timestamp: P: 1786126539872337 usec, L: 0
0807 18:16:19.639226 (+ 358us) write_op.cc:270] Start()
0807 18:16:19.639258 (+ 32us) write_op.cc:276] Timestamp: P: 1786126539902419 usec, L: 0
0807 18:16:19.639589 (+ 331us) write_op.cc:270] Start()
0807 18:16:19.639623 (+ 34us) write_op.cc:276] Timestamp: P: 1786126539963712 usec, L: 0
0807 18:16:19.640150 (+ 527us) write_op.cc:270] Start()
0807 18:16:19.640195 (+ 45us) write_op.cc:276] Timestamp: P: 1786126539966451 usec, L: 0
0807 18:16:19.640742 (+ 547us) write_op.cc:270] Start()
0807 18:16:19.640810 (+ 68us) write_op.cc:276] Timestamp: P: 1786126539999318 usec, L: 0
0807 18:16:19.641107 (+ 297us) write_op.cc:270] Start()
0807 18:16:19.641135 (+ 28us) write_op.cc:276] Timestamp: P: 1786126540004776 usec, L: 0
0807 18:16:19.641492 (+ 357us) write_op.cc:270] Start()
0807 18:16:19.641540 (+ 48us) write_op.cc:276] Timestamp: P: 1786126540031350 usec, L: 0
0807 18:16:19.641721 (+ 181us) write_op.cc:270] Start()
0807 18:16:19.641743 (+ 22us) write_op.cc:276] Timestamp: P: 1786126540075213 usec, L: 0
0807 18:16:19.642051 (+ 308us) write_op.cc:270] Start()
0807 18:16:19.642086 (+ 35us) write_op.cc:276] Timestamp: P: 1786126540076837 usec, L: 0
0807 18:16:19.642289 (+ 203us) write_op.cc:270] Start()
0807 18:16:19.642313 (+ 24us) write_op.cc:276] Timestamp: P: 1786126540079215 usec, L: 0
0807 18:16:19.642479 (+ 166us) write_op.cc:270] Start()
0807 18:16:19.681947 (+ 39468us) write_op.cc:276] Timestamp: P: 1786126540083866 usec, L: 0
0807 18:16:19.682339 (+ 392us) write_op.cc:270] Start()
0807 18:16:19.682370 (+ 31us) write_op.cc:276] Timestamp: P: 1786126540133551 usec, L: 0
0807 18:16:19.683146 (+ 776us) write_op.cc:270] Start()
0807 18:16:19.683180 (+ 34us) write_op.cc:276] Timestamp: P: 1786126540157793 usec, L: 0
0807 18:16:19.685817 (+ 2637us) write_op.cc:270] Start()
0807 18:16:19.685855 (+ 38us) write_op.cc:276] Timestamp: P: 1786126540159527 usec, L: 0
0807 18:16:19.686067 (+ 212us) write_op.cc:270] Start()
0807 18:16:19.686090 (+ 23us) write_op.cc:276] Timestamp: P: 1786126540185544 usec, L: 0
0807 18:16:19.686302 (+ 212us) write_op.cc:270] Start()
0807 18:16:19.686327 (+ 25us) write_op.cc:276] Timestamp: P: 1786126540218245 usec, L: 0
0807 18:16:19.686621 (+ 294us) write_op.cc:270] Start()
0807 18:16:19.686649 (+ 28us) write_op.cc:276] Timestamp: P: 1786126540225870 usec, L: 0
0807 18:16:19.686882 (+ 233us) write_op.cc:270] Start()
0807 18:16:19.686907 (+ 25us) write_op.cc:276] Timestamp: P: 1786126540242678 usec, L: 0
0807 18:16:19.693816 (+ 6909us) write_op.cc:270] Start()
0807 18:16:19.693866 (+ 50us) write_op.cc:276] Timestamp: P: 1786126540298511 usec, L: 0
0807 18:16:19.694169 (+ 303us) write_op.cc:270] Start()
0807 18:16:19.694201 (+ 32us) write_op.cc:276] Timestamp: P: 1786126540299740 usec, L: 0
0807 18:16:19.694370 (+ 169us) write_op.cc:270] Start()
0807 18:16:19.694394 (+ 24us) write_op.cc:276] Timestamp: P: 1786126540301592 usec, L: 0
0807 18:16:19.694665 (+ 271us) write_op.cc:270] Start()
0807 18:16:19.694707 (+ 42us) write_op.cc:276] Timestamp: P: 1786126540321615 usec, L: 0
0807 18:16:19.694935 (+ 228us) write_op.cc:270] Start()
0807 18:16:19.694961 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540368562 usec, L: 0
0807 18:16:19.695110 (+ 149us) write_op.cc:270] Start()
0807 18:16:19.695133 (+ 23us) write_op.cc:276] Timestamp: P: 1786126540371839 usec, L: 0
0807 18:16:19.702736 (+ 7603us) write_op.cc:270] Start()
0807 18:16:19.702803 (+ 67us) write_op.cc:276] Timestamp: P: 1786126540403053 usec, L: 0
0807 18:16:19.703166 (+ 363us) write_op.cc:270] Start()
0807 18:16:19.703204 (+ 38us) write_op.cc:276] Timestamp: P: 1786126540414595 usec, L: 0
0807 18:16:19.703448 (+ 244us) write_op.cc:270] Start()
0807 18:16:19.703487 (+ 39us) write_op.cc:276] Timestamp: P: 1786126540437893 usec, L: 0
0807 18:16:19.706467 (+ 2980us) write_op.cc:270] Start()
0807 18:16:19.706506 (+ 39us) write_op.cc:276] Timestamp: P: 1786126540439998 usec, L: 0
0807 18:16:19.706786 (+ 280us) write_op.cc:270] Start()
0807 18:16:19.706816 (+ 30us) write_op.cc:276] Timestamp: P: 1786126540482933 usec, L: 0
0807 18:16:19.707046 (+ 230us) write_op.cc:270] Start()
0807 18:16:19.707098 (+ 52us) write_op.cc:276] Timestamp: P: 1786126540504500 usec, L: 0
0807 18:16:19.707337 (+ 239us) write_op.cc:270] Start()
0807 18:16:19.707368 (+ 31us) write_op.cc:276] Timestamp: P: 1786126540522931 usec, L: 0
0807 18:16:19.707600 (+ 232us) write_op.cc:270] Start()
0807 18:16:19.707638 (+ 38us) write_op.cc:276] Timestamp: P: 1786126540535175 usec, L: 0
0807 18:16:19.707848 (+ 210us) write_op.cc:270] Start()
0807 18:16:19.707875 (+ 27us) write_op.cc:276] Timestamp: P: 1786126540554486 usec, L: 0
0807 18:16:19.708112 (+ 237us) write_op.cc:270] Start()
0807 18:16:19.708139 (+ 27us) write_op.cc:276] Timestamp: P: 1786126540614491 usec, L: 0
0807 18:16:19.708364 (+ 225us) write_op.cc:270] Start()
0807 18:16:19.708426 (+ 62us) write_op.cc:276] Timestamp: P: 1786126540622877 usec, L: 0
0807 18:16:19.708726 (+ 300us) write_op.cc:270] Start()
0807 18:16:19.708757 (+ 31us) write_op.cc:276] Timestamp: P: 1786126540633664 usec, L: 0
0807 18:16:19.709019 (+ 262us) write_op.cc:270] Start()
0807 18:16:19.709048 (+ 29us) write_op.cc:276] Timestamp: P: 1786126540658300 usec, L: 0
0807 18:16:19.709267 (+ 219us) write_op.cc:270] Start()
0807 18:16:19.709296 (+ 29us) write_op.cc:276] Timestamp: P: 1786126540688077 usec, L: 0
0807 18:16:19.709572 (+ 276us) write_op.cc:270] Start()
0807 18:16:19.709602 (+ 30us) write_op.cc:276] Timestamp: P: 1786126540707380 usec, L: 0
0807 18:16:19.709794 (+ 192us) write_op.cc:270] Start()
0807 18:16:19.709819 (+ 25us) write_op.cc:276] Timestamp: P: 1786126540712846 usec, L: 0
0807 18:16:19.710053 (+ 234us) write_op.cc:270] Start()
0807 18:16:19.710082 (+ 29us) write_op.cc:276] Timestamp: P: 1786126540785352 usec, L: 0
0807 18:16:19.710258 (+ 176us) write_op.cc:270] Start()
0807 18:16:19.710284 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540790017 usec, L: 0
0807 18:16:19.710498 (+ 214us) write_op.cc:270] Start()
0807 18:16:19.710554 (+ 56us) write_op.cc:276] Timestamp: P: 1786126540795909 usec, L: 0
0807 18:16:19.754747 (+ 44193us) write_op.cc:270] Start()
0807 18:16:19.754828 (+ 81us) write_op.cc:276] Timestamp: P: 1786126540801885 usec, L: 0
0807 18:16:19.755218 (+ 390us) write_op.cc:270] Start()
0807 18:16:19.755253 (+ 35us) write_op.cc:276] Timestamp: P: 1786126540850350 usec, L: 0
0807 18:16:19.755490 (+ 237us) write_op.cc:270] Start()
0807 18:16:19.755517 (+ 27us) write_op.cc:276] Timestamp: P: 1786126540890664 usec, L: 0
0807 18:16:19.755752 (+ 235us) write_op.cc:270] Start()
0807 18:16:19.755780 (+ 28us) write_op.cc:276] Timestamp: P: 1786126540904264 usec, L: 0
0807 18:16:19.756015 (+ 235us) write_op.cc:270] Start()
0807 18:16:19.756044 (+ 29us) write_op.cc:276] Timestamp: P: 1786126540905815 usec, L: 0
0807 18:16:19.756293 (+ 249us) write_op.cc:270] Start()
0807 18:16:19.756323 (+ 30us) write_op.cc:276] Timestamp: P: 1786126540910389 usec, L: 0
0807 18:16:19.756533 (+ 210us) write_op.cc:270] Start()
0807 18:16:19.756559 (+ 26us) write_op.cc:276] Timestamp: P: 1786126540975156 usec, L: 0
0807 18:16:19.756856 (+ 297us) write_op.cc:270] Start()
0807 18:16:19.756884 (+ 28us) write_op.cc:276] Timestamp: P: 1786126540983493 usec, L: 0
0807 18:16:19.757209 (+ 325us) write_op.cc:270] Start()
0807 18:16:19.757239 (+ 30us) write_op.cc:276] Timestamp: P: 1786126541013099 usec, L: 0
0807 18:16:19.757416 (+ 177us) write_op.cc:270] Start()
0807 18:16:19.757438 (+ 22us) write_op.cc:276] Timestamp: P: 1786126541014868 usec, L: 0
0807 18:16:19.757641 (+ 203us) write_op.cc:270] Start()
0807 18:16:19.757666 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541028116 usec, L: 0
0807 18:16:19.767950 (+ 10284us) write_op.cc:270] Start()
0807 18:16:19.767996 (+ 46us) write_op.cc:276] Timestamp: P: 1786126541056894 usec, L: 0
0807 18:16:19.768305 (+ 309us) write_op.cc:270] Start()
0807 18:16:19.768332 (+ 27us) write_op.cc:276] Timestamp: P: 1786126541116367 usec, L: 0
0807 18:16:19.768763 (+ 431us) write_op.cc:270] Start()
0807 18:16:19.774305 (+ 5542us) write_op.cc:276] Timestamp: P: 1786126541118538 usec, L: 0
0807 18:16:19.775343 (+ 1038us) write_op.cc:270] Start()
0807 18:16:19.775390 (+ 47us) write_op.cc:276] Timestamp: P: 1786126541131263 usec, L: 0
0807 18:16:19.836474 (+ 61084us) write_op.cc:270] Start()
0807 18:16:19.836535 (+ 61us) write_op.cc:276] Timestamp: P: 1786126541132035 usec, L: 0
0807 18:16:19.836932 (+ 397us) write_op.cc:270] Start()
0807 18:16:19.836966 (+ 34us) write_op.cc:276] Timestamp: P: 1786126541184008 usec, L: 0
0807 18:16:19.837580 (+ 614us) write_op.cc:270] Start()
0807 18:16:19.837610 (+ 30us) write_op.cc:276] Timestamp: P: 1786126541187629 usec, L: 0
0807 18:16:19.841215 (+ 3605us) write_op.cc:270] Start()
0807 18:16:19.841259 (+ 44us) write_op.cc:276] Timestamp: P: 1786126541205664 usec, L: 0
0807 18:16:19.842819 (+ 1560us) write_op.cc:270] Start()
0807 18:16:19.842865 (+ 46us) write_op.cc:276] Timestamp: P: 1786126541216514 usec, L: 0
0807 18:16:19.843537 (+ 672us) write_op.cc:270] Start()
0807 18:16:19.843568 (+ 31us) write_op.cc:276] Timestamp: P: 1786126541282756 usec, L: 0
0807 18:16:19.843769 (+ 201us) write_op.cc:270] Start()
0807 18:16:19.843797 (+ 28us) write_op.cc:276] Timestamp: P: 1786126541304804 usec, L: 0
0807 18:16:19.844039 (+ 242us) write_op.cc:270] Start()
0807 18:16:19.844066 (+ 27us) write_op.cc:276] Timestamp: P: 1786126541312175 usec, L: 0
0807 18:16:19.846414 (+ 2348us) write_op.cc:270] Start()
0807 18:16:19.846448 (+ 34us) write_op.cc:276] Timestamp: P: 1786126541316254 usec, L: 0
0807 18:16:19.855697 (+ 9249us) write_op.cc:270] Start()
0807 18:16:19.855787 (+ 90us) write_op.cc:276] Timestamp: P: 1786126541326623 usec, L: 0
0807 18:16:19.856096 (+ 309us) write_op.cc:270] Start()
0807 18:16:19.856123 (+ 27us) write_op.cc:276] Timestamp: P: 1786126541346229 usec, L: 0
0807 18:16:19.856315 (+ 192us) write_op.cc:270] Start()
0807 18:16:19.856340 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541373517 usec, L: 0
0807 18:16:19.857345 (+ 1005us) write_op.cc:270] Start()
0807 18:16:19.857375 (+ 30us) write_op.cc:276] Timestamp: P: 1786126541386084 usec, L: 0
0807 18:16:19.871957 (+ 14582us) write_op.cc:270] Start()
0807 18:16:19.872015 (+ 58us) write_op.cc:276] Timestamp: P: 1786126541392637 usec, L: 0
0807 18:16:19.873472 (+ 1457us) write_op.cc:270] Start()
0807 18:16:19.873517 (+ 45us) write_op.cc:276] Timestamp: P: 1786126541421467 usec, L: 0
0807 18:16:19.873808 (+ 291us) write_op.cc:270] Start()
0807 18:16:19.873844 (+ 36us) write_op.cc:276] Timestamp: P: 1786126541472240 usec, L: 0
0807 18:16:19.874050 (+ 206us) write_op.cc:270] Start()
0807 18:16:19.874082 (+ 32us) write_op.cc:276] Timestamp: P: 1786126541481323 usec, L: 0
0807 18:16:19.874359 (+ 277us) write_op.cc:270] Start()
0807 18:16:19.874387 (+ 28us) write_op.cc:276] Timestamp: P: 1786126541504758 usec, L: 0
0807 18:16:19.874806 (+ 419us) write_op.cc:270] Start()
0807 18:16:19.874841 (+ 35us) write_op.cc:276] Timestamp: P: 1786126541516014 usec, L: 0
0807 18:16:19.875405 (+ 564us) write_op.cc:270] Start()
0807 18:16:19.875433 (+ 28us) write_op.cc:276] Timestamp: P: 1786126541531922 usec, L: 0
0807 18:16:19.908227 (+ 32794us) write_op.cc:270] Start()
0807 18:16:19.908290 (+ 63us) write_op.cc:276] Timestamp: P: 1786126541548674 usec, L: 0
0807 18:16:19.952741 (+ 44451us) write_op.cc:270] Start()
0807 18:16:19.952792 (+ 51us) write_op.cc:276] Timestamp: P: 1786126541586870 usec, L: 0
0807 18:16:19.954982 (+ 2190us) write_op.cc:270] Start()
0807 18:16:19.955040 (+ 58us) write_op.cc:276] Timestamp: P: 1786126541622109 usec, L: 0
0807 18:16:19.957780 (+ 2740us) write_op.cc:270] Start()
0807 18:16:19.957835 (+ 55us) write_op.cc:276] Timestamp: P: 1786126541623195 usec, L: 0
0807 18:16:19.964688 (+ 6853us) write_op.cc:270] Start()
0807 18:16:19.964720 (+ 32us) write_op.cc:276] Timestamp: P: 1786126541626845 usec, L: 0
0807 18:16:19.990772 (+ 26052us) write_op.cc:270] Start()
0807 18:16:19.990824 (+ 52us) write_op.cc:276] Timestamp: P: 1786126541652955 usec, L: 0
0807 18:16:19.991585 (+ 761us) write_op.cc:270] Start()
0807 18:16:19.991620 (+ 35us) write_op.cc:276] Timestamp: P: 1786126541732101 usec, L: 0
0807 18:16:19.992930 (+ 1310us) write_op.cc:270] Start()
0807 18:16:19.992965 (+ 35us) write_op.cc:276] Timestamp: P: 1786126541738773 usec, L: 0
0807 18:16:20.006669 (+ 13704us) write_op.cc:270] Start()
0807 18:16:20.006732 (+ 63us) write_op.cc:276] Timestamp: P: 1786126541776124 usec, L: 0
0807 18:16:20.008934 (+ 2202us) write_op.cc:270] Start()
0807 18:16:20.008981 (+ 47us) write_op.cc:276] Timestamp: P: 1786126541778592 usec, L: 0
0807 18:16:20.009349 (+ 368us) write_op.cc:270] Start()
0807 18:16:20.009379 (+ 30us) write_op.cc:276] Timestamp: P: 1786126541800915 usec, L: 0
0807 18:16:20.009574 (+ 195us) write_op.cc:270] Start()
0807 18:16:20.009599 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541815504 usec, L: 0
0807 18:16:20.009778 (+ 179us) write_op.cc:270] Start()
0807 18:16:20.009803 (+ 25us) write_op.cc:276] Timestamp: P: 1786126541874256 usec, L: 0
0807 18:16:20.010059 (+ 256us) write_op.cc:270] Start()
0807 18:16:20.010100 (+ 41us) write_op.cc:276] Timestamp: P: 1786126541887232 usec, L: 0
0807 18:16:20.010398 (+ 298us) write_op.cc:270] Start()
0807 18:16:20.010484 (+ 86us) write_op.cc:276] Timestamp: P: 1786126541902823 usec, L: 0
0807 18:16:20.011131 (+ 647us) write_op.cc:270] Start()
0807 18:16:20.011167 (+ 36us) write_op.cc:276] Timestamp: P: 1786126541956669 usec, L: 0
0807 18:16:20.011392 (+ 225us) write_op.cc:270] Start()
0807 18:16:20.011420 (+ 28us) write_op.cc:276] Timestamp: P: 1786126541988024 usec, L: 0
0807 18:16:20.011758 (+ 338us) write_op.cc:270] Start()
0807 18:16:20.011789 (+ 31us) write_op.cc:276] Timestamp: P: 1786126541992112 usec, L: 0
0807 18:16:20.011969 (+ 180us) write_op.cc:270] Start()
0807 18:16:20.011996 (+ 27us) write_op.cc:276] Timestamp: P: 1786126542032153 usec, L: 0
0807 18:16:20.012312 (+ 316us) write_op.cc:270] Start()
0807 18:16:20.012342 (+ 30us) write_op.cc:276] Timestamp: P: 1786126542100443 usec, L: 0
0807 18:16:20.034181 (+ 21839us) write_op.cc:270] Start()
0807 18:16:20.034252 (+ 71us) write_op.cc:276] Timestamp: P: 1786126542127657 usec, L: 0
0807 18:16:20.034653 (+ 401us) write_op.cc:270] Start()
0807 18:16:20.034684 (+ 31us) write_op.cc:276] Timestamp: P: 1786126542143976 usec, L: 0
0807 18:16:20.065091 (+ 30407us) write_op.cc:270] Start()
0807 18:16:20.065167 (+ 76us) write_op.cc:276] Timestamp: P: 1786126542162283 usec, L: 0
0807 18:16:20.075405 (+ 10238us) write_op.cc:270] Start()
0807 18:16:20.075468 (+ 63us) write_op.cc:276] Timestamp: P: 1786126542183352 usec, L: 0
0807 18:16:20.076303 (+ 835us) write_op.cc:270] Start()
0807 18:16:20.076344 (+ 41us) write_op.cc:276] Timestamp: P: 1786126542210741 usec, L: 0
0807 18:16:20.076807 (+ 463us) write_op.cc:270] Start()
0807 18:16:20.076835 (+ 28us) write_op.cc:276] Timestamp: P: 1786126542230638 usec, L: 0
0807 18:16:20.097873 (+ 21038us) write_op.cc:270] Start()
0807 18:16:20.097937 (+ 64us) write_op.cc:276] Timestamp: P: 1786126542232238 usec, L: 0
0807 18:16:20.098342 (+ 405us) write_op.cc:270] Start()
0807 18:16:20.098393 (+ 51us) write_op.cc:276] Timestamp: P: 1786126542300483 usec, L: 0
0807 18:16:20.101546 (+ 3153us) write_op.cc:270] Start()
0807 18:16:20.101598 (+ 52us) write_op.cc:276] Timestamp: P: 1786126542328316 usec, L: 0
0807 18:16:20.101825 (+ 227us) write_op.cc:270] Start()
0807 18:16:20.102022 (+ 197us) write_op.cc:276] Timestamp: P: 1786126542333207 usec, L: 0
0807 18:16:20.102520 (+ 498us) write_op.cc:270] Start()
0807 18:16:20.102592 (+ 72us) write_op.cc:276] Timestamp: P: 1786126542343627 usec, L: 0
0807 18:16:20.102883 (+ 291us) write_op.cc:270] Start()
0807 18:16:20.102917 (+ 34us) write_op.cc:276] Timestamp: P: 1786126542384112 usec, L: 0
0807 18:16:20.103560 (+ 643us) write_op.cc:270] Start()
0807 18:16:20.103679 (+ 119us) write_op.cc:276] Timestamp: P: 1786126542429435 usec, L: 0
0807 18:16:20.104011 (+ 332us) write_op.cc:270] Start()
0807 18:16:20.104067 (+ 56us) write_op.cc:276] Timestamp: P: 1786126542446187 usec, L: 0
0807 18:16:20.104257 (+ 190us) write_op.cc:270] Start()
0807 18:16:20.104279 (+ 22us) write_op.cc:276] Timestamp: P: 1786126542459200 usec, L: 0
0807 18:16:20.104510 (+ 231us) write_op.cc:270] Start()
0807 18:16:20.104532 (+ 22us) write_op.cc:276] Timestamp: P: 1786126542527737 usec, L: 0
0807 18:16:20.104801 (+ 269us) write_op.cc:270] Start()
0807 18:16:20.104824 (+ 23us) write_op.cc:276] Timestamp: P: 1786126542541172 usec, L: 0
0807 18:16:20.105026 (+ 202us) write_op.cc:270] Start()
0807 18:16:20.105052 (+ 26us) write_op.cc:276] Timestamp: P: 1786126542548414 usec, L: 0
0807 18:16:20.105589 (+ 537us) write_op.cc:270] Start()
0807 18:16:20.106442 (+ 853us) write_op.cc:276] Timestamp: P: 1786126542562675 usec, L: 0
0807 18:16:20.106681 (+ 239us) write_op.cc:270] Start()
0807 18:16:20.106706 (+ 25us) write_op.cc:276] Timestamp: P: 1786126542641680 usec, L: 0
0807 18:16:20.106969 (+ 263us) write_op.cc:270] Start()
0807 18:16:20.106992 (+ 23us) write_op.cc:276] Timestamp: P: 1786126542661990 usec, L: 0
0807 18:16:20.108804 (+ 1812us) write_op.cc:270] Start()
0807 18:16:20.108835 (+ 31us) write_op.cc:276] Timestamp: P: 1786126542663276 usec, L: 0
0807 18:16:20.109468 (+ 633us) write_op.cc:270] Start()
0807 18:16:20.109498 (+ 30us) write_op.cc:276] Timestamp: P: 1786126542677962 usec, L: 0
0807 18:16:20.133192 (+ 23694us) write_op.cc:270] Start()
0807 18:16:20.133244 (+ 52us) write_op.cc:276] Timestamp: P: 1786126542746852 usec, L: 0
0807 18:16:20.192053 (+ 58809us) write_op.cc:270] Start()
0807 18:16:20.192099 (+ 46us) write_op.cc:276] Timestamp: P: 178612
I20260807 18:16:25.952639 13258 raft_consensus.cc:858] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }.
Pending config: opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }:
New config: opid_index: 1179 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
W20260807 18:16:25.952986 13258 raft_consensus.cc:1565] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Could not prepare op 'term: 1 index: 1179' and following 485 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 1066 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }.
Pending config: opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }:
New config: opid_index: 1179 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }
I20260807 18:16:25.989395 13258 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Committing config change with OpId 1.1132: config changed from index 1066 to 1132, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
I20260807 18:16:26.298031 13442 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51654 (request call id 2) took 10860 ms. Trace:
I20260807 18:16:26.298334 13442 rpcz_store.cc:276] 0807 18:16:15.437781 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:15.445698 (+ 7917us) service_pool.cc:227] Handling call
0807 18:16:25.751060 (+10305362us) ts_tablet_manager.cc:1145] Deleting tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:25.751080 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 18:16:26.297415 (+546335us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x615000043424. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6018ee74a 00007fa60551df16 00007fa605550404 00007fa605531870 00007fa6055315fd 00000000009edb7c 00007fa5f63f9344 00007fa5f63fc91b 00007fa5f63fc798 00000000009edb7c
0807 18:16:26.297851 (+ 436us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1255046912,"tablet-delete.queue_time_us":10304907}
W20260807 18:16:26.303316 11285 catalog_manager.cc:4815] TS 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): delete failed for tablet 644a01df651c43d4a74ac241ea43068c because of a CAS failure. No further retry: Illegal state: Request specified cas_config_opid_index_less_or_equal of 816 but the committed config has opid_index of 1132
W20260807 18:16:26.460412 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20260807 18:16:26.464138 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20260807 18:16:26.647948 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:26.663614 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
I20260807 18:16:26.718511 13630 ts_tablet_manager.cc:927] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Initiating tablet copy from peer 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889)
I20260807 18:16:26.772818 13630 tablet_copy_client.cc:316] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: tablet copy: Beginning tablet copy session from remote peer at address 127.10.253.68:43889
I20260807 18:16:26.774129 12103 tablet_copy_service.cc:140] P 22052958d03d426ebdc2fc310637c846: Received BeginTabletCopySession request for tablet 874ba119c7284c4d8a113d6654e0c39e from peer 50da72adf57546f5bab0a028672a51dd ({username='slave'} at 127.10.253.65:40915)
I20260807 18:16:26.774286 12103 tablet_copy_service.cc:161] P 22052958d03d426ebdc2fc310637c846: Beginning new tablet copy session on tablet 874ba119c7284c4d8a113d6654e0c39e from peer 50da72adf57546f5bab0a028672a51dd at {username='slave'} at 127.10.253.65:40915: session id = 50da72adf57546f5bab0a028672a51dd-874ba119c7284c4d8a113d6654e0c39e
I20260807 18:16:26.778076 12103 tablet_copy_source_session.cc:205] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 18:16:26.779994 13630 ts_tablet_manager.cc:1905] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260807 18:16:26.865701 13630 ts_tablet_manager.cc:1918] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.750
I20260807 18:16:26.885097 13630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 874ba119c7284c4d8a113d6654e0c39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:16:26.951776 13630 tablet_copy_client.cc:791] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: tablet copy: Starting download of 0 data blocks...
I20260807 18:16:27.020705 13630 tablet_copy_client.cc:655] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: tablet copy: Starting download of 1 WAL segments...
W20260807 18:16:27.024909 11975 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.70:40077, user_credentials={real_user=slave}} blocked reactor thread for 44878.3us
I20260807 18:16:27.148007 13258 raft_consensus.cc:858] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }.
Pending config: opid_index: 1179 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }:
New config: opid_index: 1244 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
W20260807 18:16:27.148797 13258 raft_consensus.cc:1565] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 1244' and following 440 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 1132 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }.
Pending config: opid_index: 1179 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } }:
New config: opid_index: 1244 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
I20260807 18:16:27.258194 13258 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.1179: config changed from index 1132 to 1179, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) evicted. New config: { opid_index: 1179 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } }
I20260807 18:16:27.371743 13630 tablet_copy_client.cc:531] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 18:16:27.399358 13630 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Bootstrap starting.
W20260807 18:16:27.565104 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
I20260807 18:16:27.585549 13258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.253.68:42039 (request call id 73) took 1223 ms. Trace:
W20260807 18:16:27.648386 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
I20260807 18:16:27.596741 13258 rpcz_store.cc:276] 0807 18:16:26.362371 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:26.362468 (+ 97us) service_pool.cc:227] Handling call
0807 18:16:26.610825 (+248357us) raft_consensus.cc:1457] Updating replica for 506 ops
0807 18:16:26.848477 (+237652us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 18:16:26.848485 (+ 8us) raft_consensus.cc:1525] Triggering prepare for 506 ops
0807 18:16:26.849002 (+ 517us) write_op.cc:270] Start()
0807 18:16:26.849053 (+ 51us) write_op.cc:276] Timestamp: P: 1786126567339136 usec, L: 0
0807 18:16:26.889260 (+ 40207us) write_op.cc:270] Start()
0807 18:16:26.889308 (+ 48us) write_op.cc:276] Timestamp: P: 1786126567387978 usec, L: 0
0807 18:16:26.889556 (+ 248us) write_op.cc:270] Start()
0807 18:16:26.889591 (+ 35us) write_op.cc:276] Timestamp: P: 1786126567430628 usec, L: 0
0807 18:16:26.907081 (+ 17490us) write_op.cc:270] Start()
0807 18:16:26.907132 (+ 51us) write_op.cc:276] Timestamp: P: 1786126567432875 usec, L: 0
0807 18:16:26.907641 (+ 509us) write_op.cc:270] Start()
0807 18:16:26.907722 (+ 81us) write_op.cc:276] Timestamp: P: 1786126567436998 usec, L: 0
0807 18:16:26.908311 (+ 589us) write_op.cc:270] Start()
0807 18:16:26.908342 (+ 31us) write_op.cc:276] Timestamp: P: 1786126567529285 usec, L: 0
0807 18:16:26.909861 (+ 1519us) write_op.cc:270] Start()
0807 18:16:26.909960 (+ 99us) write_op.cc:276] Timestamp: P: 1786126567554345 usec, L: 0
0807 18:16:26.910155 (+ 195us) write_op.cc:270] Start()
0807 18:16:26.910183 (+ 28us) write_op.cc:276] Timestamp: P: 1786126567555468 usec, L: 0
0807 18:16:26.910495 (+ 312us) write_op.cc:270] Start()
0807 18:16:26.910964 (+ 469us) write_op.cc:276] Timestamp: P: 1786126567556411 usec, L: 0
0807 18:16:26.911563 (+ 599us) write_op.cc:270] Start()
0807 18:16:26.911600 (+ 37us) write_op.cc:276] Timestamp: P: 1786126567636991 usec, L: 0
0807 18:16:26.911790 (+ 190us) write_op.cc:270] Start()
0807 18:16:26.911816 (+ 26us) write_op.cc:276] Timestamp: P: 1786126567675342 usec, L: 0
0807 18:16:26.914253 (+ 2437us) write_op.cc:270] Start()
0807 18:16:26.914291 (+ 38us) write_op.cc:276] Timestamp: P: 1786126567679524 usec, L: 0
0807 18:16:26.918019 (+ 3728us) write_op.cc:270] Start()
0807 18:16:26.918053 (+ 34us) write_op.cc:276] Timestamp: P: 1786126567682089 usec, L: 0
0807 18:16:26.918513 (+ 460us) write_op.cc:270] Start()
0807 18:16:26.918574 (+ 61us) write_op.cc:276] Timestamp: P: 1786126567848096 usec, L: 0
0807 18:16:26.918961 (+ 387us) write_op.cc:270] Start()
0807 18:16:26.919084 (+ 123us) write_op.cc:276] Timestamp: P: 1786126567849897 usec, L: 0
0807 18:16:26.919307 (+ 223us) write_op.cc:270] Start()
0807 18:16:26.919338 (+ 31us) write_op.cc:276] Timestamp: P: 1786126567858328 usec, L: 0
0807 18:16:26.931736 (+ 12398us) write_op.cc:270] Start()
0807 18:16:26.931783 (+ 47us) write_op.cc:276] Timestamp: P: 1786126567862574 usec, L: 0
0807 18:16:26.952697 (+ 20914us) write_op.cc:270] Start()
0807 18:16:26.952755 (+ 58us) write_op.cc:276] Timestamp: P: 1786126568026698 usec, L: 0
0807 18:16:27.004815 (+ 52060us) write_op.cc:270] Start()
0807 18:16:27.004868 (+ 53us) write_op.cc:276] Timestamp: P: 1786126568064289 usec, L: 0
0807 18:16:27.005139 (+ 271us) write_op.cc:270] Start()
0807 18:16:27.005164 (+ 25us) write_op.cc:276] Timestamp: P: 1786126568069420 usec, L: 0
0807 18:16:27.010097 (+ 4933us) write_op.cc:270] Start()
0807 18:16:27.010147 (+ 50us) write_op.cc:276] Timestamp: P: 1786126568081175 usec, L: 0
0807 18:16:27.010847 (+ 700us) write_op.cc:270] Start()
0807 18:16:27.010889 (+ 42us) write_op.cc:276] Timestamp: P: 1786126568216915 usec, L: 0
0807 18:16:27.013297 (+ 2408us) write_op.cc:270] Start()
0807 18:16:27.013332 (+ 35us) write_op.cc:276] Timestamp: P: 1786126568226599 usec, L: 0
0807 18:16:27.017796 (+ 4464us) write_op.cc:270] Start()
0807 18:16:27.017840 (+ 44us) write_op.cc:276] Timestamp: P: 1786126568251197 usec, L: 0
0807 18:16:27.025781 (+ 7941us) write_op.cc:270] Start()
0807 18:16:27.025845 (+ 64us) write_op.cc:276] Timestamp: P: 1786126568272758 usec, L: 0
0807 18:16:27.026214 (+ 369us) write_op.cc:270] Start()
0807 18:16:27.026305 (+ 91us) write_op.cc:276] Timestamp: P: 1786126568367604 usec, L: 0
0807 18:16:27.029506 (+ 3201us) write_op.cc:270] Start()
0807 18:16:27.029546 (+ 40us) write_op.cc:276] Timestamp: P: 1786126568409429 usec, L: 0
0807 18:16:27.029752 (+ 206us) write_op.cc:270] Start()
0807 18:16:27.029778 (+ 26us) write_op.cc:276] Timestamp: P: 1786126568420091 usec, L: 0
0807 18:16:27.045667 (+ 15889us) write_op.cc:270] Start()
0807 18:16:27.045771 (+ 104us) write_op.cc:276] Timestamp: P: 1786126568454506 usec, L: 0
0807 18:16:27.046114 (+ 343us) write_op.cc:270] Start()
0807 18:16:27.046146 (+ 32us) write_op.cc:276] Timestamp: P: 1786126568466875 usec, L: 0
0807 18:16:27.046340 (+ 194us) write_op.cc:270] Start()
0807 18:16:27.046368 (+ 28us) write_op.cc:276] Timestamp: P: 1786126568469786 usec, L: 0
0807 18:16:27.046514 (+ 146us) write_op.cc:270] Start()
0807 18:16:27.046534 (+ 20us) write_op.cc:276] Timestamp: P: 1786126568572522 usec, L: 0
0807 18:16:27.046726 (+ 192us) write_op.cc:270] Start()
0807 18:16:27.046750 (+ 24us) write_op.cc:276] Timestamp: P: 1786126568580529 usec, L: 0
0807 18:16:27.046893 (+ 143us) write_op.cc:270] Start()
0807 18:16:27.046912 (+ 19us) write_op.cc:276] Timestamp: P: 1786126568581519 usec, L: 0
0807 18:16:27.047045 (+ 133us) write_op.cc:270] Start()
0807 18:16:27.047064 (+ 19us) write_op.cc:276] Timestamp: P: 1786126568651084 usec, L: 0
0807 18:16:27.047215 (+ 151us) write_op.cc:270] Start()
0807 18:16:27.047239 (+ 24us) write_op.cc:276] Timestamp: P: 1786126568682027 usec, L: 0
0807 18:16:27.047395 (+ 156us) write_op.cc:270] Start()
0807 18:16:27.047416 (+ 21us) write_op.cc:276] Timestamp: P: 1786126568701469 usec, L: 0
0807 18:16:27.047580 (+ 164us) write_op.cc:270] Start()
0807 18:16:27.047603 (+ 23us) write_op.cc:276] Timestamp: P: 1786126568771357 usec, L: 0
0807 18:16:27.047779 (+ 176us) write_op.cc:270] Start()
0807 18:16:27.047803 (+ 24us) write_op.cc:276] Timestamp: P: 1786126568782614 usec, L: 0
0807 18:16:27.047965 (+ 162us) write_op.cc:270] Start()
0807 18:16:27.047990 (+ 25us) write_op.cc:276] Timestamp: P: 1786126568786740 usec, L: 0
0807 18:16:27.048196 (+ 206us) write_op.cc:270] Start()
0807 18:16:27.048220 (+ 24us) write_op.cc:276] Timestamp: P: 1786126568789483 usec, L: 0
0807 18:16:27.048354 (+ 134us) write_op.cc:270] Start()
0807 18:16:27.048373 (+ 19us) write_op.cc:276] Timestamp: P: 1786126568855928 usec, L: 0
0807 18:16:27.048489 (+ 116us) write_op.cc:270] Start()
0807 18:16:27.048507 (+ 18us) write_op.cc:276] Timestamp: P: 1786126568869808 usec, L: 0
0807 18:16:27.048638 (+ 131us) write_op.cc:270] Start()
0807 18:16:27.048655 (+ 17us) write_op.cc:276] Timestamp: P: 1786126568875545 usec, L: 0
0807 18:16:27.105136 (+ 56481us) write_op.cc:270] Start()
0807 18:16:27.105176 (+ 40us) write_op.cc:276] Timestamp: P: 1786126568891616 usec, L: 0
0807 18:16:27.105581 (+ 405us) write_op.cc:270] Start()
0807 18:16:27.105611 (+ 30us) write_op.cc:276] Timestamp: P: 1786126568972713 usec, L: 0
0807 18:16:27.106128 (+ 517us) write_op.cc:270] Start()
0807 18:16:27.106166 (+ 38us) write_op.cc:276] Timestamp: P: 1786126568975748 usec, L: 0
0807 18:16:27.107226 (+ 1060us) write_op.cc:270] Start()
0807 18:16:27.107258 (+ 32us) write_op.cc:276] Timestamp: P: 1786126568977699 usec, L: 0
0807 18:16:27.109913 (+ 2655us) write_op.cc:270] Start()
0807 18:16:27.109968 (+ 55us) write_op.cc:276] Timestamp: P: 1786126569015781 usec, L: 0
0807 18:16:27.110216 (+ 248us) write_op.cc:270] Start()
0807 18:16:27.110244 (+ 28us) write_op.cc:276] Timestamp: P: 1786126569070336 usec, L: 0
0807 18:16:27.110499 (+ 255us) write_op.cc:270] Start()
0807 18:16:27.110528 (+ 29us) write_op.cc:276] Timestamp: P: 1786126569086262 usec, L: 0
0807 18:16:27.110845 (+ 317us) write_op.cc:270] Start()
0807 18:16:27.110875 (+ 30us) write_op.cc:276] Timestamp: P: 1786126569088766 usec, L: 0
0807 18:16:27.117160 (+ 6285us) write_op.cc:270] Start()
0807 18:16:27.117199 (+ 39us) write_op.cc:276] Timestamp: P: 1786126569099079 usec, L: 0
0807 18:16:27.117479 (+ 280us) write_op.cc:270] Start()
0807 18:16:27.117507 (+ 28us) write_op.cc:276] Timestamp: P: 1786126569173356 usec, L: 0
0807 18:16:27.117802 (+ 295us) write_op.cc:270] Start()
0807 18:16:27.117826 (+ 24us) write_op.cc:276] Timestamp: P: 1786126569185181 usec, L: 0
0807 18:16:27.118009 (+ 183us) write_op.cc:270] Start()
0807 18:16:27.118032 (+ 23us) write_op.cc:276] Timestamp: P: 1786126569204008 usec, L: 0
0807 18:16:27.118370 (+ 338us) write_op.cc:270] Start()
0807 18:16:27.118397 (+ 27us) write_op.cc:276] Timestamp: P: 1786126569242207 usec, L: 0
0807 18:16:27.118640 (+ 243us) write_op.cc:270] Start()
0807 18:16:27.118667 (+ 27us) write_op.cc:276] Timestamp: P: 1786126569306551 usec, L: 0
0807 18:16:27.118942 (+ 275us) write_op.cc:270] Start()
0807 18:16:27.118970 (+ 28us) write_op.cc:276] Timestamp: P: 1786126569310727 usec, L: 0
0807 18:16:27.119198 (+ 228us) write_op.cc:270] Start()
0807 18:16:27.119288 (+ 90us) write_op.cc:276] Timestamp: P: 1786126569313626 usec, L: 0
0807 18:16:27.119632 (+ 344us) write_op.cc:270] Start()
0807 18:16:27.119661 (+ 29us) write_op.cc:276] Timestamp: P: 1786126569356323 usec, L: 0
0807 18:16:27.119826 (+ 165us) write_op.cc:270] Start()
0807 18:16:27.119849 (+ 23us) write_op.cc:276] Timestamp: P: 1786126569399123 usec, L: 0
0807 18:16:27.120104 (+ 255us) write_op.cc:270] Start()
0807 18:16:27.120133 (+ 29us) write_op.cc:276] Timestamp: P: 1786126569405243 usec, L: 0
0807 18:16:27.143367 (+ 23234us) write_op.cc:270] Start()
0807 18:16:27.143433 (+ 66us) write_op.cc:276] Timestamp: P: 1786126569407036 usec, L: 0
0807 18:16:27.245709 (+102276us) log.cc:842] Serialized 67984 byte log entry
0807 18:16:27.246270 (+ 561us) raft_consensus.cc:1631] Marking committed up to 1243
0807 18:16:27.301476 (+ 55206us) log.cc:842] Serialized 15 byte log entry
0807 18:16:27.569817 (+268341us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 18:16:27.585227 (+ 15410us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 18:16:27.585252 (+ 25us) raft_consensus.cc:1671] finished
0807 18:16:27.585255 (+ 3us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 18:16:27.585384 (+ 129us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 18:16:26.888451 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:26.888650 (+ 199us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:26.888658 (+ 8us) write_op.cc:435] Acquired schema lock
0807 18:16:26.888661 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:26.947429 (+ 58768us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:26.947458 (+ 29us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:26.947465 (+ 7us) tablet.cc:683] Acquiring locks for 20 operations
0807 18:16:26.990117 (+ 42652us) tablet.cc:699] Row locks acquired
0807 18:16:26.990124 (+ 7us) write_op.cc:260] PREPARE: finished
0807 18:16:27.371688 (+381564us) op_driver.cc:444] REPLICATION: finished
0807 18:16:27.378918 (+ 7230us) write_op.cc:301] APPLY: starting
0807 18:16:27.378968 (+ 50us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:27.379398 (+ 430us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:27.379402 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:27.381107 (+ 1705us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:27.393303 (+ 12196us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:27.393315 (+ 12us) write_op.cc:312] APPLY: finished
0807 18:16:27.459640 (+ 66325us) log.cc:842] Serialized 139 byte log entry
0807 18:16:27.459855 (+ 215us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.459914 (+ 59us) write_op.cc:454] Released schema lock
0807 18:16:27.459935 (+ 21us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:27.469500 (+ 9565us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.469512 (+ 12us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:26.990627 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:26.990749 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:26.990755 (+ 6us) write_op.cc:435] Acquired schema lock
0807 18:16:26.990757 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:26.995299 (+ 4542us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:26.995326 (+ 27us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:26.995335 (+ 9us) tablet.cc:683] Acquiring locks for 19 operations
0807 18:16:26.995635 (+ 300us) tablet.cc:699] Row locks acquired
0807 18:16:26.995638 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:27.381787 (+386149us) op_driver.cc:444] REPLICATION: finished
0807 18:16:27.469689 (+ 87902us) write_op.cc:301] APPLY: starting
0807 18:16:27.469713 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:27.472258 (+ 2545us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:27.472262 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:27.474954 (+ 2692us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:27.476112 (+ 1158us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:27.476127 (+ 15us) write_op.cc:312] APPLY: finished
0807 18:16:27.476280 (+ 153us) log.cc:842] Serialized 132 byte log entry
0807 18:16:27.476399 (+ 119us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.476448 (+ 49us) write_op.cc:454] Released schema lock
0807 18:16:27.476459 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:27.476598 (+ 139us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.476602 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:26.995822 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:26.995935 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:26.995943 (+ 8us) write_op.cc:435] Acquired schema lock
0807 18:16:26.995946 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:26.996365 (+ 419us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:26.996379 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:26.996384 (+ 5us) tablet.cc:683] Acquiring locks for 20 operations
0807 18:16:27.000026 (+ 3642us) tablet.cc:699] Row locks acquired
0807 18:16:27.000031 (+ 5us) write_op.cc:260] PREPARE: finished
0807 18:16:27.512582 (+512551us) op_driver.cc:444] REPLICATION: finished
0807 18:16:27.518471 (+ 5889us) write_op.cc:301] APPLY: starting
0807 18:16:27.518505 (+ 34us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:27.518737 (+ 232us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:27.518740 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:27.519642 (+ 902us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:27.519969 (+ 327us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:27.519992 (+ 23us) write_op.cc:312] APPLY: finished
0807 18:16:27.520216 (+ 224us) log.cc:842] Serialized 139 byte log entry
0807 18:16:27.520340 (+ 124us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.520393 (+ 53us) write_op.cc:454] Released schema lock
0807 18:16:27.520406 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:27.520517 (+ 111us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.520521 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:27.000372 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:27.000667 (+ 295us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:27.000673 (+ 6us) write_op.cc:435] Acquired schema lock
0807 18:16:27.000676 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:27.001017 (+ 341us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:27.001034 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:27.001039 (+ 5us) tablet.cc:683] Acquiring locks for 18 operations
0807 18:16:27.001292 (+ 253us) tablet.cc:699] Row locks acquired
0807 18:16:27.001296 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:27.520859 (+519563us) op_driver.cc:444] REPLICATION: finished
0807 18:16:27.521037 (+ 178us) write_op.cc:301] APPLY: starting
0807 18:16:27.521053 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:27.521349 (+ 296us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:27.521352 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:27.522858 (+ 1506us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:27.523039 (+ 181us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:27.523048 (+ 9us) write_op.cc:312] APPLY: finished
0807 18:16:27.523226 (+ 178us) log.cc:842] Serialized 125 byte log entry
0807 18:16:27.523418 (+ 192us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.523457 (+ 39us) write_op.cc:454] Released schema lock
0807 18:16:27.523467 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:27.523584 (+ 117us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.523588 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:27.001411 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:27.001508 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:27.001513 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:27.001515 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:27.001917 (+ 402us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:27.001936 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:27.001942 (+ 6us) tablet.cc:683] Acquiring locks for 19 operations
0807 18:16:27.002196 (+ 254us) tablet.cc:699] Row locks acquired
0807 18:16:27.002199 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:27.520956 (+518757us) op_driver.cc:444] REPLICATION: finished
0807 18:16:27.523717 (+ 2761us) write_op.cc:301] APPLY: starting
0807 18:16:27.523733 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:27.523912 (+ 179us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:27.523915 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:27.525976 (+ 2061us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:27.526105 (+ 129us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:27.526114 (+ 9us) write_op.cc:312] APPLY: finished
0807 18:16:27.526482 (+ 368us) log.cc:842] Serialized 132 byte log entry
0807 18:16:27.526609 (+ 127us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.526687 (+ 78us) write_op.cc:454] Released schema lock
0807 18:16:27.526700 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:27.526883 (+ 183us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.526890 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:27.002313 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:27.002398 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:27.002403 (+ 5us) write_op.cc:435] Acquired schema lock
0807 18:16:27.002405 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:27.016802 (+ 14397us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:27.016832 (+ 30us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:27.016839 (+ 7us) tablet.cc:683] Acquiring locks for 14 operations
0807 18:16:27.017241 (+ 402us) tablet.cc:699] Row locks acquired
0807 18:16:27.017244 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:27.527200 (+509956us) op_driver.cc:444] REPLICATION: finished
0807 18:16:27.527893 (+ 693us) write_op.cc:301] APPLY: starting
0807 18:16:27.527924 (+ 31us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:27.529427 (+ 1503us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:27.529430 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:27.531066 (+ 1636us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:27.531163 (+ 97us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:27.531171 (+ 8us) write_op.cc:312] APPLY: finished
0807 18:16:27.531806 (+ 635us) log.cc:842] Serialized 101 byte log entry
0807 18:16:27.532057 (+ 251us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.532400 (+ 343us) write_op.cc:454] Released schema lock
0807 18:16:27.532413 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:27.532840 (+ 427us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.532854 (+ 14us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:27.017390 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:27.017639 (+ 249us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:27.017646 (+ 7us) write_op.cc:435] Acquired schema lock
0807 18:16:27.017649 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:27.021185 (+ 3536us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:27.021210 (+ 25us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:27.021217 (+ 7us) tablet.cc:683] Acquiring locks for 15 operations
0807 18:16:27.021621 (+ 404us) tablet.cc:699] Row locks acquired
0807 18:16:27.021624 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:27.527311 (+505687us) op_driver.cc:444] REPLICATION: finished
0807 18:16:27.533320 (+ 6009us) write_op.cc:301] APPLY: starting
0807 18:16:27.533373 (+ 53us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:27.533541 (+ 168us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:27.533554 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:27.534086 (+ 532us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:27.534165 (+ 79us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:27.534173 (+ 8us) write_op.cc:312] APPLY: finished
0807 18:16:27.534474 (+ 301us) log.cc:842] Serialized 107 byte log entry
0807 18:16:27.534625 (+ 151us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.534766 (+ 141us) write_op.cc:454] Released schema lock
0807 18:16:27.534778 (+ 12us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:27.534889 (+ 111us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.534893 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:27.022023 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:27.022179 (+ 156us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:27.022187 (+ 8us) write_op.cc:435] Acquired schema lock
0807 18:16:27.022190 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:27.022442 (+ 252us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:27.022457 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:27.022462 (+ 5us) tablet.cc:683] Acquiring locks for 12 operations
0807 18:16:27.022910 (+ 448us) tablet.cc:699] Row locks acquired
0807 18:16:27.022914 (+ 4us) write_op.cc:260] PREPARE: finished
0807 18:16:27.527389 (+504475us) op_driver.cc:444] REPLICATION: finished
0807 18:16:27.533838 (+ 6449us) write_op.cc:301] APPLY: starting
0807 18:16:27.533851 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:27.533902 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:27.533905 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:27.538871 (+ 4966us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:27.539013 (+ 142us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:27.539022 (+ 9us) write_op.cc:312] APPLY: finished
0807 18:16:27.539284 (+ 262us) log.cc:842] Serialized 89 byte log entry
0807 18:16:27.539512 (+ 228us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.539541 (+ 29us) write_op.cc:454] Released schema lock
0807 18:16:27.539552 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:27.539717 (+ 165us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.539721 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:27.023081 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:27.023175 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:27.023181 (+ 6us) write_op.cc:435] Acquired schema lock
0807 18:16:27.023184 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:27.023408 (+ 224us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:27.023421 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:27.023427 (+ 6us) tablet.cc:683] Acquiring locks for 13 operations
0807 18:16:27.023666 (+ 239us) tablet.cc:699] Row locks acquired
0807 18:16:27.023669 (+ 3us) write_op.cc:260] PREPARE: finished
0807 18:16:27.539924 (+516255us) op_driver.cc:444] REPLICATION: finished
0807 18:16:27.540862 (+ 938us) write_op.cc:301] APPLY: starting
0807 18:16:27.540888 (+ 26us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:27.541134 (+ 246us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:27.541138 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:27.541680 (+ 542us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:27.541807 (+ 127us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:27.541815 (+ 8us) write_op.cc:312] APPLY: finished
0807 18:16:27.541987 (+ 172us) log.cc:842] Serialized 95 byte log entry
0807 18:16:27.542070 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.542098 (+ 28us) write_op.cc:454] Released schema lock
0807 18:16:27.542107 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:27.542248 (+ 141us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.542253 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:27.023798 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:27.023920 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:27.023926 (+ 6us) write_op.cc:435] Acquired schema lock
0807 18:16:27.023928 (+ 2us) tablet.cc:660] Decoding operations
0807 18:16:27.024578 (+ 650us) write_op.cc:620] Acquiring the partition lock for write op
0807 18:16:27.024596 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0807 18:16:27.024603 (+ 7us) tablet.cc:683] Acquiring locks for 18 operations
0807 18:16:27.051209 (+ 26606us) tablet.cc:699] Row locks acquired
0807 18:16:27.051215 (+ 6us) write_op.cc:260] PREPARE: finished
0807 18:16:27.540242 (+489027us) op_driver.cc:444] REPLICATION: finished
0807 18:16:27.542360 (+ 2118us) write_op.cc:301] APPLY: starting
0807 18:16:27.542373 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0807 18:16:27.542622 (+ 249us) tablet.cc:1368] finished BulkCheckPresence
0807 18:16:27.542624 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 18:16:27.543206 (+ 582us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 18:16:27.543323 (+ 117us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0807 18:16:27.543332 (+ 9us) write_op.cc:312] APPLY: finished
0807 18:16:27.543426 (+ 94us) log.cc:842] Serialized 125 byte log entry
0807 18:16:27.543526 (+ 100us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.543557 (+ 31us) write_op.cc:454] Released schema lock
0807 18:16:27.543566 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0807 18:16:27.543654 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0807 18:16:27.543660 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0807 18:16:27.051383 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 644a01df651c43d4a74ac241ea43068c
0807 18:16:27.052062 (+ 679us) write_op.cc:432] Acquiring schema lock in shared mode
0807 18:16:27.052071 (+ 9us) write_op.cc:435] Acquired schema lock
0807 18:16:27.052074 (+ 3us) tablet.cc:660] Decoding operations
0807 18:16:27.089060 (+ 36986us)
W20260807 18:16:27.955605 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
I20260807 18:16:28.354423 13260 raft_consensus.cc:1467] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 NON_PARTICIPANT]: Allowing update even though not a member of the config
W20260807 18:16:28.570176 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20260807 18:16:28.881894 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 72 similar messages]
W20260807 18:16:29.006429 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20260807 18:16:29.055552 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
I20260807 18:16:29.541443 13646 consensus_queue.cc:786] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Peer 50da72adf57546f5bab0a028672a51dd is lagging by at least 10 ops behind the committed index
W20260807 18:16:29.639429 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
I20260807 18:16:29.672827 13260 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Committing config change with OpId 1.1244: config changed from index 1179 to 1244, NON_VOTER 50da72adf57546f5bab0a028672a51dd (127.10.253.65) added. New config: { opid_index: 1244 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } } }
W20260807 18:16:29.743494 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.69:45839, user_credentials={real_user=slave}} blocked reactor thread for 46700.2us
I20260807 18:16:29.913132 13161 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:55268 (request call id 21) took 1242 ms. Trace:
I20260807 18:16:29.913304 13161 rpcz_store.cc:276] 0807 18:16:28.670786 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:28.671811 (+ 1025us) service_pool.cc:227] Handling call
0807 18:16:29.912668 (+1240857us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x615000043424. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa6018bb630 00007fa605493c7f 00007fa5fffff016 00007fa5ffffed45 00007fa5fceef9be 00007fa5fceee79e 00007fa5fcef4b25 00007fa5fcef554f 00007fa5fcef5378 00000000009edb7c
0807 18:16:29.913087 (+ 419us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2843862272}
I20260807 18:16:30.039415 13260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.10.253.68:42039 (request call id 78) took 1988 ms. Trace:
W20260807 18:16:30.143985 13669 log.cc:924] Time spent T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd: Append to log took a long time: real 0.102s user 0.000s sys 0.004s
W20260807 18:16:30.230177 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:30.255656 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20260807 18:16:30.458985 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:30.643868 12444 log.cc:924] Time spent T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846: Append to log took a long time: real 0.071s user 0.001s sys 0.000s
W20260807 18:16:30.918789 11975 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.70:40077, user_credentials={real_user=slave}} blocked reactor thread for 43737.2us
W20260807 18:16:30.970649 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.69:45839, user_credentials={real_user=slave}} blocked reactor thread for 51000.2us
I20260807 18:16:30.978958 13691 consensus_queue.cc:786] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Peer 50da72adf57546f5bab0a028672a51dd is lagging by at least 5 ops behind the committed index
W20260807 18:16:31.190743 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.69:45839, user_credentials={real_user=slave}} blocked reactor thread for 86480.5us
W20260807 18:16:31.617794 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20260807 18:16:31.725517 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
I20260807 18:16:30.039618 13260 rpcz_store.cc:276] 0807 18:16:28.050708 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 18:16:28.050834 (+ 126us) service_pool.cc:227] Handling call
0807 18:16:28.310642 (+259808us) raft_consensus.cc:1457] Updating replica for 476 ops
0807 18:16:28.523823 (+213181us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 18:16:28.523839 (+ 16us) raft_consensus.cc:1525] Triggering prepare for 476 ops
0807 18:16:28.524262 (+ 423us) write_op.cc:270] Start()
0807 18:16:28.524357 (+ 95us) write_op.cc:276] Timestamp: P: 1786126569476225 usec, L: 0
0807 18:16:28.694242 (+169885us) write_op.cc:270] Start()
0807 18:16:28.694321 (+ 79us) write_op.cc:276] Timestamp: P: 1786126569525824 usec, L: 0
0807 18:16:28.701524 (+ 7203us) write_op.cc:270] Start()
0807 18:16:28.701577 (+ 53us) write_op.cc:276] Timestamp: P: 1786126569559515 usec, L: 0
0807 18:16:28.701927 (+ 350us) write_op.cc:270] Start()
0807 18:16:28.701971 (+ 44us) write_op.cc:276] Timestamp: P: 1786126569575729 usec, L: 0
0807 18:16:28.733744 (+ 31773us) write_op.cc:270] Start()
0807 18:16:28.733808 (+ 64us) write_op.cc:276] Timestamp: P: 1786126569586927 usec, L: 0
0807 18:16:28.738211 (+ 4403us) write_op.cc:270] Start()
0807 18:16:28.738259 (+ 48us) write_op.cc:276] Timestamp: P: 1786126569689954 usec, L: 0
0807 18:16:28.738640 (+ 381us) write_op.cc:270] Start()
0807 18:16:28.738774 (+ 134us) write_op.cc:276] Timestamp: P: 1786126569696301 usec, L: 0
0807 18:16:28.738970 (+ 196us) write_op.cc:270] Start()
0807 18:16:28.738995 (+ 25us) write_op.cc:276] Timestamp: P: 1786126569699638 usec, L: 0
0807 18:16:28.739221 (+ 226us) write_op.cc:270] Start()
0807 18:16:28.739245 (+ 24us) write_op.cc:276] Timestamp: P: 1786126569700484 usec, L: 0
0807 18:16:28.739504 (+ 259us) write_op.cc:270] Start()
0807 18:16:28.739530 (+ 26us) write_op.cc:276] Timestamp: P: 1786126569836281 usec, L: 0
0807 18:16:28.739750 (+ 220us) write_op.cc:270] Start()
0807 18:16:28.739774 (+ 24us) write_op.cc:276] Timestamp: P: 1786126569855292 usec, L: 0
0807 18:16:28.739991 (+ 217us) write_op.cc:270] Start()
0807 18:16:28.740016 (+ 25us) write_op.cc:276] Timestamp: P: 1786126569856326 usec, L: 0
0807 18:16:28.740168 (+ 152us) write_op.cc:270] Start()
0807 18:16:28.740188 (+ 20us) write_op.cc:276] Timestamp: P: 1786126569857183 usec, L: 0
0807 18:16:28.740427 (+ 239us) write_op.cc:270] Start()
0807 18:16:28.740488 (+ 61us) write_op.cc:276] Timestamp: P: 1786126569901413 usec, L: 0
0807 18:16:28.740716 (+ 228us) write_op.cc:270] Start()
0807 18:16:28.740738 (+ 22us) write_op.cc:276] Timestamp: P: 1786126569913440 usec, L: 0
0807 18:16:28.740994 (+ 256us) write_op.cc:270] Start()
0807 18:16:28.741016 (+ 22us) write_op.cc:276] Timestamp: P: 1786126569914229 usec, L: 0
0807 18:16:28.741214 (+ 198us) write_op.cc:270] Start()
0807 18:16:28.741234 (+ 20us) write_op.cc:276] Timestamp: P: 1786126569977651 usec, L: 0
0807 18:16:28.741354 (+ 120us) write_op.cc:270] Start()
0807 18:16:28.741372 (+ 18us) write_op.cc:276] Timestamp: P: 1786126570056716 usec, L: 0
0807 18:16:28.741566 (+ 194us) write_op.cc:270] Start()
0807 18:16:28.741592 (+ 26us) write_op.cc:276] Timestamp: P: 1786126570058635 usec, L: 0
0807 18:16:28.751349 (+ 9757us) write_op.cc:270] Start()
0807 18:16:28.751403 (+ 54us) write_op.cc:276] Timestamp: P: 1786126570075446 usec, L: 0
0807 18:16:28.751737 (+ 334us) write_op.cc:270] Start()
0807 18:16:28.751763 (+ 26us) write_op.cc:276] Timestamp: P: 1786126570103429 usec, L: 0
0807 18:16:28.752084 (+ 321us) write_op.cc:270] Start()
0807 18:16:28.752109 (+ 25us) write_op.cc:276] Timestamp: P: 1786126570152519 usec, L: 0
0807 18:16:28.752338 (+ 229us) write_op.cc:270] Start()
0807 18:16:28.752364 (+ 26us) write_op.cc:276] Timestamp: P: 1786126570286538 usec, L: 0
0807 18:16:28.752512 (+ 148us) write_op.cc:270] Start()
0807 18:16:28.752551 (+ 39us) write_op.cc:276] Timestamp: P: 1786126570289563 usec, L: 0
0807 18:16:28.753471 (+ 920us) write_op.cc:270] Start()
0807 18:16:28.753564 (+ 93us) write_op.cc:276] Timestamp: P: 1786126570295621 usec, L: 0
0807 18:16:28.754012 (+ 448us) write_op.cc:270] Start()
0807 18:16:28.754040 (+ 28us) write_op.cc:276] Timestamp: P: 1786126570296631 usec, L: 0
0807 18:16:28.786694 (+ 32654us) write_op.cc:270] Start()
0807 18:16:28.786766 (+ 72us) write_op.cc:276] Timestamp: P: 1786126570327076 usec, L: 0
0807 18:16:28.787351 (+ 585us) write_op.cc:270] Start()
0807 18:16:28.787408 (+ 57us) write_op.cc:276] Timestamp: P: 1786126570361015 usec, L: 0
0807 18:16:28.787770 (+ 362us) write_op.cc:270] Start()
0807 18:16:28.787799 (+ 29us) write_op.cc:276] Timestamp: P: 1786126570361950 usec, L: 0
0807 18:16:28.788115 (+ 316us) write_op.cc:270] Start()
0807 18:16:28.788299 (+ 184us) write_op.cc:276] Timestamp: P: 1786126570379346 usec, L: 0
0807 18:16:28.789015 (+ 716us) write_op.cc:270] Start()
0807 18:16:28.789436 (+ 421us) write_op.cc:276] Timestamp: P: 1786126570426705 usec, L: 0
0807 18:16:28.789807 (+ 371us) write_op.cc:270] Start()
0807 18:16:28.789857 (+ 50us) write_op.cc:276] Timestamp: P: 1786126570457051 usec, L: 0
0807 18:16:28.821050 (+ 31193us) write_op.cc:270] Start()
0807 18:16:28.821105 (+ 55us) write_op.cc:276] Timestamp: P: 1786126570474311 usec, L: 0
0807 18:16:28.837929 (+ 16824us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x60f00000add8. stack: 00007fa5f63b366e 00007fa5f63b3430 00007fa5f543a5ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa5feeb0c35 00007fa601927e49 00007fa6018cf5c9 00007fa6018ccee9 00007fa605473a6c 00007fa5ffd5efa6 00007fa5ffd5ecd5 00007fa5fceef9be 00007fa5fceee79e 00007fa5fcef4b25
0807 18:16:28.838251 (+ 322us) write_op.cc:270] Start()
0807 18:16:28.838314 (+ 63us) write_op.cc:276] Timestamp: P: 1786126570480074 usec, L: 0
0807 18:16:28.838987 (+ 673us) write_op.cc:270] Start()
0807 18:16:28.839030 (+ 43us) write_op.cc:276] Timestamp: P: 1786126570559700 usec, L: 0
0807 18:16:28.862334 (+ 23304us) write_op.cc:270] Start()
0807 18:16:28.862391 (+ 57us) write_op.cc:276] Timestamp: P: 1786126570601280 usec, L: 0
0807 18:16:28.862701 (+ 310us) write_op.cc:270] Start()
0807 18:16:28.862729 (+ 28us) write_op.cc:276] Timestamp: P: 1786126570605956 usec, L: 0
0807 18:16:28.863298 (+ 569us) write_op.cc:270] Start()
0807 18:16:28.863338 (+ 40us) write_op.cc:276] Timestamp: P: 1786126570627322 usec, L: 0
0807 18:16:28.865419 (+ 2081us) write_op.cc:270] Start()
0807 18:16:28.865461 (+ 42us) write_op.cc:276] Timestamp: P: 1786126570674166 usec, L: 0
0807 18:16:28.865651 (+ 190us) write_op.cc:270] Start()
0807 18:16:28.865675 (+ 24us) write_op.cc:276] Timestamp: P: 1786126570689156 usec, L: 0
0807 18:16:28.865844 (+ 169us) write_op.cc:270] Start()
0807 18:16:28.865869 (+ 25us) write_op.cc:276] Timestamp: P: 1786126570724958 usec, L: 0
0807 18:16:28.866074 (+ 205us) write_op.cc:270] Start()
0807 18:16:28.866102 (+ 28us) write_op.cc:276] Timestamp: P: 1786126570726170 usec, L: 0
0807 18:16:28.866338 (+ 236us) write_op.cc:270] Start()
0807 18:16:28.866361 (+ 23us) write_op.cc:276] Timestamp: P: 1786126570840501 usec, L: 0
0807 18:16:28.866593 (+ 232us) write_op.cc:270] Start()
0807 18:16:28.866620 (+ 27us) write_op.cc:276] Timestamp: P: 1786126570845578 usec, L: 0
0807 18:16:28.867000 (+ 380us) write_op.cc:270] Start()
0807 18:16:28.867047 (+ 47us) write_op.cc:276] Timestamp: P: 1786126570881956 usec, L: 0
0807 18:16:28.867380 (+ 333us) write_op.cc:270] Start()
0807 18:16:28.867410 (+ 30us) write_op.cc:276] Timestamp: P: 1786126570887924 usec, L: 0
0807 18:16:28.867966 (+ 556us) write_op.cc:270] Start()
0807 18:16:28.868009 (+ 43us) write_op.cc:276] Timestamp: P: 1786126570974903 usec, L: 0
0807 18:16:28.868555 (+ 546us) write_op.cc:270] Start()
0807 18:16:28.868585 (+ 30us) write_op.cc:276] Timestamp: P: 1786126571012188 usec, L: 0
0807 18:16:28.874831 (+ 6246us) write_op.cc:270] Start()
0807 18:16:28.874873 (+ 42us) write_op.cc:276] Timestamp: P: 1786126571012879 usec, L: 0
0807 18:16:28.875654 (+ 781us) write_op.cc:270] Start()
0807 18:16:28.875720 (+ 66us) write_op.cc:276] Timestamp: P: 1786126571015577 usec, L: 0
0807 18:16:28.876109 (+ 389us) write_op.cc:270] Start()
0807 18:16:28.876141 (+ 32us) write_op.cc:276] Timestamp: P: 1786126571038169 usec, L: 0
0807 18:16:28.876779 (+ 638us) write_op.cc:270] Start()
0807 18:16:28.876815 (+ 36us) write_op.cc:276] Timestamp: P: 1786126571126310 usec, L: 0
0807 18:16:28.877402 (+ 587us) write_op.cc:270] Start()
0807 18:16:28.877430 (+ 28us) write_op.cc:276] Timestamp: P: 1786126571135647 usec, L: 0
0807 18:16:28.877655 (+ 225us) write_op.cc:270] Start()
0807 18:16:28.877680 (+ 25us) write_op.cc:276] Timestamp: P: 1786126571139353 usec, L: 0
0807 18:16:28.878110 (+ 430us) write_op.cc:270] Start()
0807 18:16:28.878143 (+ 33us) write_op.cc:276] Timestamp: P: 1786126571140382 usec, L: 0
0807 18:16:28.892679 (+ 14536us) write_op.cc:270] Start()
0807 18:16:28.892726 (+ 47us) write_op.cc:276] Timestamp: P: 1786126571215102 usec, L: 0
0807 18:16:28.904839 (+ 12113us) write_op.cc:270] Start()
0807 18:16:28.915781 (+ 10942us) write_op.cc:276] Timestamp: P: 1786126571219105 usec, L: 0
0807 18:16:28.916128 (+ 347us) write_op.cc:270] Start()
0807 18:16:28.916167 (+ 39us) write_op.cc:276] Timestamp: P: 1786126571226498 usec, L: 0
0807 18:16:28.916330 (+ 163us) write_op.cc:270] Start()
0807 18:16:28.916354 (+ 24us) write_op.cc:276] Timestamp: P: 1786126571298252 usec, L: 0
0807 18:16:28.916504 (+ 150us) write_op.cc:270] Start()
0807 18:16:28.916526 (+ 22us) write_op.cc:276] Timestamp: P: 1786126571346702 usec, L: 0
0807 18:16:28.916651 (+ 125us) write_op.cc:270] Start()
0807 18:16:28.916672 (+ 21us) write_op.cc:276] Timestamp: P: 1786126571379867 usec, L: 0
0807 18:16:28.918167 (+ 1495us) write_op.cc:270] Start()
0807 18:16:28.918198 (+ 31us) write_op.cc:276] Timestamp: P: 1786126571426257 usec, L: 0
0807 18:16:28.918426 (+ 228us) write_op.cc:270] Start()
0807 18:16:28.918451 (+ 25us) write_op.cc:276] Timestamp: P: 1786126571441414 usec, L: 0
0807 18:16:28.918714 (+ 263us) write_op.cc:270] Start()
0807 18:16:28.918740 (+ 26us) write_op.cc:276] Timestamp: P: 1786126571452713 usec, L: 0
0807 18:16:28.919153 (+ 413us) write_op.cc:270] Start()
0807 18:16:28.919182 (+ 29us) write_op.cc:276] Timestamp: P: 1786126571476365 usec, L: 0
0807 18:16:28.919409 (+ 227us) write_op.cc:270] Start()
0807 18:16:28.919433 (+ 24us) write_op.cc:276] Timestamp: P: 1786126571623360 usec, L: 0
0807 18:16:28.919657 (+ 224us) write_op.cc:270] Start()
0807 18:16:28.919681 (+ 24us) write_op.cc:276] Timestamp: P: 1786126571635832 usec, L: 0
0807 18:16:28.944618 (+ 24937us) write_op.cc:270] Start()
0807 18:16:28.944663 (+ 45us) write_op.cc:276] Timestamp: P: 1786126571661603 usec, L: 0
0807 18:16:28.944977 (+ 314us) write_op.cc:270] Start()
0807 18:16:28.950135 (+ 5158us) write_op.cc:276] Timestamp: P: 1786126571760238 usec, L: 0
0807 18:16:28.957469 (+ 7334us) write_op.cc:270] Start()
0807 18:16:28.957509 (+ 40us) write_op.cc:276] Timestamp: P: 1786126571821694 usec, L: 0
0807 18:16:28.962926 (+ 5417us) write_op.cc:270] Start()
0807 18:16:28.962995 (+ 69us) write_op.cc:276] Timestamp: P: 1786126571847433 usec, L: 0
0807 18:16:28.963567 (+ 572us) write_op.cc:270] Start()
0807 18:16:28.963865 (+ 298us) write_op.cc:276] Timestamp: P: 1786126571948032 usec, L: 0
0807 18:16:28.964173 (+ 308us) write_op.cc:270] Start()
0807 18:16:28.964209 (+ 36us) write_op.cc:276] Timestamp: P: 1786126571954277 usec, L: 0
0807 18:16:28.964400 (+ 191us) write_op.cc:270] Start()
0807 18:16:28.964427 (+ 27us) write_op.cc:276] Timestamp: P: 1786126571962013 usec, L: 0
0807 18:16:28.964628 (+ 201us) write_op.cc:270] Start()
0807 18:16:28.964654 (+ 26us) write_op.cc:276] Timestamp: P: 1786126571964885 usec, L: 0
0807 18:16:28.964806 (+ 152us) write_op.cc:270] Start()
0807 18:16:28.964827 (+ 21us) write_op.cc:276] Timestamp: P: 1786126572065130 usec, L: 0
0807 18:16:28.964969 (+ 142us) write_op.cc:270] Start()
0807 18:16:28.964990 (+ 21us) write_op.cc:276] Timestamp: P: 1786126572116595 usec, L: 0
0807 18:16:28.965135 (+ 145us) write_op.cc:270] Start()
0807 18:16:28.965156 (+ 21us) write_op.cc:276] Timestamp: P: 1786126572119357 usec, L: 0
0807 18:16:28.965295 (+ 139us) write_op.cc:270] Start()
0807 18:16:28.965315 (+ 20us) write_op.cc:276] Timestamp: P: 1786126572124570 usec, L: 0
0807 18:16:28.965480 (+ 165us) write_op.cc:270] Start()
0807 18:16:28.965500 (+ 20us) write_op.cc:276] Timestamp: P: 1786126572200080 usec, L: 0
0807 18:16:28.966095 (+ 595us) write_op.cc:270] Start()
0807 18:16:28.966135 (+ 40us) write_op.cc:276] Timestamp: P: 1786126572262361 usec, L: 0
0807 18:16:28.966345 (+ 210us) write_op.cc:270] Start()
0807 18:16:28.966367 (+ 22us) write_op.cc:276] Timestamp: P: 1786126572283852 usec, L: 0
0807 18:16:28.985358 (+ 18991us) write_op.cc:270] Start()
0807 18:16:28.985407 (+ 49us) write_op.cc:276] Timestamp: P: 1786126572286842 usec, L: 0
0807 18:16:28.985688 (+ 281us) write_op.cc:270] Start()
0807 18:16:28.985716 (+ 28us) write_op.cc:276] Timestamp: P: 1786126572354992 usec, L: 0
0807 18:16:28.985877 (+ 161us) write_op.cc:270] Start()
0807 18:16:28.985900 (+ 23us) write_op.cc:276] Timestamp: P: 1786126572356385 usec, L: 0
0807 18:16:28.986266 (+ 366us) write_op.cc:270] Start()
0807 18:16:28.986294 (+ 28us) write_op.cc:276] Timestamp: P: 1786126572460854 usec, L: 0
0807 18:16:28.986461 (+ 167us) write_op.cc:270] Start()
0807 18:16:28.986483 (+ 22us) write_op.cc:276] Timestamp: P: 1786126572468227 usec, L: 0
0807 18:16:28.987128 (+ 645us) write_op.cc:270] Start()
0807 18:16:28.987169 (+ 41us) write_op.cc:276] Timestamp: P: 1786126572563249 usec, L: 0
0807 18:16:28.987397 (+ 228us) write_op.cc:270] Start()
0807 18:16:28.987425 (+ 28us) write_op.cc:276] Timestamp: P: 1786126572565592 usec, L: 0
0807 18:16:28.987753 (+ 328us) write_op.cc:270] Start()
0807 18:16:28.987781 (+ 28us) write_op.cc:276] Timestamp: P: 1786126572643816 usec, L: 0
0807 18:16:28.987960 (+ 179us) write_op.cc:270] Start()
0807 18:16:28.987984 (+ 24us) write_op.cc:276] Timestamp: P: 1786126572648129 usec, L: 0
0807 18:16:28.988377 (+ 393us) write_op.cc:270] Start()
0807 18:16:28.988405 (+ 28us) write_op.cc:276] Timestamp: P: 1786126572703725 usec, L: 0
0807 18:16:28.988914 (+ 509us) write_op.cc:270] Start()
0807 18:16:28.988942 (+ 28us) write_op.cc:276] Timestamp: P: 1786126572748003 usec, L: 0
0807 18:16:28.989104 (+ 162us) write_op.cc:270] Start()
0807 18:16:28.989128 (+ 24us) write_op.cc:276] Timestamp: P: 1786126572783184 usec, L: 0
0807 18:16:28.989282 (+ 154us) write_op.cc:270] Start()
0807 18:16:28.989303 (+ 21us) write_op.cc:276] Timestamp: P: 1786126572791208 usec, L: 0
0807 18:16:28.989427 (+ 124us) write_op.cc:270] Start()
0807 18:16:28.989445 (+ 18us) write_op.cc:276] Timestamp: P: 1786126572947862 usec, L: 0
0807 18:16:28.989675 (+ 230us) write_op.cc:270] Start()
0807 18:16:28.989699 (+ 24us) write_op.cc:276] Timestamp: P: 1786126573041502 usec, L: 0
0807 18:16:28.989848 (+ 149us) write_op.cc:270] Start()
0807 18:16:28.989870 (+ 22us) write_op.cc:276] Timestamp: P: 1786126573045575 usec, L: 0
0807 18:16:28.990027 (+ 157us) write_op.cc:270] Start()
0807 18:16:28.990048 (+ 21us) write_op.cc:276] Timestamp: P: 1786126573047104 usec, L: 0
0807 18:16:28.990229 (+ 181us) write_op.cc:270] Start()
0807 18:16:28.990250 (+ 21us) write_op.cc:276] Timestamp: P: 1786126573122416 usec, L: 0
0807 18:16:28.990398 (+ 148us) write_op.cc:270] Start()
0807 18:16:28.990418 (+ 20us) write_op.cc:276] Timestamp: P: 1786126573165661 usec, L: 0
0807 18:16:29.020188 (+ 29770us) write_op.cc:270] Start()
0807 18:16:29.020235 (+ 47us) write_op.cc:276] Timestamp: P: 1786126573182737 usec, L: 0
0807 18:16:29.020521 (+ 286us) write_op.cc:270] Start()
0807 18:16:29.020547 (+ 26us) write_op.cc:276] Timestamp: P: 1786126573186677 usec, L: 0
0807 18:16:29.020696 (+ 149us) write_op.cc:270] Start()
0807 18:16:29.020720 (+ 24us) write_op.cc:276] Timestamp: P: 1786126573220220 usec, L: 0
0807 18:16:29.030824 (+ 10104us) write_op.cc:270] Start()
0807 18:16:29.030884 (+ 60us) write_op.cc:276] Timestamp: P: 1786126573250825 usec, L: 0
0807 18:16:29.031183 (+ 299us) write_op.cc:270] Start()
0807 18:16:29.031209 (+ 26us) write_op.cc:276] Timestamp: P: 1786126573298393 usec, L: 0
0807 18:16:29.031402 (+ 193us) write_op.cc:270] Start()
0807 18:16:29.031424 (+ 22us) write_op.cc:276] Timestamp: P: 1786126573304955 usec, L: 0
0807 18:16:29.031578 (+ 154us) write_op.cc:270] Start()
0807 18:16:29.031600 (+ 22us) write_op.cc:276] Timestamp: P: 1786126573379975 usec, L: 0
0807 18:16:29.031741 (+ 141us) write_op.cc:270] Start()
0807 18:16:29.031759 (+ 18us) write_op.cc:276] Timestamp: P: 1786126573387285 usec, L: 0
0807 18:16:29.031874 (+ 115us) write_op.cc:270] Start()
0807 18:16:29.031893 (+ 19us) write_op.cc:276] Timestamp: P: 1786126573450139 usec, L: 0
0807 18:16:29.032036 (+ 143us) write_op.cc:270] Start()
0807 18:16:29.032056 (+ 20us) write_op.cc:276] Timestamp: P: 1786126573512948 usec, L: 0
0807 18:16:29.032176 (+ 120us) write_op.cc:270] Start()
0807 18:16:29.032194 (+ 18us) write_op.cc:276] Timestamp: P: 1786126573572074 usec, L: 0
0807 18:16:29.032339 (+ 145us) write_op.cc:270] Start()
0807 18:16:29.032374 (+ 35us) write_op.cc:276] Timestamp: P: 1786126573583012 usec, L: 0
0807 18:16:29.032516 (+ 142us) write_op.cc:270] Start()
0807 18:16:29.032536 (+ 20us) write_op.cc:276] Timestamp: P: 1786126573584317 usec, L: 0
0807 18:16:29.032669 (+ 133us) write_op.cc:270] Start()
0807 18:16:29.032685 (+ 16us) write_op.cc:276] Timestamp: P: 1786126573636322 usec, L: 0
0807 18:16:29.032856 (+ 171us) write_op.cc:270] Start()
0807 18:16:29.032875 (+ 19us) write_op.cc:276] Timestamp: P: 1786126573648568 usec, L: 0
0807 18:16:29.033007 (+ 132us) write_op.cc:270] Start()
0807 18:16:29.033041 (+ 34us) write_op.cc:276] Timestamp: P: 1786126573691667 usec, L: 0
0807 18:16:29.033166 (+ 125us) write_op.cc:270] Start()
0807 18:16:29.033186 (+ 20us) write_op.cc:276] Timestamp: P: 1786126573723128 usec, L: 0
0807 18:16:29.033311 (+ 125us) write_op.cc:270] Start()
0807 18:16:29.033328 (+ 17us) write_op.cc:276] Timestamp: P: 1786126573773900 usec, L: 0
0807 18:16:29.033485 (+ 157us) write_op.cc:270] Start()
0807 18:16:29.033506 (+ 21us) write_op.cc:276] Timestamp: P: 1786126573782431 usec, L: 0
0807 18:16:29.033652 (+ 146us) write_op.cc:270] Start()
0807 18:16:29.033669 (+ 17us) write_op.cc:276] Timestamp: P: 1786126573886538 usec, L: 0
0807 18:16:29.033784 (+ 115us) write_op.cc:270] Start()
0807 18:16:29.033806 (+ 22us) write_op.cc:276] Timestamp: P: 1786126573896888 usec, L: 0
0807 18:16:29.033950 (+ 144us) write_op.cc:270] Start()
0807 18:16:29.033968 (+ 18us) write_op.cc:276] Timestamp: P: 1786126573930306 usec, L: 0
0807 18:16:29.034097 (+ 129us) write_op.cc:270] Start()
0807 18:16:29.034115 (+ 18us) write_op.cc:276] Timestamp: P: 1786126573950673 usec, L: 0
0807 18:16:29.034254 (+ 139us) write_op.cc:270] Start()
0807 18:16:29.034272 (+ 18us) write_op.cc:276] Timestamp: P: 1786126573981730 usec, L: 0
0807 18:16:29.057116 (+ 22844us) write_op.cc:270] Start()
0807 18:16:29.057148 (+ 32us) write_op.cc:276] Timestamp: P: 1786126574012274 usec, L: 0
0807 18:16:29.057735 (+ 587us) write_op.cc:270] Start()
0807 18:16:29.057766 (+ 31us) write_op.cc:276] Timestamp: P: 1786126574021003 usec, L: 0
0807 18:16:29.057925 (+ 159us) write_op.cc:270] Start()
0807 18:16:29.057972 (+ 47us) write_op.cc:276] Timestamp: P: 1786126574120768 usec, L: 0
0807 18:16:29.058144 (+ 172us) write_op.cc:270] Start()
0807 18:16:29.058165 (+ 21us) write_op.cc:276] Timestamp: P: 1786126574156961 usec, L: 0
0807 18:16:29.058294 (+ 129us) write_op.cc:270] Start()
0807 18:16:29.058311 (+ 17us) write_op.cc:276] Timestamp: P: 1786126574197476 usec, L: 0
0807 18:16:29.058446 (+ 135us) write_op.cc:270] Start()
0807 18:16:29.058463 (+ 17us) write_op.cc:276] Timestamp: P: 1786126574213312 usec, L: 0
0807 18:16:29.083591 (+ 25128us) write_op.cc:270] Start()
0807 18:16:29.083637 (+ 46us) write_op.cc:276] Timestamp: P: 1786126574285680 usec, L: 0
0807 18:16:29.083883 (+ 246us) write_op.cc:270] Start()
0807 18:16:29.083906 (+ 23us) write_op.cc:276] Timestamp: P: 1786126574291253 usec, L: 0
0807 18:16:29.084070 (+ 164us) write_op.cc:270] Start()
0807 18:16:29.084094 (+ 24us) write_op.cc:276] Timestamp: P: 1786126574375599 usec, L: 0
0807 18:16:29.084245 (+ 151us) write_op.cc:270] Start()
0807 18:16:29.084266 (+ 21us) write_op.cc:276] Timestamp: P: 1786126574376916 usec, L: 0
0807 18:16:29.084392 (+ 126us) write_op.cc:270] Start()
0807 18:16:29.084411 (+ 19us) write_op.cc:276] Timestamp: P: 1786126574385716 usec, L: 0
0807 18:16:29.084558 (+ 147us) write_op.cc:270] Start()
0807 18:16:29.084577 (+ 19us) write_op.cc:276] Timestamp: P: 1786126574472994 usec, L: 0
0807 18:16:29.084738 (+ 161us) write_op.cc:270] Start()
0807 18:16:29.084759 (+ 21us) write_op.cc:276] Timestamp: P: 1786126574509399 usec, L: 0
0807 18:16:29.084907 (+ 148us) write_op.cc:270] Start()
0807 18:16:29.084927 (+ 20us) write_op.cc:276] Timestamp: P: 1786126574549827 usec, L: 0
0807 18:16:29.085266 (+ 339us) write_op.cc:270] Start()
0807 18:16:29.085291 (+ 25us) write_op.cc:276] Timestamp: P: 1786126574567061 usec, L: 0
0807 18:16:29.118812 (+ 33521us) write_op.cc:270] Start()
0807 18:16:29.119379 (+ 567us) write_op.cc:276] Timestamp: P: 1786126574671261 usec, L: 0
0807 18:16:29.119682 (+ 303us) write_op.cc:270] Start()
0807 18:16:29.119714 (+ 32us) write_op.cc:276] Timestamp: P: 1786126574672771 usec, L: 0
0807 18:16:29.119911 (+ 197us) write_op.cc:270] Start()
0807 18:16:29.119938 (+ 27us) write_op.cc:276] Timestamp: P: 1786126574706762 usec, L: 0
0807 18:16:29.120109 (+ 171us) write_op.cc:270] Start()
0807 18:16:29.120137 (+ 28us) write_op.cc:276] Timestamp: P: 1786126574885858 usec, L: 0
0807 18:16:29.120288 (+ 151us) write_op.cc:270] Start()
0807 18:16:29.120537 (+ 249us) write_op.cc:276] Timestamp: P: 1786126574890845 usec, L: 0
0807 18:16:29.121059 (+ 522us) write_op.cc:270] Start()
0807 18:16:29.121088 (+ 29us) write_op.cc:276] Timestamp: P: 1786126574892167 usec, L: 0
0807 18:16:29.121266 (+ 178us) write_op.cc:270] Start()
0807 18:16:29.121289 (+ 23us) write_op.cc:276] Timestamp: P: 1786126574897674 usec, L: 0
0807 18:16:29.121437 (+ 148us) write_op.cc:270] Start()
0807 18:16:29.121460 (+ 23us) write_op.cc:276] Timestamp: P: 1786126575079786 usec, L: 0
0807 18:16:29.121616 (+ 156us) write_op.cc:270] Start()
0807 18:16:29.121639 (+ 23us) write_op.cc:276] Timestamp: P: 1786126575088428 usec, L: 0
0807 18:16:29.121785 (+ 146us) write_op.cc:270] Start()
0807 18:16:29.121809 (+ 24us) write_op.cc:276] Timestamp: P: 1786126575090883 usec, L: 0
0807 18:16:29.122345 (+ 536us) write_op.cc:270] Start()
0807 18:16:29.122381 (+ 36us) write_op.cc:276] Timestamp: P: 1786126575098648 usec, L: 0
0807 18:16:29.155325 (+ 32944us) write_op.cc:270] Start()
0807 18:16:29.155363 (+ 38us) write_op.cc:276] Timestamp: P: 1786126575229979 usec, L: 0
0807 18:16:29.156163 (+ 800us) write_op.cc:270] Start()
0807 18:16:29.156193 (+ 30us) write_op.cc:276] Timestamp: P: 1786126575263480 usec, L: 0
0807 18:16:29.156380 (+ 187us) write_op.cc:270] Start()
0807 18:16:29.156405 (+ 25us) write_op.cc:276] Timestamp: P: 1786126575272940 usec, L: 0
0807 18:16:29.157065 (+ 660us) write_op.cc:270] Start()
0807 18:16:29.157115 (+ 50us) write_op.cc:276] Timestamp: P: 1786126575281925 usec, L: 0
0807 18:16:29.157829 (+ 714us) write_op.cc:270] Start()
0807 18:16:29.157861 (+ 32us) write_op.cc:276] Timestamp: P: 1786126575427426 usec, L: 0
0807 18:16:29.158277 (+ 416us) write_op.cc:270] Start()
0807 18:16:29.158483 (+ 206us) write_op.cc:276] Timestamp: P: 1786126575428598 usec, L: 0
0807 18:16:29.191054 (+ 32571us) write_op.cc:270] Start()
0807 18:16:29.191105 (+ 51us) write_op.cc:276] Timestamp: P: 1786126575431675 usec, L: 0
0807 18:16:29.191382 (+ 277us) write_op.cc:270] Start()
0807 18:16:29.191406 (+ 24us) write_op.cc:276] Timestamp: P: 1786126575439988 usec, L: 0
0807 18:16:29.191562 (+ 156us) write_op.cc:270] Start()
0807 18:16:29.191585 (+ 23us) write_op.cc:276] Timestamp: P: 1786126575549874 usec, L: 0
0807 18:16:29.191725 (+ 140us) write_op.cc:270] Start()
0807 18:16:29.191744 (+ 19us) write_op.cc:276] Timestamp: P: 1786126575551873 usec, L: 0
0807 18:16:29.191890 (+ 146us) write_op.cc:270] Start()
0807 18:16:29.191908 (+ 18us) write_op.cc:276] Timestamp: P: 1786126575556289 usec, L: 0
0807 18:16:29.192182 (+ 274us) write_op.cc:270] Start()
0807 18:16:29.192207 (+ 25us) write_op.cc:276] Timestamp: P: 1786126575564960 usec, L: 0
0807 18:16:29.192392 (+ 185us) write_op.cc:270] Start()
0807 18:16:29.192419 (+ 27us) write_op.cc:276] Timestamp: P: 1786126575731993 usec, L: 0
0807 18:16:29.192586 (+ 167us) write_op.cc:270] Start()
0807 18:16:29.192606 (+ 20us) write_op.cc:276] Timestamp: P: 1786126575747869 usec, L: 0
0807 18:16:29.192772 (+ 166us) write_op.cc:270] Start()
0807 18:16:29.192793 (+ 21us) write_op.cc:276] Timestamp: P: 1786126575750595 usec, L: 0
0807 18:16:29.192959 (+ 166us) write_op.cc:270] Start()
0807 18:16:29.192980 (+ 21us) write_op.cc:276] Timestamp: P: 1786126575854663 usec, L: 0
0807 18:16:29.193227 (+ 247us) write_op.cc:270] Start()
0807 18:16:29.193258 (+ 31us) write_op.cc:276] Timestamp: P: 1786126575876587 usec, L: 0
0807 18:16:29.193422 (+ 164us) write_op.cc:270] Start()
0807 18:16:29.193445 (+ 23us) write_op.cc:276] Timestamp: P: 1786126575895905 usec, L: 0
0807 18:16:29.193583 (+ 138us) write_op.cc:270] Start()
0807 18:16:29.193603 (+ 20us) write_op.cc:276] Timestamp: P: 1786126575896864 usec, L: 0
0807 18:16:29.193727 (+ 124us) write_op.cc:270] Start()
0807 18:16:29.193745 (+ 18us) write_op.cc:276] Timestamp: P: 1786126575972128 usec, L: 0
0807 18:16:29.193876 (+ 131us) write_op.cc:270] Start()
0807 18:16:29.193896 (+ 20us) write_op.cc:276] Timestamp: P: 1786126576007401 usec, L: 0
0807 18:16:29.194021 (+ 125us) write_op.cc:270] Start()
0807 18:16:29.194041 (+ 20us) write_op.cc:276] Timestamp: P: 1786126576013718 usec, L: 0
0807 18:16:29.194165 (+ 124us) write_op.cc:270] Start()
0807 18:16:29.194188 (+ 23us) write_op.cc:276] Timestamp: P: 1786126576061595 usec, L: 0
0807 18:16:29.194329 (+ 141us) write_op.cc:270] Start()
0807 18:16:29.194349 (+ 20us) write_op.cc:276] Timestamp: P: 1786126576095497 usec, L: 0
0807 18:16:29.194475 (+ 126us) write_op.cc:270] Start()
0807 18:16:29.194499 (+ 24us) write_op.cc:276] Timestamp: P: 1786126576148869 usec, L: 0
0807 18:16:29.194661 (+ 162us) write_op.cc:270] Start()
0807 18:16:29.194681 (+ 20us) write_op.cc:276] Timestamp: P: 1786126576170512 usec, L: 0
0807 18:16:29.194807 (+ 126us) write_op.cc:270] Start()
0807 18:16:29.194826 (+ 19us) write_op.cc:276] Timestamp: P: 1786126576189782 usec, L: 0
0807 18:16:29.194979 (+ 153us) write_op.cc:270] Start()
0807 18:16:29.195001 (+ 22us) write_op.cc:276] Timestamp: P: 1786126576233616 usec, L: 0
0807 18:16:29.195144 (+ 143us) write_op.cc:270] Start()
0807 18:16:29.195166 (+ 22us) write_op.cc:276] Timestamp: P: 1786126576285811 usec, L: 0
0807 18:16:29.195308 (+ 142us) write_op.cc:270] Start()
0807 18:16:29.195330 (+ 22us) write_op.cc:276] Timestamp: P: 1786126576301480 usec, L: 0
0807 18:16:29.195482 (+ 152us) write_op.cc:270] Start()
0807 18:16:29.195503 (+ 21us) write_op.cc:276] Timestamp: P: 1786126576478165 usec, L: 0
0807 18:16:29.195671 (+ 168us) write_op.cc:270] Start()
0807 18:16:29.195692 (+ 21us) write_op.cc:276] Timestamp: P: 1786126576496144 usec, L: 0
0807 18:16:29.195853 (+ 161us) write_op.cc:270] Start()
0807 18:16:29.195882 (+ 29us) write_op.cc:276] Timestamp: P: 1786126576511508 usec, L: 0
0807 18:16:29.196017 (+ 135us) write_op.cc:270] Start()
0807 18:16:29.196037 (+ 20us) write_op.cc:276] Timestamp: P: 1786126576581920 usec, L: 0
0807 18:16:29.196166 (+ 129us) write_op.cc:270] Start()
0807 18:16:29.196187 (+ 21us) write_op.cc:276] Timestamp: P: 1786126576611998 usec, L: 0
0807 18:16:29.196312 (+ 125us) write_op.cc:270] Start()
0807 18:16:29.196330 (+ 18us) write_op.cc:276] Timestamp: P: 1786126576671735 usec, L: 0
0807 18:16:29.196449 (+ 119us) write_op.cc:270] Start()
0807 18:16:29.196468 (+ 19us) write_op.cc:276] Timestamp: P: 1786126576801585 usec, L: 0
0807 18:16:29.196622 (+ 154us) write_op.cc:270] Start()
0807 18:16:29.196643 (+ 21us) write_op.cc:276] Timestamp: P: 1786126576833382 usec, L: 0
0807 18:16:29.196769 (+ 126us) write_op.cc:270] Start()
0807 18:16:29.196788 (+ 19us) write_op.cc:276] Timestamp: P: 1786126576909430 usec, L: 0
0807 18:16:29.196920 (+ 132us) write_op.cc:270] Start()
0807 18:16:29.196939 (+ 19us) write_op.cc:276] Timestamp: P: 1786126576912584 usec, L: 0
0807 18:16:29.197060 (+ 121us) write_op.cc:270] Start()
0807 18:16:29.197079 (+ 19us) write_op.cc:276] Timestamp: P: 1786126576947036 usec, L: 0
0807 18:16:29.197217 (+ 138us) write_op.cc:270] Start()
0807 18:16:29.197237 (+ 20us) write_op.cc:276] Timestamp: P: 1786126577100412 usec, L: 0
0807 18:16:29.197377 (+ 140us) write_op.cc:270] Start()
0807 18:16:29.197398 (+ 21us) write_op.cc:276] Timestamp: P: 1786126577149570 usec, L: 0
0807 18:16:29.197529 (+ 131us) write_op.cc:270] St
I20260807 18:16:31.771534 13646 raft_consensus.cc:1050] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846: attempting to promote NON_VOTER 50da72adf57546f5bab0a028672a51dd to VOTER
W20260807 18:16:31.869833 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
I20260807 18:16:31.936041 13646 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1791, Committed index: 1791, Last appended: 1.1794, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 1795 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:31.941157 12674 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1793. Preceding OpId from leader: term: 1 index: 1795. (index mismatch)
W20260807 18:16:31.943081 11977 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:31.946741 13687 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1795, Last known committed idx: 1791, Time since last communication: 0.000s
I20260807 18:16:31.971964 11883 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1794. Preceding OpId from leader: term: 1 index: 1795. (index mismatch)
I20260807 18:16:31.974687 12246 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1794. Preceding OpId from leader: term: 1 index: 1795. (index mismatch)
I20260807 18:16:31.981164 13709 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1795, Last known committed idx: 1793, Time since last communication: 0.000s
I20260807 18:16:32.011085 13690 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1795, Last known committed idx: 1794, Time since last communication: 0.000s
I20260807 18:16:32.059660 13709 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1795: config changed from index 1244 to 1795, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1795 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:32.074945 12675 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1795: config changed from index 1244 to 1795, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1795 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:32.082520 11298 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1244 to 1795, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1795 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:32.140175 11883 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1795: config changed from index 1244 to 1795, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1795 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:32.188789 13258 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1793. Preceding OpId from leader: term: 1 index: 1795. (index mismatch)
I20260807 18:16:32.192860 13661 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1795, Last known committed idx: 1791, Time since last communication: 0.000s
I20260807 18:16:32.209404 13261 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Committing config change with OpId 1.1795: config changed from index 1244 to 1795, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1795 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:32.266209 12246 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1795: config changed from index 1244 to 1795, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1795 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:32.349941 12073 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1801, Committed index: 1801, Last appended: 1.1803, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:32.355057 13261 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1803. Preceding OpId from leader: term: 1 index: 1804. (index mismatch)
I20260807 18:16:32.356110 13712 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1804, Last known committed idx: 1801, Time since last communication: 0.000s
I20260807 18:16:32.369504 11883 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1803. Preceding OpId from leader: term: 1 index: 1804. (index mismatch)
I20260807 18:16:32.370395 13690 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1804, Last known committed idx: 1801, Time since last communication: 0.000s
I20260807 18:16:32.378038 12245 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1803. Preceding OpId from leader: term: 1 index: 1804. (index mismatch)
I20260807 18:16:32.379621 13690 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1804, Last known committed idx: 1801, Time since last communication: 0.000s
I20260807 18:16:32.381772 13690 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1804: config changed from index 1795 to 1804, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:32.387041 11883 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1804: config changed from index 1795 to 1804, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:32.395704 13261 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Committing config change with OpId 1.1804: config changed from index 1795 to 1804, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:32.401248 11293 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 reported cstate change: config changed from index 1795 to 1804, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:32.427179 11281 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 644a01df651c43d4a74ac241ea43068c with cas_config_opid_index 1795: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 18:16:32.433377 12675 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1803. Preceding OpId from leader: term: 1 index: 1804. (index mismatch)
I20260807 18:16:32.434809 12247 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1804: config changed from index 1795 to 1804, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
W20260807 18:16:32.464893 11285 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:32.493757 11285 catalog_manager.cc:4584] TS b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 644a01df651c43d4a74ac241ea43068c: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:32.548429 13691 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1804, Last known committed idx: 1803, Time since last communication: 0.000s
I20260807 18:16:32.583369 12674 raft_consensus.cc:2932] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1804: config changed from index 1795 to 1804, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
W20260807 18:16:32.644038 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20260807 18:16:32.718094 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260807 18:16:32.877970 13540 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Bootstrap replaying log segment 1/1 (328.9K/1.27M this segment, stats: ops{read=388 overwritten=0 applied=387 ignored=0} inserts{seen=6405 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
I20260807 18:16:33.124254 13667 consensus_queue.cc:786] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Peer 50da72adf57546f5bab0a028672a51dd is lagging by at least 71 ops behind the committed index [suppressed 3 similar messages]
W20260807 18:16:33.276074 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20260807 18:16:33.543439 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20260807 18:16:33.694468 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
W20260807 18:16:33.696964 11285 catalog_manager.cc:4584] TS b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 644a01df651c43d4a74ac241ea43068c: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:33.893092 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 50 similar messages]
W20260807 18:16:34.311692 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
I20260807 18:16:34.339695 13712 consensus_queue.cc:786] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Peer 50da72adf57546f5bab0a028672a51dd is lagging by at least 68 ops behind the committed index [suppressed 6 similar messages]
W20260807 18:16:34.533159 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20260807 18:16:34.692332 11975 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.70:40077, user_credentials={real_user=slave}} blocked reactor thread for 43765.2us
W20260807 18:16:34.809866 11285 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.253.66:43559, user_credentials={real_user=slave}} blocked reactor thread for 57909.8us
W20260807 18:16:34.811682 11285 catalog_manager.cc:4584] TS b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 644a01df651c43d4a74ac241ea43068c: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:35.210813 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
W20260807 18:16:35.690394 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20260807 18:16:36.022212 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20260807 18:16:36.362679 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.67:33793, user_credentials={real_user=slave}} blocked reactor thread for 47078.6us
W20260807 18:16:36.523739 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 26: this message will repeat every 5th retry.
I20260807 18:16:36.658089 13661 consensus_queue.cc:786] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Peer 50da72adf57546f5bab0a028672a51dd is lagging by at least 162 ops behind the committed index [suppressed 6 similar messages]
W20260807 18:16:36.734275 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.69:45839, user_credentials={real_user=slave}} blocked reactor thread for 47347.2us
W20260807 18:16:36.774456 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20260807 18:16:37.012590 11285 catalog_manager.cc:4584] TS b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 644a01df651c43d4a74ac241ea43068c: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:37.103997 12327 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.10.253.68:43889, user_credentials={real_user=slave}} blocked reactor thread for 50840.9us
W20260807 18:16:37.371493 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
I20260807 18:16:37.420753 13661 consensus_queue.cc:786] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Peer 50da72adf57546f5bab0a028672a51dd is lagging by at least 151 ops behind the committed index [suppressed 6 similar messages]
W20260807 18:16:37.613837 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
I20260807 18:16:37.880440 13540 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Bootstrap replaying log segment 1/1 (949.5K/1.27M this segment, stats: ops{read=1123 overwritten=0 applied=1121 ignored=0} inserts{seen=18404 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20260807 18:16:37.942406 11975 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.70:40077, user_credentials={real_user=slave}} blocked reactor thread for 49026.7us
W20260807 18:16:38.080206 11974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.253.67:33793, user_credentials={real_user=slave}} blocked reactor thread for 65349.7us
W20260807 18:16:38.145702 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
I20260807 18:16:38.232668 13630 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Bootstrap replaying log segment 1/1 (356.8K/1.41M this segment, stats: ops{read=419 overwritten=0 applied=417 ignored=0} inserts{seen=6956 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0)
W20260807 18:16:38.490244 13630 log.cc:924] Time spent T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Append to log took a long time: real 0.085s user 0.000s sys 0.000s
W20260807 18:16:38.935304 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 36 similar messages]
W20260807 18:16:38.936687 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20260807 18:16:38.962772 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 31: this message will repeat every 5th retry.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/maintenance_mode-itest.cc:479: Failure
Expected equality of these values:
kNumTablets
Which is: 3
mnt_tablet_ids.size()
Which is: 1
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_util.cc:395: Failure
Failed
Timed out waiting for assertion to pass.
I20260807 18:16:39.029819 11253 external_mini_cluster-itest-base.cc:80] Found fatal failure
I20260807 18:16:39.030082 11253 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 0 with UUID 50da72adf57546f5bab0a028672a51dd and pid 13042
W20260807 18:16:39.367056 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 26: this message will repeat every 5th retry.
W20260807 18:16:39.382200 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20260807 18:16:39.607759 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
I20260807 18:16:39.817119 13690 consensus_queue.cc:786] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Peer 50da72adf57546f5bab0a028672a51dd is lagging by at least 226 ops behind the committed index [suppressed 7 similar messages]
W20260807 18:16:39.990918 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20260807 18:16:40.187451 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 36: this message will repeat every 5th retry.
W20260807 18:16:40.375008 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 31: this message will repeat every 5th retry.
I20260807 18:16:40.428444 13799 consensus_queue.cc:786] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Peer 50da72adf57546f5bab0a028672a51dd is lagging by at least 197 ops behind the committed index [suppressed 9 similar messages]
W20260807 18:16:40.485846 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
I20260807 18:16:40.526841 13540 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1532 overwritten=0 applied=1531 ignored=0} inserts{seen=25305 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260807 18:16:40.527631 13540 tablet_bootstrap.cc:492] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Bootstrap complete.
I20260807 18:16:40.528669 13540 ts_tablet_manager.cc:1397] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Time spent bootstrapping tablet: real 19.515s user 4.610s sys 0.363s
I20260807 18:16:40.529927 13540 raft_consensus.cc:348] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 1260 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
I20260807 18:16:40.531737 13540 raft_consensus.cc:729] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Initialized, Role: LEARNER
I20260807 18:16:40.532217 13540 consensus_queue.cc:260] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1531, Last appended: 1.1532, Last appended by leader: 1532, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1260 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
************************ BEGIN STACKS **************************
I20260807 18:16:40.534080 13540 ts_tablet_manager.cc:1428] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:16:40.535563 12103 tablet_copy_service.cc:342] P 22052958d03d426ebdc2fc310637c846: Request end of tablet copy session 50da72adf57546f5bab0a028672a51dd-4c7eca40645d4ee29079ced64fa54d37 received from {username='slave'} at 127.10.253.65:40915
I20260807 18:16:40.535755 12103 tablet_copy_service.cc:433] P 22052958d03d426ebdc2fc310637c846: ending tablet copy session 50da72adf57546f5bab0a028672a51dd-4c7eca40645d4ee29079ced64fa54d37 on tablet 4c7eca40645d4ee29079ced64fa54d37 with peer 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:40.694615 13257 raft_consensus.cc:1203] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.728->[1.729-1.1743] Dedup: 1.1532->[1.1533-1.1743]
W20260807 18:16:40.733116 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
I20260807 18:16:40.947415 13799 raft_consensus.cc:1050] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846: attempting to promote NON_VOTER 50da72adf57546f5bab0a028672a51dd to VOTER
I20260807 18:16:40.950697 13799 logging.cc:424] LogThrottler TrackedPeer Lag: suppressed but not reported on 3 messages since previous log ~1 seconds ago
I20260807 18:16:40.951377 13799 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1969, Committed index: 1969, Last appended: 1.1969, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 1970 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:40.974028 13257 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1743. Preceding OpId from leader: term: 1 index: 1970. (index mismatch)
I20260807 18:16:40.975049 13800 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1970, Last known committed idx: 1743, Time since last communication: 0.000s
I20260807 18:16:40.980175 12675 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1969. Preceding OpId from leader: term: 1 index: 1970. (index mismatch)
I20260807 18:16:40.982913 11883 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1969. Preceding OpId from leader: term: 1 index: 1970. (index mismatch)
I20260807 18:16:40.984472 12246 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1969. Preceding OpId from leader: term: 1 index: 1970. (index mismatch)
I20260807 18:16:40.989449 13804 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1970, Last known committed idx: 1969, Time since last communication: 0.000s
I20260807 18:16:40.992053 13859 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1970, Last known committed idx: 1969, Time since last communication: 0.000s
I20260807 18:16:40.992688 13857 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1970, Last known committed idx: 1969, Time since last communication: 0.000s
I20260807 18:16:41.027776 13859 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1970: config changed from index 1260 to 1970, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1970 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
W20260807 18:16:41.035096 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:41.038784 11881 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1970: config changed from index 1260 to 1970, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1970 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:41.080209 12246 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1970: config changed from index 1260 to 1970, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1970 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:41.098733 11293 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 reported cstate change: config changed from index 1260 to 1970, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1970 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:41.107110 12675 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1970: config changed from index 1260 to 1970, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1970 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
W20260807 18:16:41.147511 11285 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 8 similar messages]
W20260807 18:16:41.170586 11285 catalog_manager.cc:4584] TS b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 644a01df651c43d4a74ac241ea43068c: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
I20260807 18:16:41.292779 13260 raft_consensus.cc:1203] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1743->[1.1744-1.1970] Dedup: 1.1969->[1.1970-1.1970]
I20260807 18:16:41.299646 13260 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Committing config change with OpId 1.1970: config changed from index 1260 to 1970, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1970 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:41.302345 12073 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1970, Committed index: 1970, Last appended: 1.1970, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:41.306236 12246 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1970. Preceding OpId from leader: term: 1 index: 1971. (index mismatch)
I20260807 18:16:41.306924 12675 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1970. Preceding OpId from leader: term: 1 index: 1971. (index mismatch)
I20260807 18:16:41.307590 11881 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1970. Preceding OpId from leader: term: 1 index: 1971. (index mismatch)
I20260807 18:16:41.308885 13661 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1971, Last known committed idx: 1970, Time since last communication: 0.000s
I20260807 18:16:41.309454 13661 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1971, Last known committed idx: 1970, Time since last communication: 0.000s
I20260807 18:16:41.313803 13661 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1971, Last known committed idx: 1970, Time since last communication: 0.000s
I20260807 18:16:41.316628 13690 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Committing config change with OpId 1.1971: config changed from index 1970 to 1971, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:41.319898 12246 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Committing config change with OpId 1.1971: config changed from index 1970 to 1971, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:41.323776 11881 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Committing config change with OpId 1.1971: config changed from index 1970 to 1971, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:41.326746 11281 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 4c7eca40645d4ee29079ced64fa54d37 with cas_config_opid_index 1970: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 18:16:41.328141 11297 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1970 to 1971, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New cstate: current_term: 1 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:41.328533 12675 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Committing config change with OpId 1.1971: config changed from index 1970 to 1971, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:41.392472 13261 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 1 index: 1970. Preceding OpId from leader: term: 1 index: 1971. (index mismatch)
I20260807 18:16:41.393462 13661 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1971, Last known committed idx: 1970, Time since last communication: 0.000s
I20260807 18:16:41.395318 13261 raft_consensus.cc:2932] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Committing config change with OpId 1.1971: config changed from index 1970 to 1971, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
W20260807 18:16:41.438565 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 36: this message will repeat every 5th retry.
W20260807 18:16:41.580940 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
[New LWP 13078]
[New LWP 13079]
[New LWP 13080]
[New LWP 13084]
[New LWP 13091]
[New LWP 13092]
[New LWP 13095]
[New LWP 13107]
[New LWP 13108]
[New LWP 13109]
[New LWP 13118]
[New LWP 13120]
[New LWP 13121]
[New LWP 13126]
[New LWP 13129]
[New LWP 13130]
[New LWP 13134]
[New LWP 13135]
[New LWP 13136]
[New LWP 13137]
[New LWP 13138]
[New LWP 13139]
[New LWP 13142]
[New LWP 13143]
[New LWP 13144]
[New LWP 13149]
[New LWP 13150]
[New LWP 13151]
[New LWP 13154]
[New LWP 13155]
[New LWP 13157]
[New LWP 13158]
[New LWP 13159]
[New LWP 13160]
[New LWP 13161]
[New LWP 13163]
[New LWP 13168]
[New LWP 13170]
[New LWP 13172]
[New LWP 13174]
[New LWP 13175]
[New LWP 13183]
[New LWP 13184]
[New LWP 13187]
[New LWP 13188]
[New LWP 13191]
[New LWP 13194]
[New LWP 13195]
[New LWP 13196]
[New LWP 13210]
[New LWP 13213]
[New LWP 13215]
[New LWP 13217]
[New LWP 13219]
[New LWP 13221]
[New LWP 13222]
[New LWP 13223]
[New LWP 13225]
[New LWP 13228]
[New LWP 13231]
[New LWP 13232]
[New LWP 13235]
[New LWP 13237]
[New LWP 13239]
[New LWP 13241]
[New LWP 13242]
[New LWP 13244]
[New LWP 13247]
[New LWP 13248]
[New LWP 13253]
[New LWP 13255]
[New LWP 13257]
[New LWP 13258]
[New LWP 13260]
[New LWP 13261]
[New LWP 13264]
[New LWP 13266]
[New LWP 13267]
[New LWP 13269]
[New LWP 13270]
[New LWP 13274]
[New LWP 13275]
[New LWP 13277]
[New LWP 13283]
[New LWP 13285]
[New LWP 13286]
[New LWP 13287]
[New LWP 13288]
[New LWP 13289]
[New LWP 13290]
[New LWP 13291]
[New LWP 13293]
[New LWP 13295]
[New LWP 13297]
[New LWP 13300]
[New LWP 13302]
[New LWP 13304]
[New LWP 13305]
[New LWP 13306]
[New LWP 13308]
[New LWP 13309]
[New LWP 13310]
[New LWP 13311]
[New LWP 13312]
[New LWP 13313]
[New LWP 13317]
[New LWP 13318]
[New LWP 13319]
[New LWP 13320]
[New LWP 13328]
[New LWP 13338]
[New LWP 13341]
[New LWP 13343]
[New LWP 13344]
[New LWP 13345]
[New LWP 13352]
[New LWP 13353]
[New LWP 13354]
[New LWP 13357]
[New LWP 13358]
[New LWP 13374]
[New LWP 13630]
[New LWP 13632]
[New LWP 13842]
[New LWP 13847]
[New LWP 13848]
[New LWP 13850]
[New LWP 13853]
[New LWP 13856]
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
0x00007fa5f96bbd50 in ?? ()
Id Target Id Frame
* 1 LWP 13042 "kudu" 0x00007fa5f96bbd50 in ?? ()
2 LWP 13078 "kudu" 0x00007fa5f96b7fb9 in ?? ()
3 LWP 13079 "kudu" 0x00007fa5f96b7fb9 in ?? ()
4 LWP 13080 "kudu" 0x00007fa5f96b7fb9 in ?? ()
5 LWP 13084 "kernel-watcher-" 0x00007fa5f96b7fb9 in ?? ()
6 LWP 13091 "ntp client-1309" 0x00007fa5f96bb9e2 in ?? ()
7 LWP 13092 "file cache-evic" 0x00007fa5f96b7fb9 in ?? ()
8 LWP 13095 "sq_acceptor" 0x00007fa5f263abb9 in ?? ()
9 LWP 13107 "rpc reactor-131" 0x00007fa5f2647947 in ?? ()
10 LWP 13108 "rpc reactor-131" 0x00007fa5f2647947 in ?? ()
11 LWP 13109 "rpc reactor-131" 0x00007fa5f2647947 in ?? ()
12 LWP 13118 "rpc reactor-131" 0x00007fa5f2647947 in ?? ()
13 LWP 13120 "MaintenanceMgr " 0x00007fa5f96b7ad3 in ?? ()
14 LWP 13121 "txn-status-mana" 0x00007fa5f96b7fb9 in ?? ()
15 LWP 13126 "collect_and_rem" 0x00007fa5f96b7fb9 in ?? ()
16 LWP 13129 "tc-session-exp-" 0x00007fa5f96b7fb9 in ?? ()
17 LWP 13130 "rpc worker-1313" 0x00007fa5f96b7ad3 in ?? ()
18 LWP 13134 "rpc worker-1313" 0x00007fa5f96b7ad3 in ?? ()
19 LWP 13135 "rpc worker-1313" 0x00007fa5f96b7ad3 in ?? ()
20 LWP 13136 "rpc worker-1313" 0x00007fa5f96b7ad3 in ?? ()
21 LWP 13137 "rpc worker-1313" 0x00007fa5f96b7ad3 in ?? ()
22 LWP 13138 "rpc worker-1313" 0x00007fa5f96b7ad3 in ?? ()
23 LWP 13139 "rpc worker-1313" 0x00007fa5f96b7ad3 in ?? ()
24 LWP 13142 "rpc worker-1314" 0x00007fa5f96b7ad3 in ?? ()
25 LWP 13143 "rpc worker-1314" 0x00007fa5f96b7ad3 in ?? ()
26 LWP 13144 "rpc worker-1314" 0x00007fa5f96b7ad3 in ?? ()
27 LWP 13149 "rpc worker-1314" 0x00007fa5f96b7ad3 in ?? ()
28 LWP 13150 "rpc worker-1315" 0x00007fa5f96b7ad3 in ?? ()
29 LWP 13151 "rpc worker-1315" 0x00007fa5f96b7ad3 in ?? ()
30 LWP 13154 "rpc worker-1315" 0x00007fa5f96b7ad3 in ?? ()
31 LWP 13155 "rpc worker-1315" 0x00007fa5f96b7ad3 in ?? ()
32 LWP 13157 "rpc worker-1315" 0x00007fa5f96b7ad3 in ?? ()
33 LWP 13158 "rpc worker-1315" 0x00007fa5f96b7ad3 in ?? ()
34 LWP 13159 "rpc worker-1315" 0x00007fa5f96b7ad3 in ?? ()
35 LWP 13160 "rpc worker-1316" 0x00007fa5f96b7ad3 in ?? ()
36 LWP 13161 "rpc worker-1316" 0x00007fa5f96b7ad3 in ?? ()
37 LWP 13163 "rpc worker-1316" 0x00007fa5f96b7ad3 in ?? ()
38 LWP 13168 "rpc worker-1316" 0x00007fa5f96b7ad3 in ?? ()
39 LWP 13170 "rpc worker-1317" 0x00007fa5f96b7ad3 in ?? ()
40 LWP 13172 "rpc worker-1317" 0x00007fa5f96b7ad3 in ?? ()
41 LWP 13174 "rpc worker-1317" 0x00007fa5f96b7ad3 in ?? ()
42 LWP 13175 "rpc worker-1317" 0x00007fa5f96b7ad3 in ?? ()
43 LWP 13183 "rpc worker-1318" 0x00007fa5f96b7ad3 in ?? ()
44 LWP 13184 "rpc worker-1318" 0x00007fa5f96b7ad3 in ?? ()
45 LWP 13187 "rpc worker-1318" 0x00007fa5f96b7ad3 in ?? ()
46 LWP 13188 "rpc worker-1318" 0x00007fa5f96b7ad3 in ?? ()
47 LWP 13191 "rpc worker-1319" 0x00007fa5f96b7ad3 in ?? ()
48 LWP 13194 "rpc worker-1319" 0x00007fa5f96b7ad3 in ?? ()
49 LWP 13195 "rpc worker-1319" 0x00007fa5f96b7ad3 in ?? ()
50 LWP 13196 "rpc worker-1319" 0x00007fa5f96b7ad3 in ?? ()
51 LWP 13210 "rpc worker-1321" 0x00007fa5f96b7ad3 in ?? ()
52 LWP 13213 "rpc worker-1321" 0x00007fa5f96b7ad3 in ?? ()
53 LWP 13215 "rpc worker-1321" 0x00007fa5f96b7ad3 in ?? ()
54 LWP 13217 "rpc worker-1321" 0x00007fa5f96b7ad3 in ?? ()
55 LWP 13219 "rpc worker-1321" 0x00007fa5f96b7ad3 in ?? ()
56 LWP 13221 "rpc worker-1322" 0x00007fa5f96b7ad3 in ?? ()
57 LWP 13222 "rpc worker-1322" 0x00007fa5f96b7ad3 in ?? ()
58 LWP 13223 "rpc worker-1322" 0x00007fa5f96b7ad3 in ?? ()
59 LWP 13225 "rpc worker-1322" 0x00007fa5f96b7ad3 in ?? ()
60 LWP 13228 "rpc worker-1322" 0x00007fa5f96b7ad3 in ?? ()
61 LWP 13231 "rpc worker-1323" 0x00007fa5f96b7ad3 in ?? ()
62 LWP 13232 "rpc worker-1323" 0x00007fa5f96b7ad3 in ?? ()
63 LWP 13235 "rpc worker-1323" 0x00007fa5f96b7ad3 in ?? ()
64 LWP 13237 "rpc worker-1323" 0x00007fa5f96b7ad3 in ?? ()
65 LWP 13239 "rpc worker-1323" 0x00007fa5f96b7ad3 in ?? ()
66 LWP 13241 "rpc worker-1324" 0x00007fa5f96b7ad3 in ?? ()
67 LWP 13242 "rpc worker-1324" 0x00007fa5f96b7ad3 in ?? ()
68 LWP 13244 "rpc worker-1324" 0x00007fa5f96b7ad3 in ?? ()
69 LWP 13247 "rpc worker-1324" 0x00007fa5f96b7ad3 in ?? ()
70 LWP 13248 "rpc worker-1324" 0x00007fa5f96b7ad3 in ?? ()
71 LWP 13253 "rpc worker-1325" 0x00007fa5f96b7ad3 in ?? ()
72 LWP 13255 "rpc worker-1325" 0x00007fa5f96b7ad3 in ?? ()
73 LWP 13257 "rpc worker-1325" 0x00007fa5f96b7ad3 in ?? ()
74 LWP 13258 "rpc worker-1325" 0x00007fa5f96b7ad3 in ?? ()
75 LWP 13260 "rpc worker-1326" 0x00007fa5f96b7ad3 in ?? ()
76 LWP 13261 "rpc worker-1326" 0x00007fa5f96b7ad3 in ?? ()
77 LWP 13264 "rpc worker-1326" 0x00007fa5f96b7ad3 in ?? ()
78 LWP 13266 "rpc worker-1326" 0x00007fa5f96b7ad3 in ?? ()
79 LWP 13267 "rpc worker-1326" 0x00007fa5f96b7ad3 in ?? ()
80 LWP 13269 "rpc worker-1326" 0x00007fa5f96b7ad3 in ?? ()
81 LWP 13270 "rpc worker-1327" 0x00007fa5f96b7ad3 in ?? ()
82 LWP 13274 "rpc worker-1327" 0x00007fa5f96b7ad3 in ?? ()
83 LWP 13275 "rpc worker-1327" 0x00007fa5f96b7ad3 in ?? ()
84 LWP 13277 "rpc worker-1327" 0x00007fa5f96b7ad3 in ?? ()
85 LWP 13283 "rpc worker-1328" 0x00007fa5f96b7ad3 in ?? ()
86 LWP 13285 "rpc worker-1328" 0x00007fa5f96b7ad3 in ?? ()
87 LWP 13286 "rpc worker-1328" 0x00007fa5f96b7ad3 in ?? ()
88 LWP 13287 "rpc worker-1328" 0x00007fa5f96b7ad3 in ?? ()
89 LWP 13288 "rpc worker-1328" 0x00007fa5f96b7ad3 in ?? ()
90 LWP 13289 "rpc worker-1328" 0x00007fa5f96b7ad3 in ?? ()
91 LWP 13290 "rpc worker-1329" 0x00007fa5f96b7ad3 in ?? ()
92 LWP 13291 "rpc worker-1329" 0x00007fa5f96b7ad3 in ?? ()
93 LWP 13293 "rpc worker-1329" 0x00007fa5f96b7ad3 in ?? ()
94 LWP 13295 "rpc worker-1329" 0x00007fa5f96b7ad3 in ?? ()
95 LWP 13297 "rpc worker-1329" 0x00007fa5f96b7ad3 in ?? ()
96 LWP 13300 "rpc worker-1330" 0x00007fa5f96b7ad3 in ?? ()
97 LWP 13302 "rpc worker-1330" 0x00007fa5f96b7ad3 in ?? ()
98 LWP 13304 "rpc worker-1330" 0x00007fa5f96b7ad3 in ?? ()
99 LWP 13305 "rpc worker-1330" 0x00007fa5f96b7ad3 in ?? ()
100 LWP 13306 "rpc worker-1330" 0x00007fa5f96b7ad3 in ?? ()
101 LWP 13308 "rpc worker-1330" 0x00007fa5f96b7ad3 in ?? ()
102 LWP 13309 "rpc worker-1330" 0x00007fa5f96b7ad3 in ?? ()
103 LWP 13310 "rpc worker-1331" 0x00007fa5f96b7ad3 in ?? ()
104 LWP 13311 "rpc worker-1331" 0x00007fa5f96b7ad3 in ?? ()
105 LWP 13312 "rpc worker-1331" 0x00007fa5f96b7ad3 in ?? ()
106 LWP 13313 "rpc worker-1331" 0x00007fa5f96b7ad3 in ?? ()
107 LWP 13317 "rpc worker-1331" 0x00007fa5f96b7ad3 in ?? ()
108 LWP 13318 "rpc worker-1331" 0x00007fa5f96b7ad3 in ?? ()
109 LWP 13319 "rpc worker-1331" 0x00007fa5f96b7ad3 in ?? ()
110 LWP 13320 "rpc worker-1332" 0x00007fa5f96b7ad3 in ?? ()
111 LWP 13328 "rpc worker-1332" 0x00007fa5f96b7ad3 in ?? ()
112 LWP 13338 "rpc worker-1333" 0x00007fa5f96b7ad3 in ?? ()
113 LWP 13341 "rpc worker-1334" 0x00007fa5f96b7ad3 in ?? ()
114 LWP 13343 "rpc worker-1334" 0x00007fa5f96b7ad3 in ?? ()
115 LWP 13344 "rpc worker-1334" 0x00007fa5f96b7ad3 in ?? ()
116 LWP 13345 "rpc worker-1334" 0x00007fa5f96b7ad3 in ?? ()
117 LWP 13352 "diag-logger-133" 0x00007fa5f96b7fb9 in ?? ()
118 LWP 13353 "result-tracker-" 0x00007fa5f96b7fb9 in ?? ()
119 LWP 13354 "excess-log-dele" 0x00007fa5f96b7fb9 in ?? ()
120 LWP 13357 "acceptor-13357" 0x00007fa5f2648fc7 in ?? ()
121 LWP 13358 "heartbeat-13358" 0x00007fa5f96b7fb9 in ?? ()
122 LWP 13374 "maintenance_sch" 0x00007fa5f96b7fb9 in ?? ()
123 LWP 13630 "tablet-copy [wo" 0x00007fa5f54b7210 in ?? ()
124 LWP 13632 "tablet-download" 0x00007fa5f96b7ad3 in ?? ()
125 LWP 13842 "prepare [worker" 0x00007fa5f96b7fb9 in ?? ()
126 LWP 13847 "apply [worker]-" 0x00007fa5f96b7fb9 in ?? ()
127 LWP 13848 "wal-append [wor" 0x00007fa5f96b7fb9 in ?? ()
128 LWP 13850 "apply [worker]-" 0x00007fa5f96b7fb9 in ?? ()
129 LWP 13853 "apply [worker]-" 0x00007fa5f96b7fb9 in ?? ()
130 LWP 13856 "apply [worker]-" 0x00007fa5f96b7fb9 in ?? ()
Thread 130 (LWP 13856):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000011 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x00007fa5a6e1bba4 in ?? ()
#5 0x00007fa5a6e1b830 in ?? ()
#6 0x0000000000000023 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fa5a6e1b850 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 129 (LWP 13853):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000025 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x00007fa5a9e7dba4 in ?? ()
#5 0x00007fa5a9e7d830 in ?? ()
#6 0x000000000000004b in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fa5a9e7d850 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 128 (LWP 13850):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000014 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007fa5ab737ba0 in ?? ()
#5 0x00007fa5ab737830 in ?? ()
#6 0x0000000000000028 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 127 (LWP 13848):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 126 (LWP 13847):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000022 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007fa5a967cba0 in ?? ()
#5 0x00007fa5a967c830 in ?? ()
#6 0x0000000000000044 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 125 (LWP 13842):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000020 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007fa5a8e7bba0 in ?? ()
#5 0x00007fa5a8e7b830 in ?? ()
#6 0x0000000000000040 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 124 (LWP 13632):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x00007fa5b29acba4 in ?? ()
#4 0x00007fa5b29ac8b0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa5b29ac8d0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000061600097fea8 in ?? ()
#9 0x00007fa5f96b7770 in ?? ()
#10 0x00007fa5b29ac8d0 in ?? ()
#11 0x00007fa5b29ac8d0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 123 (LWP 13630):
#0 0x00007fa5f54b7210 in ?? ()
#1 0x00007fa5f54b82a7 in ?? ()
#2 0x0000000041b58ab3 in ?? ()
#3 0x00007fa5f53936ea in ?? ()
#4 0x00007fa5f54b8010 in ?? ()
#5 0x00007fa602b37414 in ?? ()
#6 0x00007fa5abf31ea0 in ?? ()
#7 0x00007fa5abf31ef0 in ?? ()
#8 0x00007fa5f53fc280 in ?? ()
#9 0x00007fa5f53fc280 in ?? ()
#10 0x00007fa5f53fc280 in ?? ()
#11 0x00007fa5f53fc280 in ?? ()
#12 0x00007fa5f53fc280 in ?? ()
#13 0x00007fa5f53fc280 in ?? ()
#14 0x00007fa5f53fc280 in ?? ()
#15 0x00007fa5f53fc280 in ?? ()
#16 0x0000000000000000 in ?? ()
Thread 122 (LWP 13374):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 121 (LWP 13358):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0xffffffffffffffff in ?? ()
#2 0x0000000000000022 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x0000613000017d2c in ?? ()
#5 0x00007fa5ac747770 in ?? ()
#6 0x0000000000000045 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fa5ac747790 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007fa5ac747810 in ?? ()
#12 0x00000ff4b58e8f04 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 13357):
#0 0x00007fa5f2648fc7 in ?? ()
#1 0x0000614000009a90 in ?? ()
#2 0x00007fa5acf6dfa0 in ?? ()
#3 0x00007fa5acf6dfc0 in ?? ()
#4 0x00007fa5acf6e0e0 in ?? ()
#5 0x00007fa5acf6dfd0 in ?? ()
#6 0x00007fa5acf6e040 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x000000000082c9d2 in __sanitizer::theDepot ()
#9 0x00000000008c3cc9 in __sanitizer::theDepot ()
#10 0x00000000008f35b0 in __sanitizer::theDepot ()
#11 0x0000000000000032 in ?? ()
#12 0x000060c0000802d8 in ?? ()
#13 0x000060c000080334 in ?? ()
#14 0x00000000008875e1 in __sanitizer::theDepot ()
#15 0x000000000000005c in ?? ()
#16 0x000000000088348c in __sanitizer::theDepot ()
#17 0x0000000000000380 in ?? ()
#18 0x0000000000897749 in __sanitizer::theDepot ()
#19 0x0000000000010000 in ?? ()
#20 0x0000000000895799 in __sanitizer::theDepot ()
#21 0x0000000000e377a0 in ?? ()
#22 0x00000000007f9413 in __sanitizer::theDepot ()
#23 0x00000000009edb7d in __sanitizer::theDepot ()
#24 0x0000000000000700 in ?? ()
#25 0x00007fa5f96b16db in ?? ()
#26 0x00007fa5f25f9346 in ?? ()
#27 0x00007fa5acf6d842 in ?? ()
#28 0x000000006a7620e7 in ?? ()
#29 0x000000006a7620e7 in ?? ()
#30 0x0000640000001140 in ?? ()
#31 0x00007fa5ac767e60 in ?? ()
#32 0x0000000000000049 in ?? ()
#33 0x0000017000000000 in ?? ()
#34 0x0000000000000017 in ?? ()
#35 0x0000640000001140 in ?? ()
#36 0x00000000008b1acd in __sanitizer::theDepot ()
#37 0x0000000000e377a0 in ?? ()
#38 0x00007fa5ac74b198 in ?? ()
#39 0x0000000000000000 in ?? ()
Thread 119 (LWP 13354):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x00007ffc6b9bfa50 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 13353):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x00007fa5adf9d160 in ?? ()
#2 0x0000000000000021 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100006ec30 in ?? ()
#5 0x00007fa5adf9d110 in ?? ()
#6 0x0000000000000042 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 13352):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 13345):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 13344):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 13343):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 13341):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 13338):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 13328):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 13320):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 13319):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 13318):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 13317):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 13313):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 13312):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 13311):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 13310):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 13309):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 13308):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 13306):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 13305):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 13304):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 13302):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 13300):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 13297):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 13295):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 13293):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 13291):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 13290):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 13289):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 13288):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 13287):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 13286):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 13285):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 13283):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 13277):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 13275):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 13274):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 13270):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 13269):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 13267):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 13266):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 13264):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 13261):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000079 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002567dc in ?? ()
#4 0x00007fa5c6573eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa5c6573ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000256790 in ?? ()
#9 0x00007fa5f96b7770 in ?? ()
#10 0x00007fa5c6573ed0 in ?? ()
#11 0x00007fa5c6573fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 13260):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x000000000000005b in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00024ffdc in ?? ()
#4 0x00007fa5c6d8beb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa5c6d8bed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00024ff90 in ?? ()
#9 0x00007fa5f96b7770 in ?? ()
#10 0x00007fa5c6d8bed0 in ?? ()
#11 0x00007fa5c6d8bfa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 13258):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x000000000000002f in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0002467ec in ?? ()
#4 0x00007fa5c75a3eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa5c75a3ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0002467a0 in ?? ()
#9 0x00007fa5f96b7770 in ?? ()
#10 0x00007fa5c75a3ed0 in ?? ()
#11 0x00007fa5c75a3fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 73 (LWP 13257):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000083 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00023cffc in ?? ()
#4 0x00007fa5c7dbbeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa5c7dbbed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00023cfb0 in ?? ()
#9 0x00007fa5f96b7770 in ?? ()
#10 0x00007fa5c7dbbed0 in ?? ()
#11 0x00007fa5c7dbbfa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 72 (LWP 13255):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 13253):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 13248):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 13247):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 13244):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 13242):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 13241):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 13239):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 13237):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 13235):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 13232):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 13231):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 13228):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 13225):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 13223):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 13222):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 13221):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001b007c in ?? ()
#4 0x00007fa5d07a5eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa5d07a5ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001b0030 in ?? ()
#9 0x00007fa5f96b7770 in ?? ()
#10 0x00007fa5d07a5ed0 in ?? ()
#11 0x00007fa5d07a5fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 13219):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 13217):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 13215):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 13213):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 13210):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 13196):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 13195):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 13194):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 13191):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 13188):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 13187):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 13184):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 13183):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 13175):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 13174):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 13172):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 13170):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 13168):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 13163):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 13161):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x000000000000001f in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000b67dc in ?? ()
#4 0x00007fa5da16eeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa5da16eed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000b6790 in ?? ()
#9 0x00007fa5f96b7770 in ?? ()
#10 0x00007fa5da16eed0 in ?? ()
#11 0x00007fa5da16efa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 13160):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 34 (LWP 13159):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 13158):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 13157):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 13155):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 13154):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 13151):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 13150):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 13149):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 13144):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 13143):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 13142):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 13139):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 13138):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 13137):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 13136):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 13135):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 13134):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 13130):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 13129):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x00000000ffffffff in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006130000193e0 in ?? ()
#5 0x00007fa5e43dcd30 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 13126):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000007 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a618 in ?? ()
#5 0x00007fa5e4bde270 in ?? ()
#6 0x000000000000000e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 13121):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000618000004da8 in ?? ()
#5 0x00007fa5e5bdf250 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 13120):
#0 0x00007fa5f96b7ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 13118):
#0 0x00007fa5f2647947 in ?? ()
#1 0x0000614000009a80 in ?? ()
#2 0x0000619000059680 in ?? ()
#3 0x00007fa5e6be2340 in ?? ()
#4 0x00007fa5e6be2540 in ?? ()
#5 0x00007fa5e6be2390 in ?? ()
#6 0x0000614000009a80 in ?? ()
#7 0x00007fa5e6be2400 in ?? ()
#8 0x00007fa5f4c4ebda in ?? ()
#9 0x3fa5ba3fec000000 in ?? ()
#10 0x0000619000059680 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059680 in ?? ()
#13 0x425487445bb00000 in ?? ()
#14 0x00007fa5e6be2540 in ?? ()
#15 0x41da97978d7b0aa3 in ?? ()
#16 0x000000003cd74480 in ?? ()
#17 0x00007fa5e6be23e0 in ?? ()
#18 0x00007fa5f4c52228 in ?? ()
#19 0x00000000e6be23c0 in ?? ()
#20 0x0000619000059680 in ?? ()
#21 0x0000614000009a80 in ?? ()
#22 0x00007fa5e6be2400 in ?? ()
#23 0x3fa5ba3fec000000 in ?? ()
#24 0x4137c2d4019a751d in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 13109):
#0 0x00007fa5f2647947 in ?? ()
#1 0x0000614000009880 in ?? ()
#2 0x0000619000059180 in ?? ()
#3 0x00007fa5e73e3340 in ?? ()
#4 0x00007fa5e73e3540 in ?? ()
#5 0x00007fa5e73e3390 in ?? ()
#6 0x0000614000009880 in ?? ()
#7 0x00007fa5e73e3400 in ?? ()
#8 0x00007fa5f4c4ebda in ?? ()
#9 0x3f9ec2df00000000 in ?? ()
#10 0x0000619000059180 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059180 in ?? ()
#13 0x4209eab654000000 in ?? ()
#14 0x00007fa5e73e3540 in ?? ()
#15 0x41da97978d7b0a9e in ?? ()
#16 0x000000003ce74680 in ?? ()
#17 0x00007fa5e73e33e0 in ?? ()
#18 0x00007fa5f4c52228 in ?? ()
#19 0x00000000e73e33c0 in ?? ()
#20 0x0000619000059180 in ?? ()
#21 0x0000614000009880 in ?? ()
#22 0x00007fa5e73e3400 in ?? ()
#23 0x3f9ec2df00000000 in ?? ()
#24 0x4137c2d3fbedbaa1 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 13108):
#0 0x00007fa5f2647947 in ?? ()
#1 0x0000614000009680 in ?? ()
#2 0x0000619000058c80 in ?? ()
#3 0x00007fa5e7be4340 in ?? ()
#4 0x00007fa5e7be4540 in ?? ()
#5 0x00007fa5e7be4390 in ?? ()
#6 0x0000614000009680 in ?? ()
#7 0x00007fa5e7be4400 in ?? ()
#8 0x00007fa5f4c4ebda in ?? ()
#9 0x3fb95bc3b8000000 in ?? ()
#10 0x0000619000058c80 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058c80 in ?? ()
#13 0x422542247a000000 in ?? ()
#14 0x00007fa5e7be4540 in ?? ()
#15 0x41da97978d7b0a9d in ?? ()
#16 0x000000003cf74880 in ?? ()
#17 0x00007fa5e7be43e0 in ?? ()
#18 0x00007fa5f4c52228 in ?? ()
#19 0x00000000e7be43c0 in ?? ()
#20 0x0000619000058c80 in ?? ()
#21 0x0000614000009680 in ?? ()
#22 0x00007fa5e7be4400 in ?? ()
#23 0x3fb95bc3b8000000 in ?? ()
#24 0x4137c2d400a9eab1 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 13107):
#0 0x00007fa5f2647947 in ?? ()
#1 0x0000614000009480 in ?? ()
#2 0x0000619000058780 in ?? ()
#3 0x00007fa5e91ad340 in ?? ()
#4 0x00007fa5e91ad540 in ?? ()
#5 0x00007fa5e91ad390 in ?? ()
#6 0x0000614000009480 in ?? ()
#7 0x00007fa5e91ad400 in ?? ()
#8 0x00007fa5f4c4ebda in ?? ()
#9 0x3fb95bdbfb000000 in ?? ()
#10 0x0000619000058780 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058780 in ?? ()
#13 0x422364d418000000 in ?? ()
#14 0x00007fa5e91ad540 in ?? ()
#15 0x41da97978d7b0aa1 in ?? ()
#16 0x000000003d22da80 in ?? ()
#17 0x00007fa5e91ad3e0 in ?? ()
#18 0x00007fa5f4c52228 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 13095):
#0 0x00007fa5f263abb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fa5eabb77d8 in ?? ()
#3 0x000060200004d5f0 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x0000000000823a92 in __sanitizer::theDepot ()
#7 0x00007fa5eabb7800 in ?? ()
#8 0x0000000000000000 in ?? ()
Thread 7 (LWP 13092):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x00007fa5ea3b6140 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 13091):
#0 0x00007fa5f96bb9e2 in ?? ()
#1 0x00007fa5e9bb4430 in ?? ()
#2 0x00007fa5e9bb3f20 in ?? ()
#3 0x00007fa5e9bb3650 in ?? ()
#4 0x00007fa5e9bb51c0 in ?? ()
#5 0x00007fa5e9bb3ed0 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x00007fa5e9bb3f30 in ?? ()
#8 0x000061100005a2d0 in ?? ()
#9 0x00007fa5e9bb3f20 in ?? ()
#10 0x000000000081de90 in __sanitizer::theDepot ()
#11 0x00007fa5fee7f269 in ?? ()
#12 0x00000000009edb7d in __sanitizer::theDepot ()
#13 0x00007fa5f63d7eaf in ?? ()
#14 0x00007fa5f96b16db in ?? ()
#15 0x00007fa5e9bb36b0 in ?? ()
#16 0x00007fa5fee8de61 in ?? ()
#17 0x00007fa5e9bb3770 in ?? ()
#18 0x0000000000000003 in ?? ()
#19 0x0000000000000003 in ?? ()
#20 0x00000c2000001c59 in ?? ()
#21 0x000061100005a2e0 in ?? ()
#22 0x000060d0005c68a8 in ?? ()
#23 0x0000000000000080 in ?? ()
#24 0x000061000000e240 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 5 (LWP 13084):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x676f6f67364e5a5f in ?? ()
#2 0x00000000000000b4 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001ab28 in ?? ()
#5 0x00007fa5ebbb8cd0 in ?? ()
#6 0x0000000000000168 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 13080):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 13079):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 13078):
#0 0x00007fa5f96b7fb9 in ?? ()
#1 0x0000000000008000 in ?? ()
#2 0x0000000000000003 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000009838 in ?? ()
#5 0x00007fa5ed3bc450 in ?? ()
#6 0x0000000000000006 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 13042):
#0 0x00007fa5f96bbd50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20260807 18:16:42.089564 11253 external_mini_cluster-itest-base.cc:83] Tablet server 1 is not running. Cannot dump its stacks.
I20260807 18:16:42.089732 11253 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 2 with UUID 6a9cdd541bff40f98b3a280123bcc1a9 and pid 11768
W20260807 18:16:42.162696 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20260807 18:16:42.234589 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 41: this message will repeat every 5th retry.
W20260807 18:16:42.528376 11285 catalog_manager.cc:4584] TS b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4c7eca40645d4ee29079ced64fa54d37: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
************************ BEGIN STACKS **************************
W20260807 18:16:42.640255 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20260807 18:16:43.061710 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 46: this message will repeat every 5th retry.
I20260807 18:16:43.110075 13630 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1695 overwritten=0 applied=1695 ignored=0} inserts{seen=28210 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:16:43.110678 13630 tablet_bootstrap.cc:492] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Bootstrap complete.
I20260807 18:16:43.111372 13630 ts_tablet_manager.cc:1397] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Time spent bootstrapping tablet: real 15.712s user 4.818s sys 0.331s
I20260807 18:16:43.112249 13630 raft_consensus.cc:348] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 1156 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
I20260807 18:16:43.112591 13630 raft_consensus.cc:729] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Initialized, Role: LEARNER
I20260807 18:16:43.112830 13630 consensus_queue.cc:260] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1695, Last appended: 2.1695, Last appended by leader: 1695, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1156 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: NON_VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: true } }
I20260807 18:16:43.113826 13630 ts_tablet_manager.cc:1428] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 18:16:43.114835 12103 tablet_copy_service.cc:342] P 22052958d03d426ebdc2fc310637c846: Request end of tablet copy session 50da72adf57546f5bab0a028672a51dd-874ba119c7284c4d8a113d6654e0c39e received from {username='slave'} at 127.10.253.65:40915
I20260807 18:16:43.115016 12103 tablet_copy_service.cc:433] P 22052958d03d426ebdc2fc310637c846: ending tablet copy session 50da72adf57546f5bab0a028672a51dd-874ba119c7284c4d8a113d6654e0c39e on tablet 874ba119c7284c4d8a113d6654e0c39e with peer 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:43.175143 13257 raft_consensus.cc:1203] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 LEARNER]: Deduplicated request from leader. Original: 2.750->[2.751-2.1770] Dedup: 2.1695->[2.1696-2.1770]
I20260807 18:16:43.223239 13902 raft_consensus.cc:1050] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846: attempting to promote NON_VOTER 50da72adf57546f5bab0a028672a51dd to VOTER
I20260807 18:16:43.231448 13902 logging.cc:424] LogThrottler TrackedPeer Lag: suppressed but not reported on 15 messages since previous log ~2 seconds ago
I20260807 18:16:43.232206 13902 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1967, Committed index: 1967, Last appended: 2.1967, Last appended by leader: 0, Current term: 2, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 1968 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:43.249773 12245 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1967. Preceding OpId from leader: term: 2 index: 1968. (index mismatch)
I20260807 18:16:43.250623 11881 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1967. Preceding OpId from leader: term: 2 index: 1968. (index mismatch)
I20260807 18:16:43.251937 13893 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1968, Last known committed idx: 1967, Time since last communication: 0.000s
I20260807 18:16:43.252305 13661 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1968, Last known committed idx: 1967, Time since last communication: 0.000s
W20260807 18:16:43.252750 11977 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 -> Peer b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): Couldn't send request to peer b5bb27271da74b1a909d982e6fb2d470. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:43.253794 13257 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 LEARNER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1770. Preceding OpId from leader: term: 2 index: 1968. (index mismatch)
I20260807 18:16:43.258070 13893 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1968, Last known committed idx: 1770, Time since last communication: 0.000s
I20260807 18:16:43.291003 12675 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1967. Preceding OpId from leader: term: 2 index: 1968. (index mismatch)
I20260807 18:16:43.293002 13893 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1968, Last known committed idx: 1967, Time since last communication: 0.000s
I20260807 18:16:43.306252 13871 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 LEADER]: Committing config change with OpId 2.1968: config changed from index 1156 to 1968, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1968 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:43.313303 12675 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Committing config change with OpId 2.1968: config changed from index 1156 to 1968, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1968 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:43.318038 12245 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Committing config change with OpId 2.1968: config changed from index 1156 to 1968, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1968 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:43.320164 11297 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1156 to 1968, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1968 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:43.324649 11881 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Committing config change with OpId 2.1968: config changed from index 1156 to 1968, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1968 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
[New LWP 11769]
[New LWP 11770]
[New LWP 11771]
[New LWP 11773]
[New LWP 11780]
[New LWP 11783]
[New LWP 11784]
[New LWP 11790]
[New LWP 11791]
[New LWP 11792]
[New LWP 11793]
[New LWP 11794]
[New LWP 11795]
[New LWP 11798]
[New LWP 11799]
[New LWP 11800]
[New LWP 11802]
[New LWP 11804]
[New LWP 11805]
[New LWP 11806]
[New LWP 11807]
[New LWP 11808]
[New LWP 11809]
[New LWP 11811]
[New LWP 11812]
[New LWP 11813]
[New LWP 11814]
[New LWP 11815]
[New LWP 11817]
[New LWP 11819]
[New LWP 11821]
[New LWP 11822]
[New LWP 11823]
[New LWP 11824]
[New LWP 11825]
[New LWP 11826]
[New LWP 11827]
[New LWP 11830]
[New LWP 11831]
[New LWP 11833]
[New LWP 11835]
[New LWP 11837]
[New LWP 11838]
[New LWP 11839]
[New LWP 11840]
[New LWP 11841]
[New LWP 11842]
[New LWP 11843]
[New LWP 11847]
[New LWP 11848]
[New LWP 11849]
[New LWP 11851]
[New LWP 11852]
[New LWP 11853]
[New LWP 11854]
[New LWP 11855]
[New LWP 11856]
[New LWP 11857]
[New LWP 11859]
[New LWP 11860]
[New LWP 11861]
[New LWP 11864]
[New LWP 11865]
[New LWP 11867]
[New LWP 11868]
[New LWP 11869]
[New LWP 11872]
[New LWP 11873]
[New LWP 11875]
[New LWP 11876]
[New LWP 11877]
[New LWP 11880]
[New LWP 11881]
[New LWP 11883]
[New LWP 11884]
[New LWP 11885]
[New LWP 11886]
[New LWP 11888]
[New LWP 11889]
[New LWP 11890]
[New LWP 11891]
[New LWP 11892]
[New LWP 11893]
[New LWP 11894]
[New LWP 11896]
[New LWP 11897]
[New LWP 11898]
[New LWP 11900]
[New LWP 11901]
[New LWP 11902]
[New LWP 11903]
[New LWP 11905]
[New LWP 11908]
[New LWP 11909]
[New LWP 11910]
[New LWP 11911]
[New LWP 11913]
[New LWP 11916]
[New LWP 11917]
[New LWP 11918]
[New LWP 11919]
[New LWP 11921]
[New LWP 11922]
[New LWP 11923]
[New LWP 11925]
[New LWP 11927]
[New LWP 11928]
[New LWP 11929]
[New LWP 11930]
[New LWP 11931]
[New LWP 11932]
[New LWP 11933]
[New LWP 11934]
[New LWP 11935]
[New LWP 11936]
[New LWP 11937]
[New LWP 11939]
[New LWP 11940]
[New LWP 11941]
[New LWP 11945]
[New LWP 11946]
[New LWP 13921]
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
0x00007fae44312d50 in ?? ()
Id Target Id Frame
* 1 LWP 11768 "kudu" 0x00007fae44312d50 in ?? ()
2 LWP 11769 "kudu" 0x00007fae4430efb9 in ?? ()
3 LWP 11770 "kudu" 0x00007fae4430efb9 in ?? ()
4 LWP 11771 "kudu" 0x00007fae4430efb9 in ?? ()
5 LWP 11773 "kernel-watcher-" 0x00007fae4430efb9 in ?? ()
6 LWP 11780 "ntp client-1178" 0x00007fae443129e2 in ?? ()
7 LWP 11783 "file cache-evic" 0x00007fae4430efb9 in ?? ()
8 LWP 11784 "sq_acceptor" 0x00007fae3d291bb9 in ?? ()
9 LWP 11790 "rpc reactor-117" 0x00007fae3d29e947 in ?? ()
10 LWP 11791 "rpc reactor-117" 0x00007fae3d29e947 in ?? ()
11 LWP 11792 "rpc reactor-117" 0x00007fae3d29e947 in ?? ()
12 LWP 11793 "rpc reactor-117" 0x00007fae3d29e947 in ?? ()
13 LWP 11794 "MaintenanceMgr " 0x00007fae4430ead3 in ?? ()
14 LWP 11795 "txn-status-mana" 0x00007fae4430efb9 in ?? ()
15 LWP 11798 "collect_and_rem" 0x00007fae4430efb9 in ?? ()
16 LWP 11799 "tc-session-exp-" 0x00007fae4430efb9 in ?? ()
17 LWP 11800 "rpc worker-1180" 0x00007fae4430ead3 in ?? ()
18 LWP 11802 "rpc worker-1180" 0x00007fae4430ead3 in ?? ()
19 LWP 11804 "rpc worker-1180" 0x00007fae4430ead3 in ?? ()
20 LWP 11805 "rpc worker-1180" 0x00007fae4430ead3 in ?? ()
21 LWP 11806 "rpc worker-1180" 0x00007fae4430ead3 in ?? ()
22 LWP 11807 "rpc worker-1180" 0x00007fae4430ead3 in ?? ()
23 LWP 11808 "rpc worker-1180" 0x00007fae4430ead3 in ?? ()
24 LWP 11809 "rpc worker-1180" 0x00007fae4430ead3 in ?? ()
25 LWP 11811 "rpc worker-1181" 0x00007fae4430ead3 in ?? ()
26 LWP 11812 "rpc worker-1181" 0x00007fae4430ead3 in ?? ()
27 LWP 11813 "rpc worker-1181" 0x00007fae4430ead3 in ?? ()
28 LWP 11814 "rpc worker-1181" 0x00007fae4430ead3 in ?? ()
29 LWP 11815 "rpc worker-1181" 0x00007fae4430ead3 in ?? ()
30 LWP 11817 "rpc worker-1181" 0x00007fae4430ead3 in ?? ()
31 LWP 11819 "rpc worker-1181" 0x00007fae4430ead3 in ?? ()
32 LWP 11821 "rpc worker-1182" 0x00007fae4430ead3 in ?? ()
33 LWP 11822 "rpc worker-1182" 0x00007fae4430ead3 in ?? ()
34 LWP 11823 "rpc worker-1182" 0x00007fae4430ead3 in ?? ()
35 LWP 11824 "rpc worker-1182" 0x00007fae4430ead3 in ?? ()
36 LWP 11825 "rpc worker-1182" 0x00007fae4430ead3 in ?? ()
37 LWP 11826 "rpc worker-1182" 0x00007fae4430ead3 in ?? ()
38 LWP 11827 "rpc worker-1182" 0x00007fae4430ead3 in ?? ()
39 LWP 11830 "rpc worker-1183" 0x00007fae4430ead3 in ?? ()
40 LWP 11831 "rpc worker-1183" 0x00007fae4430ead3 in ?? ()
41 LWP 11833 "rpc worker-1183" 0x00007fae4430ead3 in ?? ()
42 LWP 11835 "rpc worker-1183" 0x00007fae4430ead3 in ?? ()
43 LWP 11837 "rpc worker-1183" 0x00007fae4430ead3 in ?? ()
44 LWP 11838 "rpc worker-1183" 0x00007fae4430ead3 in ?? ()
45 LWP 11839 "rpc worker-1183" 0x00007fae4430ead3 in ?? ()
46 LWP 11840 "rpc worker-1184" 0x00007fae4430ead3 in ?? ()
47 LWP 11841 "rpc worker-1184" 0x00007fae4430ead3 in ?? ()
48 LWP 11842 "rpc worker-1184" 0x00007fae4430ead3 in ?? ()
49 LWP 11843 "rpc worker-1184" 0x00007fae4430ead3 in ?? ()
50 LWP 11847 "rpc worker-1184" 0x00007fae4430ead3 in ?? ()
51 LWP 11848 "rpc worker-1184" 0x00007fae4430ead3 in ?? ()
52 LWP 11849 "rpc worker-1184" 0x00007fae4430ead3 in ?? ()
53 LWP 11851 "rpc worker-1185" 0x00007fae4430ead3 in ?? ()
54 LWP 11852 "rpc worker-1185" 0x00007fae4430ead3 in ?? ()
55 LWP 11853 "rpc worker-1185" 0x00007fae4430ead3 in ?? ()
56 LWP 11854 "rpc worker-1185" 0x00007fae4430ead3 in ?? ()
57 LWP 11855 "rpc worker-1185" 0x00007fae4430ead3 in ?? ()
58 LWP 11856 "rpc worker-1185" 0x00007fae4430ead3 in ?? ()
59 LWP 11857 "rpc worker-1185" 0x00007fae4430ead3 in ?? ()
60 LWP 11859 "rpc worker-1185" 0x00007fae4430ead3 in ?? ()
61 LWP 11860 "rpc worker-1186" 0x00007fae4430ead3 in ?? ()
62 LWP 11861 "rpc worker-1186" 0x00007fae4430ead3 in ?? ()
63 LWP 11864 "rpc worker-1186" 0x00007fae4430ead3 in ?? ()
64 LWP 11865 "rpc worker-1186" 0x00007fae4430ead3 in ?? ()
65 LWP 11867 "rpc worker-1186" 0x00007fae4430ead3 in ?? ()
66 LWP 11868 "rpc worker-1186" 0x00007fae4430ead3 in ?? ()
67 LWP 11869 "rpc worker-1186" 0x00007fae4430ead3 in ?? ()
68 LWP 11872 "rpc worker-1187" 0x00007fae4430ead3 in ?? ()
69 LWP 11873 "rpc worker-1187" 0x00007fae4430ead3 in ?? ()
70 LWP 11875 "rpc worker-1187" 0x00007fae4430ead3 in ?? ()
71 LWP 11876 "rpc worker-1187" 0x00007fae4430ead3 in ?? ()
72 LWP 11877 "rpc worker-1187" 0x00007fae4430ead3 in ?? ()
73 LWP 11880 "rpc worker-1188" 0x00007fae4430ead3 in ?? ()
74 LWP 11881 "rpc worker-1188" 0x00007fae4430f4fc in ?? ()
75 LWP 11883 "rpc worker-1188" 0x00007fae4430ead3 in ?? ()
76 LWP 11884 "rpc worker-1188" 0x00007fae4430ead3 in ?? ()
77 LWP 11885 "rpc worker-1188" 0x00007fae4430ead3 in ?? ()
78 LWP 11886 "rpc worker-1188" 0x00007fae4430ead3 in ?? ()
79 LWP 11888 "rpc worker-1188" 0x00007fae4430ead3 in ?? ()
80 LWP 11889 "rpc worker-1188" 0x00007fae4430ead3 in ?? ()
81 LWP 11890 "rpc worker-1189" 0x00007fae4430ead3 in ?? ()
82 LWP 11891 "rpc worker-1189" 0x00007fae4430ead3 in ?? ()
83 LWP 11892 "rpc worker-1189" 0x00007fae4430ead3 in ?? ()
84 LWP 11893 "rpc worker-1189" 0x00007fae4430ead3 in ?? ()
85 LWP 11894 "rpc worker-1189" 0x00007fae4430ead3 in ?? ()
86 LWP 11896 "rpc worker-1189" 0x00007fae4430ead3 in ?? ()
87 LWP 11897 "rpc worker-1189" 0x00007fae4430ead3 in ?? ()
88 LWP 11898 "rpc worker-1189" 0x00007fae4430ead3 in ?? ()
89 LWP 11900 "rpc worker-1190" 0x00007fae4430ead3 in ?? ()
90 LWP 11901 "rpc worker-1190" 0x00007fae4430ead3 in ?? ()
91 LWP 11902 "rpc worker-1190" 0x00007fae4430ead3 in ?? ()
92 LWP 11903 "rpc worker-1190" 0x00007fae4430ead3 in ?? ()
93 LWP 11905 "rpc worker-1190" 0x00007fae4430ead3 in ?? ()
94 LWP 11908 "rpc worker-1190" 0x00007fae4430ead3 in ?? ()
95 LWP 11909 "rpc worker-1190" 0x00007fae4430ead3 in ?? ()
96 LWP 11910 "rpc worker-1191" 0x00007fae4430ead3 in ?? ()
97 LWP 11911 "rpc worker-1191" 0x00007fae4430ead3 in ?? ()
98 LWP 11913 "rpc worker-1191" 0x00007fae4430ead3 in ?? ()
99 LWP 11916 "rpc worker-1191" 0x00007fae4430ead3 in ?? ()
100 LWP 11917 "rpc worker-1191" 0x00007fae4430ead3 in ?? ()
101 LWP 11918 "rpc worker-1191" 0x00007fae4430ead3 in ?? ()
102 LWP 11919 "rpc worker-1191" 0x00007fae4430ead3 in ?? ()
103 LWP 11921 "rpc worker-1192" 0x00007fae4430ead3 in ?? ()
104 LWP 11922 "rpc worker-1192" 0x00007fae4430ead3 in ?? ()
105 LWP 11923 "rpc worker-1192" 0x00007fae4430ead3 in ?? ()
106 LWP 11925 "rpc worker-1192" 0x00007fae4430ead3 in ?? ()
107 LWP 11927 "rpc worker-1192" 0x00007fae4430ead3 in ?? ()
108 LWP 11928 "rpc worker-1192" 0x00007fae4430ead3 in ?? ()
109 LWP 11929 "rpc worker-1192" 0x00007fae4430ead3 in ?? ()
110 LWP 11930 "rpc worker-1193" 0x00007fae4430ead3 in ?? ()
111 LWP 11931 "rpc worker-1193" 0x00007fae4430ead3 in ?? ()
112 LWP 11932 "rpc worker-1193" 0x00007fae4430ead3 in ?? ()
113 LWP 11933 "rpc worker-1193" 0x00007fae4430ead3 in ?? ()
114 LWP 11934 "rpc worker-1193" 0x00007fae4430ead3 in ?? ()
115 LWP 11935 "rpc worker-1193" 0x00007fae4430ead3 in ?? ()
116 LWP 11936 "rpc worker-1193" 0x00007fae4430ead3 in ?? ()
117 LWP 11937 "diag-logger-119" 0x00007fae4430efb9 in ?? ()
118 LWP 11939 "result-tracker-" 0x00007fae4430efb9 in ?? ()
119 LWP 11940 "excess-log-dele" 0x00007fae4430efb9 in ?? ()
120 LWP 11941 "acceptor-11941" 0x00007fae3d29ffc7 in ?? ()
121 LWP 11945 "heartbeat-11945" 0x00007fae4430efb9 in ?? ()
122 LWP 11946 "maintenance_sch" 0x00007fae4430efb9 in ?? ()
123 LWP 13921 "wal-append [wor" 0x00007fae4430efb9 in ?? ()
Thread 123 (LWP 13921):
#0 0x00007fae4430efb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 122 (LWP 11946):
#0 0x00007fae4430efb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 121 (LWP 11945):
#0 0x00007fae4430efb9 in ?? ()
#1 0xffffffffffffffff in ?? ()
#2 0x000000000000005f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000018ea8 in ?? ()
#5 0x00007fadfa723770 in ?? ()
#6 0x00000000000000be in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 11941):
#0 0x00007fae3d29ffc7 in ?? ()
#1 0x000061400000a090 in ?? ()
#2 0x00007fadfaf3afa0 in ?? ()
#3 0x00007fadfaf3afc0 in ?? ()
#4 0x00007fadfaf3b0e0 in ?? ()
#5 0x00007fadfaf3afd0 in ?? ()
#6 0x00007fadfaf3b040 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x000000000082c9d2 in __sanitizer::theDepot ()
#9 0x00000000008c3cc9 in __sanitizer::theDepot ()
#10 0x00000000008f35b0 in __sanitizer::theDepot ()
#11 0x00000000008f34b8 in __sanitizer::theDepot ()
#12 0x000060c000060058 in ?? ()
#13 0x000060c0000600b4 in ?? ()
#14 0x00000000008875e1 in __sanitizer::theDepot ()
#15 0x000000000000005c in ?? ()
#16 0x000000000088348c in __sanitizer::theDepot ()
#17 0x000060c000060058 in ?? ()
#18 0x0000000000883aba in __sanitizer::theDepot ()
#19 0x00000000008d30d7 in __sanitizer::theDepot ()
#20 0x00007fae47a01d85 in ?? ()
#21 0x00007fae47a0474c in ?? ()
#22 0x00007fae47a045c9 in ?? ()
#23 0x00000000009edb7d in __sanitizer::theDepot ()
#24 0x00007fae4102eeaf in ?? ()
#25 0x00007fae443086db in ?? ()
#26 0x00007fae3d250346 in ?? ()
#27 0x00007fadfaf3a842 in ?? ()
#28 0x000000006a7620bd in ?? ()
#29 0x000000006a7620bd in ?? ()
#30 0x000000000080e8d4 in __sanitizer::theDepot ()
#31 0x0000000f00000019 in ?? ()
#32 0x0000000700000012 in ?? ()
#33 0x0000640000001140 in ?? ()
#34 0x00007fadfa734e60 in ?? ()
#35 0x0000640000001140 in ?? ()
#36 0x00000000008b1acd in __sanitizer::theDepot ()
#37 0x0000000000e377a0 in ?? ()
#38 0x00007fadf8ec73b8 in ?? ()
#39 0x0000000000000000 in ?? ()
Thread 119 (LWP 11940):
#0 0x00007fae4430efb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 118 (LWP 11939):
#0 0x00007fae4430efb9 in ?? ()
#1 0x00007fadfbf6d160 in ?? ()
#2 0x000000000000004d in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100006ec30 in ?? ()
#5 0x00007fadfbf6d110 in ?? ()
#6 0x000000000000009a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 11937):
#0 0x00007fae4430efb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 11936):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 11935):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 11934):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 11933):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 11932):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 11931):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 11930):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 11929):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 11928):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 11927):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 11925):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 11923):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 11922):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 11921):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 11919):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 11918):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 11917):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 11916):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 11913):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 11911):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 11910):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 11909):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 11908):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 11905):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 11903):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 11902):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 11901):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 11900):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 11898):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 11897):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 11896):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 11894):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 11893):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 11892):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 11891):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 11890):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 11889):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 11888):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 11886):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 11885):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 11884):
#0 0x00007fae4430ead3 in ?? ()
#1 0x000000000000057c in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007fae1136deb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fae1136ded0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 11883):
#0 0x00007fae4430ead3 in ?? ()
#1 0x00000000000005e4 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a0088 in ?? ()
#4 0x00007fae11b85eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fae11b85ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 74 (LWP 11881):
#0 0x00007fae4430f4fc in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 11880):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000426 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00018ffc8 in ?? ()
#4 0x00007fae12bb5eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fae12bb5ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 72 (LWP 11877):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 11876):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 11875):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 11873):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 11872):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 11869):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 11868):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 11867):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 11865):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 11864):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 11861):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 11860):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 11859):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 11857):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 11856):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 11855):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 11854):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007fae1b54eeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fae1b54eed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007fae4430e770 in ?? ()
#10 0x00007fae1b54eed0 in ?? ()
#11 0x00007fae1b54efa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 11853):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012003c in ?? ()
#4 0x00007fae1bd66eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fae1bd66ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011fff0 in ?? ()
#9 0x00007fae4430e770 in ?? ()
#10 0x00007fae1bd66ed0 in ?? ()
#11 0x00007fae1bd66fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 54 (LWP 11852):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011684c in ?? ()
#4 0x00007fae1c57eeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fae1c57eed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000116800 in ?? ()
#9 0x00007fae4430e770 in ?? ()
#10 0x00007fae1c57eed0 in ?? ()
#11 0x00007fae1c57efa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 53 (LWP 11851):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 11849):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 11848):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 11847):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 11843):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 11842):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 11841):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 11840):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 11839):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 11838):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 11837):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 11835):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 11833):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 11831):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 11830):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 11827):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 11826):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 11825):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000018 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009ffe8 in ?? ()
#4 0x00007fae2572feb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fae2572fed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 11824):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 34 (LWP 11823):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 11822):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 11821):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 11819):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 11817):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 11815):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 11814):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 11813):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 11812):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 11811):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 11809):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 11808):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 11807):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 11806):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 11805):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 11804):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 11802):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 11800):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 11799):
#0 0x00007fae4430efb9 in ?? ()
#1 0x00000000ffffffff in ?? ()
#2 0x0000000000000007 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000019760 in ?? ()
#5 0x00007fae2f8ddd30 in ?? ()
#6 0x000000000000000e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 11798):
#0 0x00007fae4430efb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x000000000000000f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a618 in ?? ()
#5 0x00007fae300df270 in ?? ()
#6 0x000000000000001e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 11795):
#0 0x00007fae4430efb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000007 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000618000004da8 in ?? ()
#5 0x00007fae308df250 in ?? ()
#6 0x000000000000000e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 11794):
#0 0x00007fae4430ead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 11793):
#0 0x00007fae3d29e947 in ?? ()
#1 0x000061400000a480 in ?? ()
#2 0x0000619000059680 in ?? ()
#3 0x00007fae318e2340 in ?? ()
#4 0x00007fae318e2540 in ?? ()
#5 0x00007fae318e2390 in ?? ()
#6 0x000061400000a480 in ?? ()
#7 0x00007fae318e2400 in ?? ()
#8 0x00007fae3f8a5bda in ?? ()
#9 0x3fa6e481ca000000 in ?? ()
#10 0x0000619000059680 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059680 in ?? ()
#13 0x422788f4ea800000 in ?? ()
#14 0x00007fae318e2540 in ?? ()
I20260807 18:16:43.434599 13257 raft_consensus.cc:1203] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1770->[2.1771-2.1968] Dedup: 2.1967->[2.1968-2.1968]
#15 0x41da97978d7b0aa0 in ?? ()
#16 0x0000000046314480 in ?? ()
#17 0x00007fae318e23e0 in ?? ()
#18 0x00007fae3f8a9228 in ?? ()
#19 0x00000000318e23c0 in ?? ()
#20 0x0000619000059680 in ?? ()
#21 0x000061400000a480 in ?? ()
#22 0x00007fae318e2400 in ?? ()
#23 0x3fa6e481ca000000 in ?? ()
#24 0x4137c2d561c79367 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 11792):
#0 0x00007fae3d29e947 in ?? ()
#1 0x000061400000a280 in ?? ()
#2 0x0000619000059180 in ?? ()
#3 0x00007fae320e3340 in ?? ()
#4 0x00007fae320e3540 in ?? ()
#5 0x00007fae320e3390 in ?? ()
#6 0x000061400000a280 in ?? ()
#7 0x00007fae320e3400 in ?? ()
#8 0x00007fae3f8a5bda in ?? ()
#9 0x3fb9953965000000 in ?? ()
#10 0x0000619000059180 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059180 in ?? ()
#13 0x4227317503800000 in ?? ()
#14 0x00007fae320e3540 in ?? ()
#15 0x41da97978d7b0a9f in ?? ()
#16 0x0000000046414680 in ?? ()
#17 0x00007fae320e33e0 in ?? ()
#18 0x00007fae3f8a9228 in ?? ()
#19 0x00000000320e33c0 in ?? ()
#20 0x0000619000059180 in ?? ()
#21 0x000061400000a280 in ?? ()
#22 0x00007fae320e3400 in ?? ()
#23 0x3fb9953965000000 in ?? ()
#24 0x4137c2d54ff193f5 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 11791):
#0 0x00007fae3d29e947 in ?? ()
#1 0x000061400000a080 in ?? ()
#2 0x0000619000058c80 in ?? ()
#3 0x00007fae328e4340 in ?? ()
#4 0x00007fae328e4540 in ?? ()
#5 0x00007fae328e4390 in ?? ()
#6 0x000061400000a080 in ?? ()
#7 0x00007fae328e4400 in ?? ()
#8 0x00007fae3f8a5bda in ?? ()
#9 0x3fb96faf63000000 in ?? ()
#10 0x0000619000058c80 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058c80 in ?? ()
#13 0x4216da8db3000000 in ?? ()
#14 0x00007fae328e4540 in ?? ()
#15 0x41da97978d7b0a9f in ?? ()
#16 0x0000000046514880 in ?? ()
#17 0x00007fae328e43e0 in ?? ()
#18 0x00007fae3f8a9228 in ?? ()
#19 0x00000000328e43c0 in ?? ()
#20 0x0000619000058c80 in ?? ()
#21 0x000061400000a080 in ?? ()
#22 0x00007fae328e4400 in ?? ()
#23 0x3fb96faf63000000 in ?? ()
#24 0x4137c2d550080cf7 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 11790):
#0 0x00007fae3d29e947 in ?? ()
#1 0x0000614000009e80 in ?? ()
#2 0x0000619000058780 in ?? ()
#3 0x00007fae33ead340 in ?? ()
#4 0x00007fae33ead540 in ?? ()
#5 0x00007fae33ead390 in ?? ()
#6 0x0000614000009e80 in ?? ()
#7 0x00007fae33ead400 in ?? ()
#8 0x00007fae3f8a5bda in ?? ()
#9 0x3f83e04b68000000 in ?? ()
#10 0x0000619000058780 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058780 in ?? ()
#13 0x4266678624c80000 in ?? ()
#14 0x00007fae33ead540 in ?? ()
#15 0x41da97978d7b0aa0 in ?? ()
#16 0x00000000467cda80 in ?? ()
#17 0x00007fae33ead3e0 in ?? ()
#18 0x00007fae3f8a9228 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 11784):
#0 0x00007fae3d291bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fae358b77d8 in ?? ()
#3 0x000060200004c430 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x0000000000823a92 in __sanitizer::theDepot ()
#7 0x0000000000000009 in ?? ()
#8 0x0000000000007da4 in ?? ()
#9 0x0000000000000000 in ?? ()
I20260807 18:16:43.445276 13260 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Committing config change with OpId 2.1968: config changed from index 1156 to 1968, 50da72adf57546f5bab0a028672a51dd (127.10.253.65) changed from NON_VOTER to VOTER. New config: { opid_index: 1968 OBSOLETE_local: false peers { permanent_uuid: "b5bb27271da74b1a909d982e6fb2d470" member_type: VOTER last_known_addr { host: "127.10.253.66" port: 43559 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:43.454779 12073 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1968, Committed index: 1968, Last appended: 2.1968, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:43.458721 12245 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1968. Preceding OpId from leader: term: 2 index: 1969. (index mismatch)
I20260807 18:16:43.459527 12675 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1968. Preceding OpId from leader: term: 2 index: 1969. (index mismatch)
I20260807 18:16:43.460943 13893 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1969, Last known committed idx: 1968, Time since last communication: 0.000s
I20260807 18:16:43.463322 13893 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1969, Last known committed idx: 1968, Time since last communication: 0.000s
I20260807 18:16:43.467621 13918 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 LEADER]: Committing config change with OpId 2.1969: config changed from index 1968 to 1969, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:43.469010 12675 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Committing config change with OpId 2.1969: config changed from index 1968 to 1969, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:43.473989 11281 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 874ba119c7284c4d8a113d6654e0c39e with cas_config_opid_index 1968: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 18:16:43.475544 12245 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Committing config change with OpId 2.1969: config changed from index 1968 to 1969, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:43.480261 11291 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 reported cstate change: config changed from index 1968 to 1969, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New cstate: current_term: 2 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:43.493984 13257 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1968. Preceding OpId from leader: term: 2 index: 1969. (index mismatch)
I20260807 18:16:43.496039 13918 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1969, Last known committed idx: 1968, Time since last communication: 0.000s
I20260807 18:16:43.500362 13257 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Committing config change with OpId 2.1969: config changed from index 1968 to 1969, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
W20260807 18:16:43.559674 11285 catalog_manager.cc:4584] TS b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 874ba119c7284c4d8a113d6654e0c39e: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
Thread 7 (LWP 11783):
#0 0x00007fae4430efb9 in ?? ()
#1 0x3ff0000000000000 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a228 in ?? ()
#5 0x00007fae350b60d0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 6 (LWP 11780):
#0 0x00007fae443129e2 in ?? ()
#1 0x00007fae348b4430 in ?? ()
#2 0x00007fae348b3f20 in ?? ()
#3 0x00007fae348b3650 in ?? ()
#4 0x00007fae348b51c0 in ?? ()
#5 0x00007fae348b3ed0 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x00007fae348b3f30 in ?? ()
#8 0x000061100005a2d0 in ?? ()
#9 0x00007fae348b3f20 in ?? ()
#10 0x000000000081de90 in __sanitizer::theDepot ()
#11 0x00007fae49ad6269 in ?? ()
#12 0x00000000009edb7d in __sanitizer::theDepot ()
#13 0x00007fae4102eeaf in ?? ()
#14 0x00007fae443086db in ?? ()
#15 0x00007fae348b36b0 in ?? ()
#16 0x00007fae49ae4e61 in ?? ()
#17 0x00007fae348b3770 in ?? ()
#18 0x0000000000000003 in ?? ()
#19 0x0000000000000003 in ?? ()
#20 0x00000c2000001c59 in ?? ()
#21 0x000061100005a2e0 in ?? ()
#22 0x000060d000430098 in ?? ()
#23 0x0000000000000080 in ?? ()
#24 0x000061000000e240 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 5 (LWP 11773):
#0 0x00007fae4430efb9 in ?? ()
#1 0x00007fae368b8c90 in ?? ()
#2 0x000000000000017f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001ab28 in ?? ()
#5 0x00007fae368b8cd0 in ?? ()
#6 0x00000000000002fe in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 11771):
#0 0x00007fae4430efb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 11770):
#0 0x00007fae4430efb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 11769):
#0 0x00007fae4430efb9 in ?? ()
#1 0x0000000000008000 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000009838 in ?? ()
#5 0x00007fae380bc450 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 11768):
#0 0x00007fae44312d50 in ?? ()
#1 0x0000000000000000 in ?? ()
I20260807 18:16:43.834515 13938 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:43.835464 11880 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 2 index: 1968. Preceding OpId from leader: term: 2 index: 1969. (index mismatch)
I20260807 18:16:43.836707 13938 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:43.838964 13938 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:43.840042 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:43.841230 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
************************* END STACKS ***************************
I20260807 18:16:43.844269 11253 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 3 with UUID 22052958d03d426ebdc2fc310637c846 and pid 11949
I20260807 18:16:43.844628 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:43.845256 13893 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1969, Last known committed idx: 1968, Time since last communication: 0.000s
I20260807 18:16:43.845630 11791 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca
I20260807 18:16:43.845993 13938 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:43.848562 11880 raft_consensus.cc:2932] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Committing config change with OpId 2.1969: config changed from index 1968 to 1969, VOTER b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66) evicted. New config: { opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } } }
I20260807 18:16:43.840658 13942 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:43.850716 13942 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:43.851796 13942 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:43.852306 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:43.852476 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:43.853590 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:43.854483 11790 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca
I20260807 18:16:43.854851 13942 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:43.876427 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:43.877288 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
************************ BEGIN STACKS **************************
W20260807 18:16:44.721231 11285 catalog_manager.cc:4584] TS b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 874ba119c7284c4d8a113d6654e0c39e: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
[New LWP 11950]
[New LWP 11952]
[New LWP 11953]
[New LWP 11957]
[New LWP 11965]
[New LWP 11966]
[New LWP 11967]
[New LWP 11974]
[New LWP 11975]
[New LWP 11976]
[New LWP 11977]
[New LWP 11979]
[New LWP 11980]
[New LWP 11981]
[New LWP 11982]
[New LWP 11983]
[New LWP 11984]
[New LWP 11985]
[New LWP 11989]
[New LWP 11990]
[New LWP 11991]
[New LWP 11993]
[New LWP 11994]
[New LWP 11995]
[New LWP 11996]
[New LWP 11998]
[New LWP 12001]
[New LWP 12002]
[New LWP 12003]
[New LWP 12004]
[New LWP 12005]
[New LWP 12007]
[New LWP 12009]
[New LWP 12010]
[New LWP 12011]
[New LWP 12012]
[New LWP 12013]
[New LWP 12015]
[New LWP 12016]
[New LWP 12017]
[New LWP 12018]
[New LWP 12020]
[New LWP 12021]
[New LWP 12022]
[New LWP 12025]
[New LWP 12027]
[New LWP 12030]
[New LWP 12031]
[New LWP 12033]
[New LWP 12035]
[New LWP 12036]
[New LWP 12037]
[New LWP 12038]
[New LWP 12041]
[New LWP 12044]
[New LWP 12045]
[New LWP 12046]
[New LWP 12048]
[New LWP 12049]
[New LWP 12050]
[New LWP 12052]
[New LWP 12053]
[New LWP 12054]
[New LWP 12055]
[New LWP 12057]
[New LWP 12058]
[New LWP 12059]
[New LWP 12061]
[New LWP 12066]
[New LWP 12067]
[New LWP 12069]
[New LWP 12071]
[New LWP 12072]
[New LWP 12073]
[New LWP 12074]
[New LWP 12075]
[New LWP 12076]
[New LWP 12077]
[New LWP 12078]
[New LWP 12079]
[New LWP 12081]
[New LWP 12082]
[New LWP 12084]
[New LWP 12085]
[New LWP 12087]
[New LWP 12090]
[New LWP 12091]
[New LWP 12092]
[New LWP 12094]
[New LWP 12096]
[New LWP 12097]
[New LWP 12098]
[New LWP 12100]
[New LWP 12102]
[New LWP 12103]
[New LWP 12104]
[New LWP 12105]
[New LWP 12108]
[New LWP 12109]
[New LWP 12110]
[New LWP 12112]
[New LWP 12113]
[New LWP 12114]
[New LWP 12115]
[New LWP 12116]
[New LWP 12117]
[New LWP 12118]
[New LWP 12119]
[New LWP 12121]
[New LWP 12122]
[New LWP 12123]
[New LWP 12125]
[New LWP 12126]
[New LWP 12127]
[New LWP 12128]
[New LWP 12129]
[New LWP 12130]
[New LWP 12131]
[New LWP 12132]
[New LWP 12133]
[New LWP 12134]
[New LWP 13661]
[New LWP 13893]
[New LWP 13918]
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
0x00007f997edb2d50 in ?? ()
Id Target Id Frame
* 1 LWP 11949 "kudu" 0x00007f997edb2d50 in ?? ()
2 LWP 11950 "kudu" 0x00007f997edaefb9 in ?? ()
3 LWP 11952 "kudu" 0x00007f997edaefb9 in ?? ()
4 LWP 11953 "kudu" 0x00007f997edaefb9 in ?? ()
5 LWP 11957 "kernel-watcher-" 0x00007f997edaefb9 in ?? ()
6 LWP 11965 "ntp client-1196" 0x00007f997edb29e2 in ?? ()
7 LWP 11966 "file cache-evic" 0x00007f997edaefb9 in ?? ()
8 LWP 11967 "sq_acceptor" 0x00007f9977d31bb9 in ?? ()
9 LWP 11974 "rpc reactor-119" 0x00007f9977d3e947 in ?? ()
10 LWP 11975 "rpc reactor-119" 0x00007f9977d3e947 in ?? ()
11 LWP 11976 "rpc reactor-119" 0x00007f9977d3e947 in ?? ()
12 LWP 11977 "rpc reactor-119" 0x00007f9977d3e947 in ?? ()
13 LWP 11979 "MaintenanceMgr " 0x00007f997edaead3 in ?? ()
14 LWP 11980 "txn-status-mana" 0x00007f997edaefb9 in ?? ()
15 LWP 11981 "collect_and_rem" 0x00007f997edaefb9 in ?? ()
16 LWP 11982 "tc-session-exp-" 0x00007f997edaefb9 in ?? ()
17 LWP 11983 "rpc worker-1198" 0x00007f997edaead3 in ?? ()
18 LWP 11984 "rpc worker-1198" 0x00007f997edaead3 in ?? ()
19 LWP 11985 "rpc worker-1198" 0x00007f997edaead3 in ?? ()
20 LWP 11989 "rpc worker-1198" 0x00007f997edaead3 in ?? ()
21 LWP 11990 "rpc worker-1199" 0x00007f997edaead3 in ?? ()
22 LWP 11991 "rpc worker-1199" 0x00007f997edaead3 in ?? ()
23 LWP 11993 "rpc worker-1199" 0x00007f997edaead3 in ?? ()
24 LWP 11994 "rpc worker-1199" 0x00007f997edaead3 in ?? ()
25 LWP 11995 "rpc worker-1199" 0x00007f997edaead3 in ?? ()
26 LWP 11996 "rpc worker-1199" 0x00007f997edaead3 in ?? ()
27 LWP 11998 "rpc worker-1199" 0x00007f997edaead3 in ?? ()
28 LWP 12001 "rpc worker-1200" 0x00007f997edaead3 in ?? ()
29 LWP 12002 "rpc worker-1200" 0x00007f997edaead3 in ?? ()
30 LWP 12003 "rpc worker-1200" 0x00007f997edaead3 in ?? ()
31 LWP 12004 "rpc worker-1200" 0x00007f997edaead3 in ?? ()
32 LWP 12005 "rpc worker-1200" 0x00007f997edaead3 in ?? ()
33 LWP 12007 "rpc worker-1200" 0x00007f997edaead3 in ?? ()
34 LWP 12009 "rpc worker-1200" 0x00007f997edaead3 in ?? ()
35 LWP 12010 "rpc worker-1201" 0x00007f997edaead3 in ?? ()
36 LWP 12011 "rpc worker-1201" 0x00007f997edaead3 in ?? ()
37 LWP 12012 "rpc worker-1201" 0x00007f997edaead3 in ?? ()
38 LWP 12013 "rpc worker-1201" 0x00007f997edaead3 in ?? ()
39 LWP 12015 "rpc worker-1201" 0x00007f997edaead3 in ?? ()
40 LWP 12016 "rpc worker-1201" 0x00007f997edaead3 in ?? ()
41 LWP 12017 "rpc worker-1201" 0x00007f997edaead3 in ?? ()
42 LWP 12018 "rpc worker-1201" 0x00007f997edaead3 in ?? ()
43 LWP 12020 "rpc worker-1202" 0x00007f997edaead3 in ?? ()
44 LWP 12021 "rpc worker-1202" 0x00007f997edaead3 in ?? ()
45 LWP 12022 "rpc worker-1202" 0x00007f997edaead3 in ?? ()
46 LWP 12025 "rpc worker-1202" 0x00007f997edaead3 in ?? ()
47 LWP 12027 "rpc worker-1202" 0x00007f997edaead3 in ?? ()
48 LWP 12030 "rpc worker-1203" 0x00007f997edaead3 in ?? ()
49 LWP 12031 "rpc worker-1203" 0x00007f997edaead3 in ?? ()
50 LWP 12033 "rpc worker-1203" 0x00007f997edaead3 in ?? ()
51 LWP 12035 "rpc worker-1203" 0x00007f997edaead3 in ?? ()
52 LWP 12036 "rpc worker-1203" 0x00007f997edaead3 in ?? ()
53 LWP 12037 "rpc worker-1203" 0x00007f997edaead3 in ?? ()
54 LWP 12038 "rpc worker-1203" 0x00007f997edaead3 in ?? ()
55 LWP 12041 "rpc worker-1204" 0x00007f997edaead3 in ?? ()
56 LWP 12044 "rpc worker-1204" 0x00007f997edaead3 in ?? ()
57 LWP 12045 "rpc worker-1204" 0x00007f997edaead3 in ?? ()
58 LWP 12046 "rpc worker-1204" 0x00007f997edaead3 in ?? ()
59 LWP 12048 "rpc worker-1204" 0x00007f997edaead3 in ?? ()
60 LWP 12049 "rpc worker-1204" 0x00007f997edaead3 in ?? ()
61 LWP 12050 "rpc worker-1205" 0x00007f997edaead3 in ?? ()
62 LWP 12052 "rpc worker-1205" 0x00007f997edaead3 in ?? ()
63 LWP 12053 "rpc worker-1205" 0x00007f997edaead3 in ?? ()
64 LWP 12054 "rpc worker-1205" 0x00007f997edaead3 in ?? ()
65 LWP 12055 "rpc worker-1205" 0x00007f997edaead3 in ?? ()
66 LWP 12057 "rpc worker-1205" 0x00007f997edaead3 in ?? ()
67 LWP 12058 "rpc worker-1205" 0x00007f997edaead3 in ?? ()
68 LWP 12059 "rpc worker-1205" 0x00007f997edaead3 in ?? ()
69 LWP 12061 "rpc worker-1206" 0x00007f997edaead3 in ?? ()
70 LWP 12066 "rpc worker-1206" 0x00007f997edaead3 in ?? ()
71 LWP 12067 "rpc worker-1206" 0x00007f997edaead3 in ?? ()
72 LWP 12069 "rpc worker-1206" 0x00007f997edaead3 in ?? ()
73 LWP 12071 "rpc worker-1207" 0x00007f997edaead3 in ?? ()
74 LWP 12072 "rpc worker-1207" 0x00007f997edaead3 in ?? ()
75 LWP 12073 "rpc worker-1207" 0x00007f997edaead3 in ?? ()
76 LWP 12074 "rpc worker-1207" 0x00007f997edaead3 in ?? ()
77 LWP 12075 "rpc worker-1207" 0x00007f997edaead3 in ?? ()
78 LWP 12076 "rpc worker-1207" 0x00007f997edaead3 in ?? ()
79 LWP 12077 "rpc worker-1207" 0x00007f997edaead3 in ?? ()
80 LWP 12078 "rpc worker-1207" 0x00007f997edaead3 in ?? ()
81 LWP 12079 "rpc worker-1207" 0x00007f997edaead3 in ?? ()
82 LWP 12081 "rpc worker-1208" 0x00007f997edaead3 in ?? ()
83 LWP 12082 "rpc worker-1208" 0x00007f997edaead3 in ?? ()
84 LWP 12084 "rpc worker-1208" 0x00007f997edaead3 in ?? ()
85 LWP 12085 "rpc worker-1208" 0x00007f997edaead3 in ?? ()
86 LWP 12087 "rpc worker-1208" 0x00007f997edaead3 in ?? ()
87 LWP 12090 "rpc worker-1209" 0x00007f997edaead3 in ?? ()
88 LWP 12091 "rpc worker-1209" 0x00007f997edaead3 in ?? ()
89 LWP 12092 "rpc worker-1209" 0x00007f997edaead3 in ?? ()
90 LWP 12094 "rpc worker-1209" 0x00007f997edaead3 in ?? ()
91 LWP 12096 "rpc worker-1209" 0x00007f997edaead3 in ?? ()
92 LWP 12097 "rpc worker-1209" 0x00007f997edaead3 in ?? ()
93 LWP 12098 "rpc worker-1209" 0x00007f997edaead3 in ?? ()
94 LWP 12100 "rpc worker-1210" 0x00007f997edaead3 in ?? ()
95 LWP 12102 "rpc worker-1210" 0x00007f997edaead3 in ?? ()
96 LWP 12103 "rpc worker-1210" 0x00007f997edaead3 in ?? ()
97 LWP 12104 "rpc worker-1210" 0x00007f997edaead3 in ?? ()
98 LWP 12105 "rpc worker-1210" 0x00007f997edaead3 in ?? ()
99 LWP 12108 "rpc worker-1210" 0x00007f997edaead3 in ?? ()
100 LWP 12109 "rpc worker-1210" 0x00007f997edaead3 in ?? ()
101 LWP 12110 "rpc worker-1211" 0x00007f997edaead3 in ?? ()
102 LWP 12112 "rpc worker-1211" 0x00007f997edaead3 in ?? ()
103 LWP 12113 "rpc worker-1211" 0x00007f997edaead3 in ?? ()
104 LWP 12114 "rpc worker-1211" 0x00007f997edaead3 in ?? ()
105 LWP 12115 "rpc worker-1211" 0x00007f997edaead3 in ?? ()
106 LWP 12116 "rpc worker-1211" 0x00007f997edaead3 in ?? ()
107 LWP 12117 "rpc worker-1211" 0x00007f997edaead3 in ?? ()
108 LWP 12118 "rpc worker-1211" 0x00007f997edaead3 in ?? ()
109 LWP 12119 "rpc worker-1211" 0x00007f997edaead3 in ?? ()
110 LWP 12121 "rpc worker-1212" 0x00007f997edaead3 in ?? ()
111 LWP 12122 "rpc worker-1212" 0x00007f997edaead3 in ?? ()
112 LWP 12123 "rpc worker-1212" 0x00007f997edaead3 in ?? ()
113 LWP 12125 "rpc worker-1212" 0x00007f997edaead3 in ?? ()
114 LWP 12126 "rpc worker-1212" 0x00007f997edaead3 in ?? ()
115 LWP 12127 "rpc worker-1212" 0x00007f997edaead3 in ?? ()
116 LWP 12128 "rpc worker-1212" 0x00007f997edaead3 in ?? ()
117 LWP 12129 "diag-logger-121" 0x00007f997edaefb9 in ?? ()
118 LWP 12130 "result-tracker-" 0x00007f997edaefb9 in ?? ()
119 LWP 12131 "excess-log-dele" 0x00007f997edaefb9 in ?? ()
120 LWP 12132 "acceptor-12132" 0x00007f9977d3ffc7 in ?? ()
121 LWP 12133 "heartbeat-12133" 0x00007f997edaefb9 in ?? ()
122 LWP 12134 "maintenance_sch" 0x00007f997edaefb9 in ?? ()
123 LWP 13661 "raft [worker]-1" 0x00007f997edaefb9 in ?? ()
124 LWP 13893 "raft [worker]-1" 0x00007f997edaefb9 in ?? ()
125 LWP 13918 "raft [worker]-1" 0x00007f997edaefb9 in ?? ()
Thread 125 (LWP 13918):
#0 0x00007f997edaefb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000089 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x00007f992befdba4 in ?? ()
#5 0x00007f992befd830 in ?? ()
#6 0x0000000000000113 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f992befd850 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 124 (LWP 13893):
#0 0x00007f997edaefb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x00000000000000e2 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007f9970ab7ba0 in ?? ()
#5 0x00007f9970ab7830 in ?? ()
#6 0x00000000000001c4 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 123 (LWP 13661):
#0 0x00007f997edaefb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000232 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007f992019cba0 in ?? ()
#5 0x00007f992019c830 in ?? ()
#6 0x0000000000000464 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 122 (LWP 12134):
#0 0x00007f997edaefb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 121 (LWP 12133):
#0 0x00007f997edaefb9 in ?? ()
#1 0xffffffffffffffff in ?? ()
#2 0x0000000000000098 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x0000613000018eac in ?? ()
#5 0x00007f99351c3770 in ?? ()
#6 0x0000000000000131 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f99351c3790 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007f99351c3810 in ?? ()
#12 0x00000ff326a38704 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 12132):
#0 0x00007f9977d3ffc7 in ?? ()
#1 0x00007f99359daf90 in ?? ()
#2 0x000000000080fb05 in __sanitizer::theDepot ()
#3 0x0000000000000000 in ?? ()
Thread 119 (LWP 12131):
#0 0x00007f997edaefb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 118 (LWP 12130):
#0 0x00007f997edaefb9 in ?? ()
#1 0x00007f9936a0d160 in ?? ()
#2 0x000000000000004e in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100006ec30 in ?? ()
#5 0x00007f9936a0d110 in ?? ()
#6 0x000000000000009c in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 12129):
#0 0x00007f997edaefb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 12128):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 12127):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 12126):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 12125):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 12123):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 12122):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 12121):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 12119):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 12118):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 12117):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 12116):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 12115):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 12114):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 12113):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 12112):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 12110):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 12109):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 12108):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 12105):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 12104):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 12103):
#0 0x00007f997edaead3 in ?? ()
#1 0x000000000000000c in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00022fff8 in ?? ()
#4 0x00007f9941c2ceb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f9941c2ced0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 95 (LWP 12102):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000226808 in ?? ()
#4 0x00007f9942444eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f9942444ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 94 (LWP 12100):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00022000c in ?? ()
#4 0x00007f9942c5deb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f9942c5ded0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00021ffc0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f9942c5ded0 in ?? ()
#11 0x00007f9942c5dfa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 93 (LWP 12098):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 12097):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 12096):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 12094):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 12092):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 12091):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 12090):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 12087):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 12085):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 12084):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 12082):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 12081):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 12079):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 12078):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 12077):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 12076):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 12075):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 12074):
#0 0x00007f997edaead3 in ?? ()
#1 0x000000000000005d in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a688c in ?? ()
#4 0x00007f994be0deb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f994be0ded0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a6840 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f994be0ded0 in ?? ()
#11 0x00007f994be0dfa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 12073):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000027 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007f994c625eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f994c625ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f994c625ed0 in ?? ()
#11 0x00007f994c625fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 12072):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 73 (LWP 12071):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 12069):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 12067):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 12066):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 12061):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 12059):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 12058):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 12057):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 12055):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 12054):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 12053):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 12052):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 12050):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 12049):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 12048):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 12046):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 12045):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 12044):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007f9955feeeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f9955feeed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f9955feeed0 in ?? ()
#11 0x00007f9955feefa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 12041):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012003c in ?? ()
#4 0x00007f9956806eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f9956806ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011fff0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f9956806ed0 in ?? ()
#11 0x00007f9956806fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 54 (LWP 12038):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011684c in ?? ()
#4 0x00007f995701eeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f995701eed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000116800 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f995701eed0 in ?? ()
#11 0x00007f995701efa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 53 (LWP 12037):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 12036):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 12035):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 12033):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 12031):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 12030):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 12027):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 12025):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 12022):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 12021):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 12020):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 12018):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 12017):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 12016):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 12015):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 12013):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 12012):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 12011):
#0 0x00007f997edaead3 in ?? ()
#1 0x00000000000003bd in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007f99601cfeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f99601cfed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f99601cfed0 in ?? ()
#11 0x00007f99601cffa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 12010):
#0 0x00007f997edaead3 in ?? ()
#1 0x00000000000001d8 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009cff8 in ?? ()
#4 0x00007f99609e7eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f99609e7ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 34 (LWP 12009):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000263 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000967fc in ?? ()
#4 0x00007f99611ffeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f99611ffed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000967b0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f99611ffed0 in ?? ()
#11 0x00007f99611fffa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 12007):
#0 0x00007f997edaead3 in ?? ()
#1 0x00000000000001fd in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008fffc in ?? ()
#4 0x00007f9961a17eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f9961a17ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00008ffb0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f9961a17ed0 in ?? ()
#11 0x00007f9961a17fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 32 (LWP 12005):
#0 0x00007f997edaead3 in ?? ()
#1 0x00000000000001f7 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008680c in ?? ()
#4 0x00007f996222feb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f996222fed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000867c0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f996222fed0 in ?? ()
#11 0x00007f996222ffa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 31 (LWP 12004):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000239 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008000c in ?? ()
#4 0x00007f9962a47eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f9962a47ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00007ffc0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f9962a47ed0 in ?? ()
#11 0x00007f9962a47fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 30 (LWP 12003):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000100 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00007d018 in ?? ()
#4 0x00007f996325feb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f996325fed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 29 (LWP 12002):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000365 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00007681c in ?? ()
#4 0x00007f9963a77eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f9963a77ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000767d0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f9963a77ed0 in ?? ()
#11 0x00007f9963a77fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 28 (LWP 12001):
#0 0x00007f997edaead3 in ?? ()
#1 0x00000000000001c9 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00007001c in ?? ()
#4 0x00007f996428feb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f996428fed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00006ffd0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f996428fed0 in ?? ()
#11 0x00007f996428ffa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 27 (LWP 11998):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000275 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00006682c in ?? ()
#4 0x00007f9964aa6eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f9964aa6ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000667e0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f9964aa6ed0 in ?? ()
#11 0x00007f9964aa6fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 26 (LWP 11996):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000047 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00006002c in ?? ()
#4 0x00007f99652bdeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f99652bded0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00005ffe0 in ?? ()
#9 0x00007f997edae770 in ?? ()
#10 0x00007f99652bded0 in ?? ()
#11 0x00007f99652bdfa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 25 (LWP 11995):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 11994):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 11993):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 11991):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 11990):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 11989):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 11985):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 11984):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 11983):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 11982):
#0 0x00007f997edaefb9 in ?? ()
#1 0x00000000ffffffff in ?? ()
#2 0x0000000000000007 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000019760 in ?? ()
#5 0x00007f996a2ddd30 in ?? ()
#6 0x000000000000000e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 11981):
#0 0x00007f997edaefb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x000000000000000f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a618 in ?? ()
#5 0x00007f996aadf270 in ?? ()
#6 0x000000000000001e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 11980):
#0 0x00007f997edaefb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000007 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000618000004da8 in ?? ()
#5 0x00007f996b2df250 in ?? ()
#6 0x000000000000000e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 11979):
#0 0x00007f997edaead3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 11977):
#0 0x00007f9977d3e947 in ?? ()
#1 0x000061400000a480 in ?? ()
#2 0x0000619000059680 in ?? ()
#3 0x00007f996c2e2340 in ?? ()
#4 0x00007f996c2e2540 in ?? ()
#5 0x00007f996c2e2390 in ?? ()
#6 0x000061400000a480 in ?? ()
#7 0x00007f996c2e2400 in ?? ()
#8 0x00007f997a345bda in ?? ()
#9 0x3f65c036a0000000 in ?? ()
#10 0x0000619000059680 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059680 in ?? ()
#13 0x425a43a471000000 in ?? ()
#14 0x00007f996c2e2540 in ?? ()
#15 0x41da97978d7b0a9f in ?? ()
#16 0x00000000ad854480 in ?? ()
#17 0x00007f996c2e23e0 in ?? ()
#18 0x00007f997a349228 in ?? ()
#19 0x000000006c2e23c0 in ?? ()
#20 0x0000619000059680 in ?? ()
#21 0x000061400000a480 in ?? ()
#22 0x00007f996c2e2400 in ?? ()
#23 0x3f65c036a0000000 in ?? ()
#24 0x4137c2d6e8d6752d in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 11976):
#0 0x00007f9977d3e947 in ?? ()
#1 0x000061400000a280 in ?? ()
#2 0x0000619000059180 in ?? ()
#3 0x00007f996cae3340 in ?? ()
#4 0x00007f996cae3540 in ?? ()
#5 0x00007f996cae3390 in ?? ()
#6 0x000061400000a280 in ?? ()
#7 0x00007f996cae3400 in ?? ()
#8 0x00007f997a345bda in ?? ()
#9 0x3f8f5c2cf8000000 in ?? ()
#10 0x0000619000059180 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059180 in ?? ()
#13 0x4220c43feb000000 in ?? ()
#14 0x00007f996cae3540 in ?? ()
#15 0x41da97978d7b0aa0 in ?? ()
#16 0x00000000ad954680 in ?? ()
#17 0x00007f996cae33e0 in ?? ()
#18 0x00007f997a349228 in ?? ()
#19 0x000000006cae33c0 in ?? ()
#20 0x0000619000059180 in ?? ()
#21 0x000061400000a280 in ?? ()
#22 0x00007f996cae3400 in ?? ()
#23 0x3f8f5c2cf8000000 in ?? ()
#24 0x4137c2d6e661c463 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 11975):
#0 0x00007f9977d3e947 in ?? ()
#1 0x000061400000a080 in ?? ()
#2 0x0000619000058c80 in ?? ()
#3 0x00007f996d2e4340 in ?? ()
#4 0x00007f996d2e4540 in ?? ()
#5 0x00007f996d2e4390 in ?? ()
#6 0x000061400000a080 in ?? ()
#7 0x00007f996d2e4400 in ?? ()
#8 0x00007f997a345bda in ?? ()
#9 0x3f95004a20000000 in ?? ()
#10 0x0000619000058c80 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058c80 in ?? ()
#13 0x420c68b868000000 in ?? ()
#14 0x00007f996d2e4540 in ?? ()
#15 0x41da97978d7b0aa1 in ?? ()
#16 0x00000000ada54880 in ?? ()
#17 0x00007f996d2e43e0 in ?? ()
#18 0x00007f997a349228 in ?? ()
#19 0x000000006d2e43c0 in ?? ()
#20 0x0000619000058c80 in ?? ()
#21 0x000061400000a080 in ?? ()
#22 0x00007f996d2e4400 in ?? ()
#23 0x3f95004a20000000 in ?? ()
#24 0x4137c2d6e82a1215 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 11974):
#0 0x00007f9977d3e947 in ?? ()
#1 0x0000614000009e80 in ?? ()
#2 0x0000619000058780 in ?? ()
#3 0x00007f996e8ad340 in ?? ()
#4 0x00007f996e8ad540 in ?? ()
#5 0x00007f996e8ad390 in ?? ()
#6 0x0000614000009e80 in ?? ()
#7 0x00007f996e8ad400 in ?? ()
#8 0x00007f997a345bda in ?? ()
#9 0x3fa6bcbb64000000 in ?? ()
#10 0x0000619000058780 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058780 in ?? ()
#13 0x4258de79f6700000 in ?? ()
#14 0x00007f996e8ad540 in ?? ()
#15 0x41da97978d7b0a9f in ?? ()
#16 0x00000000add0da80 in ?? ()
#17 0x00007f996e8ad3e0 in ?? ()
#18 0x00007f997a349228 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 11967):
#0 0x00007f9977d31bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f99702b77d8 in ?? ()
#3 0x000060200004c5b0 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x0000000000823a92 in __sanitizer::theDepot ()
#7 0x0000000000000009 in ?? ()
#8 0x0000000000007da4 in ?? ()
#9 0x0000000000000000 in ?? ()
I20260807 18:16:45.025458 13959 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.026089 13959 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.028403 13959 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.047147 13966 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.047549 13966 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.050642 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:45.054118 13966 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.054476 13966 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.054795 13966 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.056704 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:45.057139 11880 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 1.
I20260807 18:16:45.061527 13966 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.062274 13976 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.062599 13976 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.064154 13976 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.064380 13976 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.064574 13976 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.064953 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:45.065395 12675 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 1.
I20260807 18:16:45.065467 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:45.065917 13976 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.067302 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:45.067484 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:45.067799 12245 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 1.
I20260807 18:16:45.067837 13972 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.068171 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:45.068117 13972 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.068599 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:45.068935 11790 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9; no voters:
I20260807 18:16:45.068933 13260 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 2.
I20260807 18:16:45.069547 13972 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077)
I20260807 18:16:45.070086 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:45.070083 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:45.070338 12246 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 1.
I20260807 18:16:45.070820 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:45.070920 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:45.071099 13969 raft_consensus.cc:2781] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 18:16:45.071200 12673 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 1.
I20260807 18:16:45.071223 13969 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.071354 13969 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:16:45.071879 12161 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9; no voters:
I20260807 18:16:45.072389 13966 raft_consensus.cc:2781] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 18:16:45.072404 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:45.072522 13966 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.072705 13966 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:16:45.076717 13966 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.078416 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:16:45.078440 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:45.078819 12246 raft_consensus.cc:2379] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14597aeb31024f3bacbdbb6a99a2800d in current term 2: Already voted for candidate 41f204b71daa453ea5e1226f14f422ca in this term.
I20260807 18:16:45.079497 13966 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 2 election: Requested vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.080242 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d"
I20260807 18:16:45.080528 12673 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:16:45.083318 13969 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.084280 12673 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 2.
I20260807 18:16:45.084766 11880 raft_consensus.cc:2379] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14597aeb31024f3bacbdbb6a99a2800d in current term 2: Already voted for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in this term.
I20260807 18:16:45.084820 13969 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 election: Requested vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.086292 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d"
I20260807 18:16:45.086483 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd"
I20260807 18:16:45.086716 12673 raft_consensus.cc:2379] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6a9cdd541bff40f98b3a280123bcc1a9 in current term 2: Already voted for candidate 41f204b71daa453ea5e1226f14f422ca in this term.
I20260807 18:16:45.087920 13959 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.088152 13959 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.089236 13959 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.091094 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:45.091351 11880 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 2.
I20260807 18:16:45.091604 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:16:45.092015 12246 raft_consensus.cc:2379] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6a9cdd541bff40f98b3a280123bcc1a9 in current term 2: Already voted for candidate 41f204b71daa453ea5e1226f14f422ca in this term.
I20260807 18:16:45.092339 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:45.093158 11790 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:45.093685 13969 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 18:16:45.094216 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:45.097107 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:45.098044 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:45.098096 12583 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d; no voters: 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:45.098338 13260 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 2.
I20260807 18:16:45.098623 13959 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:45.099409 12583 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 41f204b71daa453ea5e1226f14f422ca
I20260807 18:16:45.099602 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:45.099793 13959 raft_consensus.cc:2781] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 18:16:45.099893 13260 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 1.
I20260807 18:16:45.099927 13959 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.100018 13959 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:45.100368 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:45.100912 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd"
I20260807 18:16:45.101588 13966 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.101830 13966 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.103334 13966 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.103788 13959 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.104396 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:45.104727 11880 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 2.
I20260807 18:16:45.105065 13959 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 3 election: Requested vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.106043 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:16:45.106305 11880 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:45.106424 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:16:45.106709 12245 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:45.109920 11880 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 3.
I20260807 18:16:45.111244 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:45.111580 12673 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41f204b71daa453ea5e1226f14f422ca in current term 3: Already voted for candidate 14597aeb31024f3bacbdbb6a99a2800d in this term.
I20260807 18:16:45.111564 12245 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 3.
I20260807 18:16:45.111501 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:45.111850 13257 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 2.
I20260807 18:16:45.111924 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd"
I20260807 18:16:45.112140 13260 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:45.112290 12163 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 14597aeb31024f3bacbdbb6a99a2800d
I20260807 18:16:45.112936 13966 raft_consensus.cc:2741] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 18:16:45.113327 12580 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9; no voters:
I20260807 18:16:45.113714 13959 raft_consensus.cc:2781] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Leader election won for term 3
I20260807 18:16:45.114893 13959 raft_consensus.cc:686] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 3 LEADER]: Becoming Leader. State: Replica: 14597aeb31024f3bacbdbb6a99a2800d, State: Running, Role: LEADER
I20260807 18:16:45.115619 13959 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1969, Committed index: 1969, Last appended: 2.1969, Last appended by leader: 1969, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.116257 13260 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 3.
I20260807 18:16:45.119396 13959 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.119736 13959 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.120854 13959 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.122056 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:45.122139 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:45.122435 12245 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 1.
I20260807 18:16:45.122431 13260 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 1.
I20260807 18:16:45.123011 12580 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd; no voters:
I20260807 18:16:45.123391 13959 raft_consensus.cc:2781] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 18:16:45.123497 13959 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.123603 13959 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:16:45.124588 11298 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d reported cstate change: term changed from 2 to 3, leader changed from 22052958d03d426ebdc2fc310637c846 (127.10.253.68) to 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70). New cstate: current_term: 3 leader_uuid: "14597aeb31024f3bacbdbb6a99a2800d" committed_config { opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:45.126785 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:45.126885 13959 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.128695 13959 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 2 election: Requested vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.128796 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:16:45.129102 12245 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:16:45.132462 13972 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.132620 12245 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 2.
I20260807 18:16:45.132882 13972 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.134104 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd"
I20260807 18:16:45.134351 13972 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077)
I20260807 18:16:45.134454 13260 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:16:45.136278 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:45.136798 11881 raft_consensus.cc:2379] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 2: Already voted for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in this term.
I20260807 18:16:45.137387 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:45.137848 12246 raft_consensus.cc:2379] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 2: Already voted for candidate 41f204b71daa453ea5e1226f14f422ca in this term.
I20260807 18:16:45.138285 13969 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:45.138603 13969 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.139061 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:16:45.139508 11880 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:16:45.140390 13969 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:45.141261 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:45.142611 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:45.142978 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:45.143446 12675 raft_consensus.cc:2379] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 2: Already voted for candidate 41f204b71daa453ea5e1226f14f422ca in this term.
I20260807 18:16:45.144709 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:45.145167 12245 raft_consensus.cc:2379] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a9cdd541bff40f98b3a280123bcc1a9 in current term 2: Already voted for candidate 14597aeb31024f3bacbdbb6a99a2800d in this term.
I20260807 18:16:45.145874 13108 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:45.146373 13972 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:16:45.153271 11880 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 2.
I20260807 18:16:45.154338 12580 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9; no voters:
I20260807 18:16:45.155092 13959 raft_consensus.cc:2781] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:16:45.155359 13959 raft_consensus.cc:686] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 2 LEADER]: Becoming Leader. State: Replica: 14597aeb31024f3bacbdbb6a99a2800d, State: Running, Role: LEADER
I20260807 18:16:45.155390 13260 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 2.
I20260807 18:16:45.155887 13959 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1971, Committed index: 1971, Last appended: 1.1971, Last appended by leader: 1971, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.157553 13972 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:45.174003 11791 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:45.174521 13969 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:45.174950 11298 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d reported cstate change: term changed from 1 to 2, leader changed from 22052958d03d426ebdc2fc310637c846 (127.10.253.68) to 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70). New cstate: current_term: 2 leader_uuid: "14597aeb31024f3bacbdbb6a99a2800d" committed_config { opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:45.196062 11880 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Refusing update from remote peer 14597aeb31024f3bacbdbb6a99a2800d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1969. Preceding OpId from leader: term: 3 index: 1970. (index mismatch)
I20260807 18:16:45.197124 13959 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1970, Last known committed idx: 1969, Time since last communication: 0.000s
I20260807 18:16:45.220968 12245 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Refusing update from remote peer 14597aeb31024f3bacbdbb6a99a2800d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1969. Preceding OpId from leader: term: 3 index: 1970. (index mismatch)
I20260807 18:16:45.222059 13959 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1970, Last known committed idx: 1969, Time since last communication: 0.000s
I20260807 18:16:45.231633 13260 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 3 FOLLOWER]: Refusing update from remote peer 14597aeb31024f3bacbdbb6a99a2800d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1969. Preceding OpId from leader: term: 3 index: 1970. (index mismatch)
I20260807 18:16:45.232575 13959 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1970, Last known committed idx: 1969, Time since last communication: 0.000s
I20260807 18:16:45.267665 13257 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Refusing update from remote peer 14597aeb31024f3bacbdbb6a99a2800d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1971. Preceding OpId from leader: term: 2 index: 1972. (index mismatch)
I20260807 18:16:45.269062 13980 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1972, Last known committed idx: 1971, Time since last communication: 0.000s
I20260807 18:16:45.271620 12245 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Refusing update from remote peer 14597aeb31024f3bacbdbb6a99a2800d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1971. Preceding OpId from leader: term: 2 index: 1972. (index mismatch)
I20260807 18:16:45.272598 13959 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1972, Last known committed idx: 1971, Time since last communication: 0.000s
I20260807 18:16:45.272953 11880 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Refusing update from remote peer 14597aeb31024f3bacbdbb6a99a2800d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1971. Preceding OpId from leader: term: 2 index: 1972. (index mismatch)
I20260807 18:16:45.275372 13999 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1972, Last known committed idx: 1971, Time since last communication: 0.000s
Thread 7 (LWP 11966):
#0 0x00007f997edaefb9 in ?? ()
#1 0x3ff0000000000000 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a228 in ?? ()
#5 0x00007f996fab60d0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 6 (LWP 11965):
#0 0x00007f997edb29e2 in ?? ()
#1 0x00007f996f2b4430 in ?? ()
#2 0x00007f996f2b3f20 in ?? ()
#3 0x00007f996f2b3650 in ?? ()
#4 0x00007f996f2b51c0 in ?? ()
#5 0x00007f996f2b3ed0 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x00007f996f2b3f30 in ?? ()
#8 0x000061100005a2d0 in ?? ()
#9 0x00007f996f2b3f20 in ?? ()
#10 0x000000000081de90 in __sanitizer::theDepot ()
#11 0x00007f9984576269 in ?? ()
#12 0x00000000009edb7d in __sanitizer::theDepot ()
#13 0x00007f997baceeaf in ?? ()
#14 0x00007f997eda86db in ?? ()
#15 0x00007f996f2b36b0 in ?? ()
#16 0x00007f9984584e61 in ?? ()
#17 0x00007f996f2b3770 in ?? ()
#18 0x0000000000000003 in ?? ()
#19 0x0000000000000003 in ?? ()
#20 0x00000c2000001c59 in ?? ()
#21 0x000061100005a2e0 in ?? ()
#22 0x000060d0004d67f8 in ?? ()
#23 0x0000000000000080 in ?? ()
#24 0x000061000000e240 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 5 (LWP 11957):
#0 0x00007f997edaefb9 in ?? ()
#1 0x00007f99712b8c90 in ?? ()
#2 0x0000000000000185 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001ab28 in ?? ()
#5 0x00007f99712b8cd0 in ?? ()
#6 0x000000000000030a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 11953):
#0 0x00007f997edaefb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 11952):
#0 0x00007f997edaefb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 11950):
#0 0x00007f997edaefb9 in ?? ()
#1 0x0000000000008000 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000009838 in ?? ()
#5 0x00007f9972abc450 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 11949):
#0 0x00007f997edb2d50 in ?? ()
#1 0x0000000000000000 in ?? ()
I20260807 18:16:45.376299 11880 raft_consensus.cc:1226] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 2. Current term is 3. Ops: []
I20260807 18:16:45.376910 11881 raft_consensus.cc:1226] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 1. Current term is 2. Ops: []
I20260807 18:16:45.376961 12246 raft_consensus.cc:1226] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 1. Current term is 2. Ops: []
I20260807 18:16:45.377128 12247 raft_consensus.cc:1226] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 1. Current term is 2. Ops: []
I20260807 18:16:45.378012 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.378227 12072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.378091 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.381172 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.381899 12072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.382004 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:16:45.382602 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.382647 12072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:16:45.383100 12160 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.253.68:43889 timed out after 0.303s (SENT)
************************* END STACKS ***************************
I20260807 18:16:45.385715 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:16:45.385787 11253 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 4 with UUID 41f204b71daa453ea5e1226f14f422ca and pid 12137
I20260807 18:16:45.385923 12245 raft_consensus.cc:1226] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 2. Current term is 3. Ops: []
I20260807 18:16:45.386152 12072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.387239 12072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:16:45.387538 13257 raft_consensus.cc:1226] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 1. Current term is 2. Ops: []
I20260807 18:16:45.388448 12072 raft_consensus.cc:3032] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 18:16:45.388593 13257 raft_consensus.cc:1226] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 3 FOLLOWER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 2. Current term is 3. Ops: []
I20260807 18:16:45.388583 12072 raft_consensus.cc:729] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22052958d03d426ebdc2fc310637c846, State: Running, Role: LEADER
I20260807 18:16:45.389024 12072 consensus_queue.cc:260] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1969, Committed index: 1969, Last appended: 2.1969, Last appended by leader: 1969, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.389245 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.389511 12072 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:45.389814 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.390832 12673 raft_consensus.cc:1226] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 1. Current term is 2. Ops: []
I20260807 18:16:45.390936 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:16:45.391587 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1969 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.391752 12675 raft_consensus.cc:1226] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 3 LEADER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 2. Current term is 3. Ops: []
I20260807 18:16:45.392503 14012 consensus_queue.cc:1046] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.1971, Next index: 1972, Last known committed idx: 1971, Time since last communication: 0.000s
I20260807 18:16:45.392786 13257 raft_consensus.cc:1226] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 1. Current term is 2. Ops: []
I20260807 18:16:45.393160 14009 raft_consensus.cc:3032] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 18:16:45.393293 14009 raft_consensus.cc:729] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22052958d03d426ebdc2fc310637c846, State: Running, Role: LEADER
I20260807 18:16:45.393707 14009 consensus_queue.cc:260] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1971, Committed index: 1971, Last appended: 1.1971, Last appended by leader: 1971, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.394418 12675 raft_consensus.cc:1226] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 2 LEADER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 1. Current term is 2. Ops: []
I20260807 18:16:45.394424 14009 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:16:45.394312 14010 consensus_queue.cc:1046] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.1971, Next index: 1972, Last known committed idx: 1972, Time since last communication: 0.000s
I20260807 18:16:45.395017 14011 raft_consensus.cc:3032] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 18:16:45.395159 14011 raft_consensus.cc:729] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22052958d03d426ebdc2fc310637c846, State: Running, Role: LEADER
I20260807 18:16:45.395478 14011 consensus_queue.cc:260] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1971, Committed index: 1971, Last appended: 1.1971, Last appended by leader: 1971, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.395977 14011 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 1 FOLLOWER]: Advancing to term 2
W20260807 18:16:45.396478 12580 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.253.68:43889 timed out after 0.368s (SENT)
I20260807 18:16:45.399150 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:16:45.400285 12074 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Refusing update from remote peer 14597aeb31024f3bacbdbb6a99a2800d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1971. Preceding OpId from leader: term: 2 index: 1972. (index mismatch)
I20260807 18:16:45.400893 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:45.400913 11790 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca
I20260807 18:16:45.401731 13972 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:16:45.402150 11881 raft_consensus.cc:1226] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Rejecting Update request from peer 22052958d03d426ebdc2fc310637c846 for earlier term 1. Current term is 2. Ops: []
I20260807 18:16:45.403436 13969 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 18:16:45.403740 12072 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Refusing update from remote peer 14597aeb31024f3bacbdbb6a99a2800d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1969. Preceding OpId from leader: term: 3 index: 1970. (index mismatch)
I20260807 18:16:45.406774 12073 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 2.
I20260807 18:16:45.407341 12160 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 5 responses out of 5 voters: 3 yes votes; 2 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca; no voters: 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:45.407614 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.407769 13966 raft_consensus.cc:2781] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:16:45.407938 13966 raft_consensus.cc:686] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 2 LEADER]: Becoming Leader. State: Replica: 41f204b71daa453ea5e1226f14f422ca, State: Running, Role: LEADER
I20260807 18:16:45.407939 12073 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 2.
I20260807 18:16:45.408531 13966 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1971, Committed index: 1971, Last appended: 1.1971, Last appended by leader: 1971, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.414369 12160 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 5 responses out of 5 voters: 3 yes votes; 2 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:45.414320 13980 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1972, Last known committed idx: 1971, Time since last communication: 0.000s
I20260807 18:16:45.414899 13971 raft_consensus.cc:2741] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 18:16:45.415283 13980 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1970, Last known committed idx: 1969, Time since last communication: 0.000s
I20260807 18:16:45.416836 12073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.417344 12073 raft_consensus.cc:2379] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14597aeb31024f3bacbdbb6a99a2800d in current term 2: Already voted for candidate 41f204b71daa453ea5e1226f14f422ca in this term.
I20260807 18:16:45.427042 11291 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca reported cstate change: term changed from 1 to 2, leader changed from 22052958d03d426ebdc2fc310637c846 (127.10.253.68) to 41f204b71daa453ea5e1226f14f422ca (127.10.253.69). New cstate: current_term: 2 leader_uuid: "41f204b71daa453ea5e1226f14f422ca" committed_config { opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:45.462332 13972 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:45.462661 13972 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.463721 13972 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077)
I20260807 18:16:45.465236 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:45.465600 11881 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 2.
I20260807 18:16:45.466389 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:45.468104 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:45.468151 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:45.468470 12675 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 2.
I20260807 18:16:45.468528 12074 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 2.
I20260807 18:16:45.469129 13108 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 41f204b71daa453ea5e1226f14f422ca
I20260807 18:16:45.469906 13972 raft_consensus.cc:2781] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 18:16:45.470034 13972 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:16:45.470124 13972 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:45.473515 13972 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.474993 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:16:45.475275 11881 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:45.478848 11881 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 3.
I20260807 18:16:45.480530 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:16:45.480871 12074 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:45.480772 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:16:45.484477 13972 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 election: Requested vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077)
I20260807 18:16:45.487274 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d"
I20260807 18:16:45.487660 12675 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:45.490084 12074 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 3.
I20260807 18:16:45.491139 13107 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 41f204b71daa453ea5e1226f14f422ca
I20260807 18:16:45.491814 13972 raft_consensus.cc:2781] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 3 FOLLOWER]: Leader election won for term 3
I20260807 18:16:45.492319 11881 raft_consensus.cc:1226] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Rejecting Update request from peer 41f204b71daa453ea5e1226f14f422ca for earlier term 2. Current term is 3. Ops: []
I20260807 18:16:45.493777 13966 consensus_queue.cc:1046] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1972, Last known committed idx: 1971, Time since last communication: 0.000s
I20260807 18:16:45.494441 13966 raft_consensus.cc:3032] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 2 LEADER]: Stepping down as leader of term 2
I20260807 18:16:45.494609 13966 raft_consensus.cc:729] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41f204b71daa453ea5e1226f14f422ca, State: Running, Role: LEADER
I20260807 18:16:45.495074 13966 consensus_queue.cc:260] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1971, Committed index: 1971, Last appended: 2.1972, Last appended by leader: 1972, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.495788 12675 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da72adf57546f5bab0a028672a51dd in term 3.
I20260807 18:16:45.497828 13966 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:45.508437 13972 raft_consensus.cc:686] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 3 LEADER]: Becoming Leader. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Running, Role: LEADER
I20260807 18:16:45.509114 13972 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1971, Committed index: 1971, Last appended: 1.1971, Last appended by leader: 1971, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:45.521224 13257 raft_consensus.cc:1226] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 3 LEADER]: Rejecting Update request from peer 41f204b71daa453ea5e1226f14f422ca for earlier term 2. Current term is 3. Ops: []
I20260807 18:16:45.524432 11291 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd reported cstate change: term changed from 2 to 3, leader changed from 41f204b71daa453ea5e1226f14f422ca (127.10.253.69) to 50da72adf57546f5bab0a028672a51dd (127.10.253.65). New cstate: current_term: 3 leader_uuid: "50da72adf57546f5bab0a028672a51dd" committed_config { opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 18:16:45.590736 12675 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Refusing update from remote peer 50da72adf57546f5bab0a028672a51dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1971. Preceding OpId from leader: term: 3 index: 1972. (index mismatch)
I20260807 18:16:45.591912 13972 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1972, Last known committed idx: 1971, Time since last communication: 0.000s
I20260807 18:16:45.608623 11881 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Refusing update from remote peer 50da72adf57546f5bab0a028672a51dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1971. Preceding OpId from leader: term: 3 index: 1972. (index mismatch)
I20260807 18:16:45.609635 13972 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1972, Last known committed idx: 1971, Time since last communication: 0.000s
I20260807 18:16:45.629611 12245 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Refusing update from remote peer 50da72adf57546f5bab0a028672a51dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1972. Preceding OpId from leader: term: 3 index: 1972. (term mismatch)
I20260807 18:16:45.629792 12245 pending_rounds.cc:76] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca: Aborting all ops after (but not including) 1971
I20260807 18:16:45.629884 12245 pending_rounds.cc:97] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca: Aborting uncommitted NO_OP operation due to leader change: 2.1972
I20260807 18:16:45.629966 12245 raft_consensus.cc:2866] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 18:16:45.631134 13972 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1972, Last known committed idx: 1971, Time since last communication: 0.000s
I20260807 18:16:45.640671 12074 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Refusing update from remote peer 50da72adf57546f5bab0a028672a51dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1971. Preceding OpId from leader: term: 3 index: 1972. (index mismatch)
I20260807 18:16:45.642488 14036 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1972, Last known committed idx: 1971, Time since last communication: 0.000s
************************ BEGIN STACKS **************************
W20260807 18:16:45.748216 11285 catalog_manager.cc:4584] TS b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 874ba119c7284c4d8a113d6654e0c39e: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
[New LWP 12138]
[New LWP 12139]
[New LWP 12140]
[New LWP 12142]
[New LWP 12151]
[New LWP 12152]
[New LWP 12153]
[New LWP 12160]
[New LWP 12161]
[New LWP 12162]
[New LWP 12163]
[New LWP 12165]
[New LWP 12166]
[New LWP 12167]
[New LWP 12168]
[New LWP 12169]
[New LWP 12170]
[New LWP 12172]
[New LWP 12173]
[New LWP 12174]
[New LWP 12175]
[New LWP 12177]
[New LWP 12178]
[New LWP 12179]
[New LWP 12181]
[New LWP 12183]
[New LWP 12185]
[New LWP 12187]
[New LWP 12188]
[New LWP 12189]
[New LWP 12190]
[New LWP 12191]
[New LWP 12194]
[New LWP 12195]
[New LWP 12196]
[New LWP 12197]
[New LWP 12200]
[New LWP 12201]
[New LWP 12202]
[New LWP 12203]
[New LWP 12204]
[New LWP 12205]
[New LWP 12206]
[New LWP 12207]
[New LWP 12208]
[New LWP 12209]
[New LWP 12210]
[New LWP 12211]
[New LWP 12212]
[New LWP 12216]
[New LWP 12217]
[New LWP 12218]
[New LWP 12219]
[New LWP 12221]
[New LWP 12223]
[New LWP 12225]
[New LWP 12226]
[New LWP 12227]
[New LWP 12230]
[New LWP 12231]
[New LWP 12232]
[New LWP 12234]
[New LWP 12235]
[New LWP 12236]
[New LWP 12237]
[New LWP 12238]
[New LWP 12239]
[New LWP 12240]
[New LWP 12243]
[New LWP 12245]
[New LWP 12246]
[New LWP 12247]
[New LWP 12249]
[New LWP 12250]
[New LWP 12251]
[New LWP 12253]
[New LWP 12254]
[New LWP 12255]
[New LWP 12257]
[New LWP 12258]
[New LWP 12259]
[New LWP 12260]
[New LWP 12261]
[New LWP 12262]
[New LWP 12263]
[New LWP 12264]
[New LWP 12265]
[New LWP 12267]
[New LWP 12268]
[New LWP 12269]
[New LWP 12271]
[New LWP 12272]
[New LWP 12273]
[New LWP 12274]
[New LWP 12277]
[New LWP 12278]
[New LWP 12279]
[New LWP 12281]
[New LWP 12283]
[New LWP 12285]
[New LWP 12286]
[New LWP 12287]
[New LWP 12288]
[New LWP 12289]
[New LWP 12290]
[New LWP 12291]
[New LWP 12292]
[New LWP 12293]
[New LWP 12295]
[New LWP 12297]
[New LWP 12298]
[New LWP 12299]
[New LWP 12300]
[New LWP 12301]
[New LWP 12303]
[New LWP 12305]
[New LWP 12306]
[New LWP 12310]
[New LWP 12311]
[New LWP 12312]
[New LWP 12313]
[New LWP 14019]
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
0x00007feb45447d50 in ?? ()
Id Target Id Frame
* 1 LWP 12137 "kudu" 0x00007feb45447d50 in ?? ()
2 LWP 12138 "kudu" 0x00007feb45443fb9 in ?? ()
3 LWP 12139 "kudu" 0x00007feb45443fb9 in ?? ()
4 LWP 12140 "kudu" 0x00007feb45443fb9 in ?? ()
5 LWP 12142 "kernel-watcher-" 0x00007feb45443fb9 in ?? ()
6 LWP 12151 "ntp client-1215" 0x00007feb454479e2 in ?? ()
7 LWP 12152 "file cache-evic" 0x00007feb45443fb9 in ?? ()
8 LWP 12153 "sq_acceptor" 0x00007feb3e3c6bb9 in ?? ()
9 LWP 12160 "rpc reactor-121" 0x00007feb3e3d3947 in ?? ()
10 LWP 12161 "rpc reactor-121" 0x00007feb3e3d3947 in ?? ()
11 LWP 12162 "rpc reactor-121" 0x00007feb3e3d3947 in ?? ()
12 LWP 12163 "rpc reactor-121" 0x00007feb3e3d3947 in ?? ()
13 LWP 12165 "MaintenanceMgr " 0x00007feb45443ad3 in ?? ()
14 LWP 12166 "txn-status-mana" 0x00007feb45443fb9 in ?? ()
15 LWP 12167 "collect_and_rem" 0x00007feb45443fb9 in ?? ()
16 LWP 12168 "tc-session-exp-" 0x00007feb45443fb9 in ?? ()
17 LWP 12169 "rpc worker-1216" 0x00007feb45443ad3 in ?? ()
18 LWP 12170 "rpc worker-1217" 0x00007feb45443ad3 in ?? ()
19 LWP 12172 "rpc worker-1217" 0x00007feb45443ad3 in ?? ()
20 LWP 12173 "rpc worker-1217" 0x00007feb45443ad3 in ?? ()
21 LWP 12174 "rpc worker-1217" 0x00007feb45443ad3 in ?? ()
22 LWP 12175 "rpc worker-1217" 0x00007feb45443ad3 in ?? ()
23 LWP 12177 "rpc worker-1217" 0x00007feb45443ad3 in ?? ()
24 LWP 12178 "rpc worker-1217" 0x00007feb45443ad3 in ?? ()
25 LWP 12179 "rpc worker-1217" 0x00007feb45443ad3 in ?? ()
26 LWP 12181 "rpc worker-1218" 0x00007feb45443ad3 in ?? ()
27 LWP 12183 "rpc worker-1218" 0x00007feb45443ad3 in ?? ()
28 LWP 12185 "rpc worker-1218" 0x00007feb45443ad3 in ?? ()
29 LWP 12187 "rpc worker-1218" 0x00007feb45443ad3 in ?? ()
30 LWP 12188 "rpc worker-1218" 0x00007feb45443ad3 in ?? ()
31 LWP 12189 "rpc worker-1218" 0x00007feb45443ad3 in ?? ()
32 LWP 12190 "rpc worker-1219" 0x00007feb45443ad3 in ?? ()
33 LWP 12191 "rpc worker-1219" 0x00007feb45443ad3 in ?? ()
34 LWP 12194 "rpc worker-1219" 0x00007feb45443ad3 in ?? ()
35 LWP 12195 "rpc worker-1219" 0x00007feb45443ad3 in ?? ()
36 LWP 12196 "rpc worker-1219" 0x00007feb45443ad3 in ?? ()
37 LWP 12197 "rpc worker-1219" 0x00007feb45443ad3 in ?? ()
38 LWP 12200 "rpc worker-1220" 0x00007feb45443ad3 in ?? ()
39 LWP 12201 "rpc worker-1220" 0x00007feb45443ad3 in ?? ()
40 LWP 12202 "rpc worker-1220" 0x00007feb45443ad3 in ?? ()
41 LWP 12203 "rpc worker-1220" 0x00007feb45443ad3 in ?? ()
42 LWP 12204 "rpc worker-1220" 0x00007feb45443ad3 in ?? ()
43 LWP 12205 "rpc worker-1220" 0x00007feb45443ad3 in ?? ()
44 LWP 12206 "rpc worker-1220" 0x00007feb45443ad3 in ?? ()
45 LWP 12207 "rpc worker-1220" 0x00007feb45443ad3 in ?? ()
46 LWP 12208 "rpc worker-1220" 0x00007feb45443ad3 in ?? ()
47 LWP 12209 "rpc worker-1220" 0x00007feb45443ad3 in ?? ()
48 LWP 12210 "rpc worker-1221" 0x00007feb45443ad3 in ?? ()
49 LWP 12211 "rpc worker-1221" 0x00007feb45443ad3 in ?? ()
50 LWP 12212 "rpc worker-1221" 0x00007feb45443ad3 in ?? ()
51 LWP 12216 "rpc worker-1221" 0x00007feb45443ad3 in ?? ()
52 LWP 12217 "rpc worker-1221" 0x00007feb45443ad3 in ?? ()
53 LWP 12218 "rpc worker-1221" 0x00007feb45443ad3 in ?? ()
54 LWP 12219 "rpc worker-1221" 0x00007feb45443ad3 in ?? ()
55 LWP 12221 "rpc worker-1222" 0x00007feb45443ad3 in ?? ()
56 LWP 12223 "rpc worker-1222" 0x00007feb45443ad3 in ?? ()
57 LWP 12225 "rpc worker-1222" 0x00007feb45443ad3 in ?? ()
58 LWP 12226 "rpc worker-1222" 0x00007feb45443ad3 in ?? ()
59 LWP 12227 "rpc worker-1222" 0x00007feb45443ad3 in ?? ()
60 LWP 12230 "rpc worker-1223" 0x00007feb45443ad3 in ?? ()
61 LWP 12231 "rpc worker-1223" 0x00007feb45443ad3 in ?? ()
62 LWP 12232 "rpc worker-1223" 0x00007feb45443ad3 in ?? ()
63 LWP 12234 "rpc worker-1223" 0x00007feb45443ad3 in ?? ()
64 LWP 12235 "rpc worker-1223" 0x00007feb45443ad3 in ?? ()
65 LWP 12236 "rpc worker-1223" 0x00007feb45443ad3 in ?? ()
66 LWP 12237 "rpc worker-1223" 0x00007feb45443ad3 in ?? ()
67 LWP 12238 "rpc worker-1223" 0x00007feb45443ad3 in ?? ()
68 LWP 12239 "rpc worker-1223" 0x00007feb45443ad3 in ?? ()
69 LWP 12240 "rpc worker-1224" 0x00007feb45443ad3 in ?? ()
70 LWP 12243 "rpc worker-1224" 0x00007feb45443ad3 in ?? ()
71 LWP 12245 "rpc worker-1224" 0x00007feb45443ad3 in ?? ()
72 LWP 12246 "rpc worker-1224" 0x00007feb45443ad3 in ?? ()
73 LWP 12247 "rpc worker-1224" 0x00007feb45443ad3 in ?? ()
74 LWP 12249 "rpc worker-1224" 0x00007feb45443ad3 in ?? ()
75 LWP 12250 "rpc worker-1225" 0x00007feb45443ad3 in ?? ()
76 LWP 12251 "rpc worker-1225" 0x00007feb45443ad3 in ?? ()
77 LWP 12253 "rpc worker-1225" 0x00007feb45443ad3 in ?? ()
78 LWP 12254 "rpc worker-1225" 0x00007feb45443ad3 in ?? ()
79 LWP 12255 "rpc worker-1225" 0x00007feb45443ad3 in ?? ()
80 LWP 12257 "rpc worker-1225" 0x00007feb45443ad3 in ?? ()
81 LWP 12258 "rpc worker-1225" 0x00007feb45443ad3 in ?? ()
82 LWP 12259 "rpc worker-1225" 0x00007feb45443ad3 in ?? ()
83 LWP 12260 "rpc worker-1226" 0x00007feb45443ad3 in ?? ()
84 LWP 12261 "rpc worker-1226" 0x00007feb45443ad3 in ?? ()
85 LWP 12262 "rpc worker-1226" 0x00007feb45443ad3 in ?? ()
86 LWP 12263 "rpc worker-1226" 0x00007feb45443ad3 in ?? ()
87 LWP 12264 "rpc worker-1226" 0x00007feb45443ad3 in ?? ()
88 LWP 12265 "rpc worker-1226" 0x00007feb45443ad3 in ?? ()
89 LWP 12267 "rpc worker-1226" 0x00007feb45443ad3 in ?? ()
90 LWP 12268 "rpc worker-1226" 0x00007feb45443ad3 in ?? ()
91 LWP 12269 "rpc worker-1226" 0x00007feb45443ad3 in ?? ()
92 LWP 12271 "rpc worker-1227" 0x00007feb45443ad3 in ?? ()
93 LWP 12272 "rpc worker-1227" 0x00007feb45443ad3 in ?? ()
94 LWP 12273 "rpc worker-1227" 0x00007feb45443ad3 in ?? ()
95 LWP 12274 "rpc worker-1227" 0x00007feb45443ad3 in ?? ()
96 LWP 12277 "rpc worker-1227" 0x00007feb45443ad3 in ?? ()
97 LWP 12278 "rpc worker-1227" 0x00007feb45443ad3 in ?? ()
98 LWP 12279 "rpc worker-1227" 0x00007feb45443ad3 in ?? ()
99 LWP 12281 "rpc worker-1228" 0x00007feb45443ad3 in ?? ()
100 LWP 12283 "rpc worker-1228" 0x00007feb45443ad3 in ?? ()
101 LWP 12285 "rpc worker-1228" 0x00007feb45443ad3 in ?? ()
102 LWP 12286 "rpc worker-1228" 0x00007feb45443ad3 in ?? ()
103 LWP 12287 "rpc worker-1228" 0x00007feb45443ad3 in ?? ()
104 LWP 12288 "rpc worker-1228" 0x00007feb45443ad3 in ?? ()
105 LWP 12289 "rpc worker-1228" 0x00007feb45443ad3 in ?? ()
106 LWP 12290 "rpc worker-1229" 0x00007feb45443ad3 in ?? ()
107 LWP 12291 "rpc worker-1229" 0x00007feb45443ad3 in ?? ()
108 LWP 12292 "rpc worker-1229" 0x00007feb45443ad3 in ?? ()
109 LWP 12293 "rpc worker-1229" 0x00007feb45443ad3 in ?? ()
110 LWP 12295 "rpc worker-1229" 0x00007feb45443ad3 in ?? ()
111 LWP 12297 "rpc worker-1229" 0x00007feb45443ad3 in ?? ()
112 LWP 12298 "rpc worker-1229" 0x00007feb45443ad3 in ?? ()
113 LWP 12299 "rpc worker-1229" 0x00007feb45443ad3 in ?? ()
114 LWP 12300 "rpc worker-1230" 0x00007feb45443ad3 in ?? ()
115 LWP 12301 "rpc worker-1230" 0x00007feb45443ad3 in ?? ()
116 LWP 12303 "rpc worker-1230" 0x00007feb45443ad3 in ?? ()
117 LWP 12305 "diag-logger-123" 0x00007feb45443fb9 in ?? ()
118 LWP 12306 "result-tracker-" 0x00007feb45443fb9 in ?? ()
119 LWP 12310 "excess-log-dele" 0x00007feb45443fb9 in ?? ()
120 LWP 12311 "acceptor-12311" 0x00007feb3e3d4fc7 in ?? ()
121 LWP 12312 "heartbeat-12312" 0x00007feb45443fb9 in ?? ()
122 LWP 12313 "maintenance_sch" 0x00007feb45443fb9 in ?? ()
123 LWP 14019 "wal-append [wor" 0x00007feb45443fb9 in ?? ()
Thread 123 (LWP 14019):
#0 0x00007feb45443fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 122 (LWP 12313):
#0 0x00007feb45443fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 121 (LWP 12312):
#0 0x00007feb45443fb9 in ?? ()
#1 0xffffffffffffffff in ?? ()
#2 0x0000000000000065 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000018ea8 in ?? ()
#5 0x00007feafb848770 in ?? ()
#6 0x00000000000000ca in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 12311):
#0 0x00007feb3e3d4fc7 in ?? ()
#1 0x000061400000a290 in ?? ()
#2 0x00007feafc06ffa0 in ?? ()
#3 0x00007feafc06ffc0 in ?? ()
#4 0x00007feafc0700e0 in ?? ()
#5 0x00007feafc06ffd0 in ?? ()
#6 0x00007feafc070040 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x000000000082c9d2 in __sanitizer::theDepot ()
#9 0x00007feafc06f810 in ?? ()
#10 0x0000000000897749 in __sanitizer::theDepot ()
#11 0x00006030001691a0 in ?? ()
#12 0x0000000000895799 in __sanitizer::theDepot ()
#13 0x00007feafb864000 in ?? ()
#14 0x00000000007f9cf9 in __sanitizer::theDepot ()
#15 0x000000000000001e in ?? ()
#16 0x00007feafc06f810 in ?? ()
#17 0x00007feafb8640e0 in ?? ()
#18 0x00007feafc06f810 in ?? ()
#19 0x00007feafc06f9e0 in ?? ()
#20 0x00007feafb864000 in ?? ()
#21 0x00000ffd5f80dfec in ?? ()
#22 0x00007feafc06f810 in ?? ()
#23 0x00007feafc070050 in ?? ()
#24 0x00006030001691b0 in ?? ()
#25 0x000000000000001e in ?? ()
#26 0x0000000000000001 in ?? ()
#27 0x00006030001691c8 in ?? ()
#28 0x00000000008c4651 in __sanitizer::theDepot ()
#29 0x00007feafc06f820 in ?? ()
#30 0x000000000000000d in ?? ()
#31 0x00000000008c4681 in __sanitizer::theDepot ()
#32 0x00007feb420a78c1 in ?? ()
#33 0x00007feb420a78a1 in ?? ()
#34 0x00007feb420a7873 in ?? ()
#35 0x00007feb420a77e7 in ?? ()
#36 0x00007feb420a647b in ?? ()
#37 0x00007feb420a5133 in ?? ()
#38 0x00007feaf9ff7d40 in ?? ()
#39 0x0000000000000000 in ?? ()
Thread 119 (LWP 12310):
#0 0x00007feb45443fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 118 (LWP 12306):
#0 0x00007feb45443fb9 in ?? ()
#1 0x00007feafd0a2160 in ?? ()
#2 0x000000000000004e in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100006ec30 in ?? ()
#5 0x00007feafd0a2110 in ?? ()
#6 0x000000000000009c in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 12305):
#0 0x00007feb45443fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 12303):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 12301):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 12300):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 12299):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 12298):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 12297):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 12295):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 12293):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 12292):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 12291):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 12290):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 12289):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 12288):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 12287):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 12286):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 12285):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 12283):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 12281):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 12279):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 12278):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 12277):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 12274):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 12273):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 12272):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 12271):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 12269):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 12268):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 12267):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 12265):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 12264):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 12263):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 12262):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 12261):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 12260):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 12259):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 12258):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 12257):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 12255):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 12254):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 12253):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 12251):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000005 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a688c in ?? ()
#4 0x00007feb124a2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007feb124a2ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a6840 in ?? ()
#9 0x00007feb45443770 in ?? ()
#10 0x00007feb124a2ed0 in ?? ()
#11 0x00007feb124a2fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 12250):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000005 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007feb12cbaeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007feb12cbaed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007feb45443770 in ?? ()
#10 0x00007feb12cbaed0 in ?? ()
#11 0x00007feb12cbafa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 12249):
#0 0x00007feb45443ad3 in ?? ()
#1 0x00000000000004ab in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001967cc in ?? ()
#4 0x00007feb134d2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007feb134d2ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000196780 in ?? ()
#9 0x00007feb45443770 in ?? ()
#10 0x00007feb134d2ed0 in ?? ()
#11 0x00007feb134d2fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 73 (LWP 12247):
#0 0x00007feb45443ad3 in ?? ()
#1 0x000000000000041c in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00018ffc8 in ?? ()
#4 0x00007feb13ceaeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007feb13ceaed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 72 (LWP 12246):
#0 0x00007feb45443ad3 in ?? ()
#1 0x00000000000007e4 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00018cfd8 in ?? ()
#4 0x00007feb14502eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007feb14502ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 71 (LWP 12245):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000630 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001867d8 in ?? ()
#4 0x00007feb14d1aeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007feb14d1aed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 70 (LWP 12243):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00017ffdc in ?? ()
#4 0x00007feb15532eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007feb15532ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00017ff90 in ?? ()
#9 0x00007feb45443770 in ?? ()
#10 0x00007feb15532ed0 in ?? ()
#11 0x00007feb15532fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 69 (LWP 12240):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 12239):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 12238):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 12237):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 12236):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 12235):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 12234):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 12232):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 12231):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 12230):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 12227):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 12226):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 12225):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 12223):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007feb1c683eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007feb1c683ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007feb45443770 in ?? ()
#10 0x00007feb1c683ed0 in ?? ()
#11 0x00007feb1c683fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 12221):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012003c in ?? ()
#4 0x00007feb1ce9beb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007feb1ce9bed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011fff0 in ?? ()
#9 0x00007feb45443770 in ?? ()
#10 0x00007feb1ce9bed0 in ?? ()
#11 0x00007feb1ce9bfa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 54 (LWP 12219):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011684c in ?? ()
#4 0x00007feb1d6b3eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007feb1d6b3ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000116800 in ?? ()
#9 0x00007feb45443770 in ?? ()
#10 0x00007feb1d6b3ed0 in ?? ()
#11 0x00007feb1d6b3fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 53 (LWP 12218):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 12217):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 12216):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 12212):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 12211):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 12210):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 12209):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 12208):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 12207):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 12206):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 12205):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 12204):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 12203):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 12202):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 12201):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 12200):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 12197):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 12196):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000018 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009ffe8 in ?? ()
#4 0x00007feb26864eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007feb26864ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 12195):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 34 (LWP 12194):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 12191):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 12190):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 12189):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 12188):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 12187):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 12185):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 12183):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 12181):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 12179):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 12178):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 12177):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 12175):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 12174):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 12173):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 12172):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 12170):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 12169):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 12168):
#0 0x00007feb45443fb9 in ?? ()
#1 0x00000000ffffffff in ?? ()
#2 0x0000000000000007 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000019760 in ?? ()
#5 0x00007feb309ddd30 in ?? ()
#6 0x000000000000000e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 12167):
#0 0x00007feb45443fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x000000000000000f in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a618 in ?? ()
#5 0x00007feb311df270 in ?? ()
#6 0x000000000000001e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 12166):
#0 0x00007feb45443fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000007 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000618000004da8 in ?? ()
#5 0x00007feb319df250 in ?? ()
#6 0x000000000000000e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 12165):
#0 0x00007feb45443ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 12163):
#0 0x00007feb3e3d3947 in ?? ()
#1 0x000061400000a480 in ?? ()
#2 0x0000619000059680 in ?? ()
#3 0x00007feb329e2340 in ?? ()
#4 0x00007feb329e2540 in ?? ()
#5 0x00007feb329e2390 in ?? ()
#6 0x000061400000a480 in ?? ()
#7 0x00007feb329e2400 in ?? ()
#8 0x00007feb409dabda in ?? ()
#9 0x3fb9709e1b000000 in ?? ()
#10 0x0000619000059680 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059680 in ?? ()
#13 0x4244e8517b400000 in ?? ()
#14 0x00007feb329e2540 in ?? ()
#15 0x41da97978d7b0aa2 in ?? ()
#16 0x00000000e6534480 in ?? ()
#17 0x00007feb329e23e0 in ?? ()
#18 0x00007feb409de228 in ?? ()
#19 0x00000000329e23c0 in ?? ()
#20 0x0000619000059680 in ?? ()
#21 0x000061400000a480 in ?? ()
#22 0x00007feb329e2400 in ?? ()
#23 0x3fb9709e1b000000 in ?? ()
#24 0x4137c2d877d72f19 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 12162):
#0 0x00007feb3e3d3947 in ?? ()
#1 0x000061400000a280 in ?? ()
#2 0x0000619000059180 in ?? ()
#3 0x00007feb331e3340 in ?? ()
#4 0x00007feb331e3540 in ?? ()
#5 0x00007feb331e3390 in ?? ()
#6 0x000061400000a280 in ?? ()
#7 0x00007feb331e3400 in ?? ()
#8 0x00007feb409dabda in ?? ()
#9 0x3fb75e326e000000 in ?? ()
#10 0x0000619000059180 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059180 in ?? ()
#13 0x4252ba0438100000 in ?? ()
#14 0x00007feb331e3540 in ?? ()
#15 0x41da97978d7b0a9e in ?? ()
#16 0x00000000e6634680 in ?? ()
#17 0x00007feb331e33e0 in ?? ()
#18 0x00007feb409de228 in ?? ()
#19 0x00000000331e33c0 in ?? ()
#20 0x0000619000059180 in ?? ()
#21 0x000061400000a280 in ?? ()
#22 0x00007feb331e3400 in ?? ()
#23 0x3fb75e326e000000 in ?? ()
#24 0x4137c2d87a36fdc3 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 12161):
#0 0x00007feb3e3d3947 in ?? ()
#1 0x000061400000a080 in ?? ()
#2 0x0000619000058c80 in ?? ()
#3 0x00007feb339e4340 in ?? ()
#4 0x00007feb339e4540 in ?? ()
#5 0x00007feb339e4390 in ?? ()
#6 0x000061400000a080 in ?? ()
#7 0x00007feb339e4400 in ?? ()
#8 0x00007feb409dabda in ?? ()
#9 0x3fb79770b3000000 in ?? ()
#10 0x0000619000058c80 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058c80 in ?? ()
#13 0x4256bc3e9ae00000 in ?? ()
#14 0x00007feb339e4540 in ?? ()
#15 0x41da97978d7b0a9f in ?? ()
#16 0x00000000e6734880 in ?? ()
#17 0x00007feb339e43e0 in ?? ()
#18 0x00007feb409de228 in ?? ()
#19 0x00000000339e43c0 in ?? ()
#20 0x0000619000058c80 in ?? ()
#21 0x000061400000a080 in ?? ()
#22 0x00007feb339e4400 in ?? ()
#23 0x3fb79770b3000000 in ?? ()
#24 0x4137c2d87ba7062e in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 12160):
#0 0x00007feb3e3d3947 in ?? ()
#1 0x0000614000009e80 in ?? ()
#2 0x0000619000058780 in ?? ()
#3 0x00007feb34fad340 in ?? ()
#4 0x00007feb34fad540 in ?? ()
#5 0x00007feb34fad390 in ?? ()
#6 0x0000614000009e80 in ?? ()
#7 0x00007feb34fad400 in ?? ()
#8 0x00007feb409dabda in ?? ()
#9 0x3fb1a343e7000000 in ?? ()
#10 0x0000619000058780 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058780 in ?? ()
#13 0x4230092694400000 in ?? ()
#14 0x00007feb34fad540 in ?? ()
#15 0x41da97978d7b0aa3 in ?? ()
#16 0x00000000e69eda80 in ?? ()
#17 0x00007feb34fad3e0 in ?? ()
#18 0x00007feb409de228 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 12153):
#0 0x00007feb3e3c6bb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007feb369b77d8 in ?? ()
#3 0x000060200004b5b0 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x0000000000823a92 in __sanitizer::theDepot ()
#7 0x0000000000000008 in ?? ()
#8 0x0000000000007da0 in ?? ()
#9 0x0000000000000000 in ?? ()
Thread 7 (LWP 12152):
#0 0x00007feb45443fb9 in ?? ()
#1 0x3ff0000000000000 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a228 in ?? ()
#5 0x00007feb361b60d0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 6 (LWP 12151):
#0 0x00007feb454479e2 in ?? ()
#1 0x00007feb359b4430 in ?? ()
#2 0x00007feb359b3f20 in ?? ()
#3 0x00007feb359b3650 in ?? ()
#4 0x00007feb359b51c0 in ?? ()
#5 0x00007feb359b3ed0 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x00007feb359b3f30 in ?? ()
#8 0x000061100005a2d0 in ?? ()
#9 0x00007feb359b3f20 in ?? ()
#10 0x000000000081de90 in __sanitizer::theDepot ()
#11 0x00007feb4ac0b269 in ?? ()
#12 0x00000000009edb7d in __sanitizer::theDepot ()
#13 0x00007feb42163eaf in ?? ()
#14 0x00007feb4543d6db in ?? ()
#15 0x00007feb359b36b0 in ?? ()
#16 0x00007feb4ac19e61 in ?? ()
#17 0x00007feb359b3770 in ?? ()
#18 0x0000000000000003 in ?? ()
#19 0x0000000000000003 in ?? ()
#20 0x00000c2000001c59 in ?? ()
#21 0x000061100005a2e0 in ?? ()
#22 0x000060d0004f68a8 in ?? ()
#23 0x0000000000000080 in ?? ()
#24 0x000061000000e240 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 5 (LWP 12142):
#0 0x00007feb45443fb9 in ?? ()
#1 0x00007feb379b90b0 in ?? ()
#2 0x0000000000000187 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001ab28 in ?? ()
#5 0x00007feb379b8cd0 in ?? ()
#6 0x000000000000030e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 12140):
#0 0x00007feb45443fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 12139):
#0 0x00007feb45443fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 12138):
#0 0x00007feb45443fb9 in ?? ()
#1 0x0000000000008000 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000009838 in ?? ()
#5 0x00007feb391bc450 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 12137):
#0 0x00007feb45447d50 in ?? ()
#1 0x0000000000000000 in ?? ()
I20260807 18:16:46.864655 14062 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:46.865919 14062 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:46.866561 14061 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:46.866729 14061 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:46.868141 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:46.868156 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:46.868242 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:46.868917 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:46.869450 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:46.866206 14060 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50da72adf57546f5bab0a028672a51dd)
I20260807 18:16:46.870714 13260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:46.867496 14061 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:46.870210 14062 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:46.870836 14060 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:46.871299 13261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:46.872089 14060 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:46.872393 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:46.873090 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:46.874410 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:46.874672 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:46.876021 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:46.876070 12160 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:46.876598 14060 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 18:16:46.876708 12160 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:46.877102 14060 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 18:16:46.877157 12160 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:46.877461 14060 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
************************* END STACKS ***************************
I20260807 18:16:46.879302 11253 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 5 with UUID 14597aeb31024f3bacbdbb6a99a2800d and pid 12492
************************ BEGIN STACKS **************************
[New LWP 12559]
[New LWP 12560]
[New LWP 12561]
[New LWP 12562]
[New LWP 12575]
[New LWP 12576]
[New LWP 12577]
[New LWP 12580]
[New LWP 12581]
[New LWP 12582]
[New LWP 12583]
[New LWP 12585]
[New LWP 12589]
[New LWP 12590]
[New LWP 12592]
[New LWP 12593]
[New LWP 12595]
[New LWP 12596]
[New LWP 12597]
[New LWP 12598]
[New LWP 12600]
[New LWP 12601]
[New LWP 12603]
[New LWP 12604]
[New LWP 12606]
[New LWP 12608]
[New LWP 12610]
[New LWP 12611]
[New LWP 12613]
[New LWP 12614]
[New LWP 12615]
[New LWP 12616]
[New LWP 12617]
[New LWP 12618]
[New LWP 12619]
[New LWP 12620]
[New LWP 12621]
[New LWP 12622]
[New LWP 12627]
[New LWP 12628]
[New LWP 12629]
[New LWP 12630]
[New LWP 12634]
[New LWP 12636]
[New LWP 12637]
[New LWP 12638]
[New LWP 12639]
[New LWP 12640]
[New LWP 12641]
[New LWP 12642]
[New LWP 12643]
[New LWP 12644]
[New LWP 12647]
[New LWP 12648]
[New LWP 12649]
[New LWP 12650]
[New LWP 12652]
[New LWP 12654]
[New LWP 12656]
[New LWP 12657]
[New LWP 12659]
[New LWP 12661]
[New LWP 12662]
[New LWP 12664]
[New LWP 12665]
[New LWP 12666]
[New LWP 12667]
[New LWP 12668]
[New LWP 12670]
[New LWP 12671]
[New LWP 12672]
[New LWP 12673]
[New LWP 12674]
[New LWP 12675]
[New LWP 12676]
[New LWP 12677]
[New LWP 12679]
[New LWP 12686]
[New LWP 12690]
[New LWP 12691]
[New LWP 12693]
[New LWP 12694]
[New LWP 12695]
[New LWP 12696]
[New LWP 12697]
[New LWP 12698]
[New LWP 12699]
[New LWP 12702]
[New LWP 12703]
[New LWP 12704]
[New LWP 12705]
[New LWP 12706]
[New LWP 12707]
[New LWP 12708]
[New LWP 12709]
[New LWP 12719]
[New LWP 12722]
[New LWP 12723]
[New LWP 12724]
[New LWP 12725]
[New LWP 12726]
[New LWP 12728]
[New LWP 12730]
[New LWP 12732]
[New LWP 12735]
[New LWP 12736]
[New LWP 12737]
[New LWP 12738]
[New LWP 12739]
[New LWP 12742]
[New LWP 12743]
[New LWP 12744]
[New LWP 12745]
[New LWP 12746]
[New LWP 12747]
[New LWP 12748]
[New LWP 12749]
[New LWP 12750]
[New LWP 12751]
[New LWP 12752]
[New LWP 12756]
[New LWP 14029]
[New LWP 14057]
W20260807 18:16:47.807646 11285 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111) [suppressed 17 similar messages]
W20260807 18:16:47.809603 11285 catalog_manager.cc:4584] TS b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 874ba119c7284c4d8a113d6654e0c39e: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666671
Cannot access memory at address 0x746e657265666669
0x00007fe12e37fd50 in ?? ()
Id Target Id Frame
* 1 LWP 12492 "kudu" 0x00007fe12e37fd50 in ?? ()
2 LWP 12559 "kudu" 0x00007fe12e37bfb9 in ?? ()
3 LWP 12560 "kudu" 0x00007fe12e37bfb9 in ?? ()
4 LWP 12561 "kudu" 0x00007fe12e37bfb9 in ?? ()
5 LWP 12562 "kernel-watcher-" 0x00007fe12e37bfb9 in ?? ()
6 LWP 12575 "ntp client-1257" 0x00007fe12e37f9e2 in ?? ()
7 LWP 12576 "file cache-evic" 0x00007fe12e37bfb9 in ?? ()
8 LWP 12577 "sq_acceptor" 0x00007fe1272febb9 in ?? ()
9 LWP 12580 "rpc reactor-125" 0x00007fe12730b947 in ?? ()
10 LWP 12581 "rpc reactor-125" 0x00007fe12730b947 in ?? ()
11 LWP 12582 "rpc reactor-125" 0x00007fe12730b947 in ?? ()
12 LWP 12583 "rpc reactor-125" 0x00007fe12730b947 in ?? ()
13 LWP 12585 "MaintenanceMgr " 0x00007fe12e37bad3 in ?? ()
14 LWP 12589 "txn-status-mana" 0x00007fe12e37bfb9 in ?? ()
15 LWP 12590 "collect_and_rem" 0x00007fe12e37bfb9 in ?? ()
16 LWP 12592 "tc-session-exp-" 0x00007fe12e37bfb9 in ?? ()
17 LWP 12593 "rpc worker-1259" 0x00007fe12e37bad3 in ?? ()
18 LWP 12595 "rpc worker-1259" 0x00007fe12e37bad3 in ?? ()
19 LWP 12596 "rpc worker-1259" 0x00007fe12e37bad3 in ?? ()
20 LWP 12597 "rpc worker-1259" 0x00007fe12e37bad3 in ?? ()
21 LWP 12598 "rpc worker-1259" 0x00007fe12e37bad3 in ?? ()
22 LWP 12600 "rpc worker-1260" 0x00007fe12e37bad3 in ?? ()
23 LWP 12601 "rpc worker-1260" 0x00007fe12e37bad3 in ?? ()
24 LWP 12603 "rpc worker-1260" 0x00007fe12e37bad3 in ?? ()
25 LWP 12604 "rpc worker-1260" 0x00007fe12e37bad3 in ?? ()
26 LWP 12606 "rpc worker-1260" 0x00007fe12e37bad3 in ?? ()
27 LWP 12608 "rpc worker-1260" 0x00007fe12e37bad3 in ?? ()
28 LWP 12610 "rpc worker-1261" 0x00007fe12e37bad3 in ?? ()
29 LWP 12611 "rpc worker-1261" 0x00007fe12e37bad3 in ?? ()
30 LWP 12613 "rpc worker-1261" 0x00007fe12e37bad3 in ?? ()
31 LWP 12614 "rpc worker-1261" 0x00007fe12e37bad3 in ?? ()
32 LWP 12615 "rpc worker-1261" 0x00007fe12e37bad3 in ?? ()
33 LWP 12616 "rpc worker-1261" 0x00007fe12e37bad3 in ?? ()
34 LWP 12617 "rpc worker-1261" 0x00007fe12e37bad3 in ?? ()
35 LWP 12618 "rpc worker-1261" 0x00007fe12e37bad3 in ?? ()
36 LWP 12619 "rpc worker-1261" 0x00007fe12e37bad3 in ?? ()
37 LWP 12620 "rpc worker-1262" 0x00007fe12e37bad3 in ?? ()
38 LWP 12621 "rpc worker-1262" 0x00007fe12e37bad3 in ?? ()
39 LWP 12622 "rpc worker-1262" 0x00007fe12e37bad3 in ?? ()
40 LWP 12627 "rpc worker-1262" 0x00007fe12e37bad3 in ?? ()
41 LWP 12628 "rpc worker-1262" 0x00007fe12e37bad3 in ?? ()
42 LWP 12629 "rpc worker-1262" 0x00007fe12e37bad3 in ?? ()
43 LWP 12630 "rpc worker-1263" 0x00007fe12e37bad3 in ?? ()
44 LWP 12634 "rpc worker-1263" 0x00007fe12e37bad3 in ?? ()
45 LWP 12636 "rpc worker-1263" 0x00007fe12e37bad3 in ?? ()
46 LWP 12637 "rpc worker-1263" 0x00007fe12e37bad3 in ?? ()
47 LWP 12638 "rpc worker-1263" 0x00007fe12e37bad3 in ?? ()
48 LWP 12639 "rpc worker-1263" 0x00007fe12e37bad3 in ?? ()
49 LWP 12640 "rpc worker-1264" 0x00007fe12e37bad3 in ?? ()
50 LWP 12641 "rpc worker-1264" 0x00007fe12e37bad3 in ?? ()
51 LWP 12642 "rpc worker-1264" 0x00007fe12e37bad3 in ?? ()
52 LWP 12643 "rpc worker-1264" 0x00007fe12e37bad3 in ?? ()
53 LWP 12644 "rpc worker-1264" 0x00007fe12e37bad3 in ?? ()
54 LWP 12647 "rpc worker-1264" 0x00007fe12e37bad3 in ?? ()
55 LWP 12648 "rpc worker-1264" 0x00007fe12e37bad3 in ?? ()
56 LWP 12649 "rpc worker-1264" 0x00007fe12e37bad3 in ?? ()
57 LWP 12650 "rpc worker-1265" 0x00007fe12e37bad3 in ?? ()
58 LWP 12652 "rpc worker-1265" 0x00007fe12e37bad3 in ?? ()
59 LWP 12654 "rpc worker-1265" 0x00007fe12e37bad3 in ?? ()
60 LWP 12656 "rpc worker-1265" 0x00007fe12e37bad3 in ?? ()
61 LWP 12657 "rpc worker-1265" 0x00007fe12e37bad3 in ?? ()
62 LWP 12659 "rpc worker-1265" 0x00007fe12e37bad3 in ?? ()
63 LWP 12661 "rpc worker-1266" 0x00007fe12e37bad3 in ?? ()
64 LWP 12662 "rpc worker-1266" 0x00007fe12e37bad3 in ?? ()
65 LWP 12664 "rpc worker-1266" 0x00007fe12e37bad3 in ?? ()
66 LWP 12665 "rpc worker-1266" 0x00007fe12e37bad3 in ?? ()
67 LWP 12666 "rpc worker-1266" 0x00007fe12e37bad3 in ?? ()
68 LWP 12667 "rpc worker-1266" 0x00007fe12e37bad3 in ?? ()
69 LWP 12668 "rpc worker-1266" 0x00007fe12e37bad3 in ?? ()
70 LWP 12670 "rpc worker-1267" 0x00007fe12e37bad3 in ?? ()
71 LWP 12671 "rpc worker-1267" 0x00007fe12e37bad3 in ?? ()
72 LWP 12672 "rpc worker-1267" 0x00007fe12e37bad3 in ?? ()
73 LWP 12673 "rpc worker-1267" 0x00007fe12e37bad3 in ?? ()
74 LWP 12674 "rpc worker-1267" 0x00007fe12e37bad3 in ?? ()
75 LWP 12675 "rpc worker-1267" 0x00007fe12e37bad3 in ?? ()
76 LWP 12676 "rpc worker-1267" 0x00007fe12e37bad3 in ?? ()
77 LWP 12677 "rpc worker-1267" 0x00007fe12e37bad3 in ?? ()
78 LWP 12679 "rpc worker-1267" 0x00007fe12e37bad3 in ?? ()
79 LWP 12686 "rpc worker-1268" 0x00007fe12e37bad3 in ?? ()
80 LWP 12690 "rpc worker-1269" 0x00007fe12e37bad3 in ?? ()
81 LWP 12691 "rpc worker-1269" 0x00007fe12e37bad3 in ?? ()
82 LWP 12693 "rpc worker-1269" 0x00007fe12e37bad3 in ?? ()
83 LWP 12694 "rpc worker-1269" 0x00007fe12e37bad3 in ?? ()
84 LWP 12695 "rpc worker-1269" 0x00007fe12e37bad3 in ?? ()
85 LWP 12696 "rpc worker-1269" 0x00007fe12e37bad3 in ?? ()
86 LWP 12697 "rpc worker-1269" 0x00007fe12e37bad3 in ?? ()
87 LWP 12698 "rpc worker-1269" 0x00007fe12e37bad3 in ?? ()
88 LWP 12699 "rpc worker-1269" 0x00007fe12e37bad3 in ?? ()
89 LWP 12702 "rpc worker-1270" 0x00007fe12e37bad3 in ?? ()
90 LWP 12703 "rpc worker-1270" 0x00007fe12e37bad3 in ?? ()
91 LWP 12704 "rpc worker-1270" 0x00007fe12e37bad3 in ?? ()
92 LWP 12705 "rpc worker-1270" 0x00007fe12e37bad3 in ?? ()
93 LWP 12706 "rpc worker-1270" 0x00007fe12e37bad3 in ?? ()
94 LWP 12707 "rpc worker-1270" 0x00007fe12e37bad3 in ?? ()
95 LWP 12708 "rpc worker-1270" 0x00007fe12e37bad3 in ?? ()
96 LWP 12709 "rpc worker-1270" 0x00007fe12e37bad3 in ?? ()
97 LWP 12719 "rpc worker-1271" 0x00007fe12e37bad3 in ?? ()
98 LWP 12722 "rpc worker-1272" 0x00007fe12e37bad3 in ?? ()
99 LWP 12723 "rpc worker-1272" 0x00007fe12e37bad3 in ?? ()
100 LWP 12724 "rpc worker-1272" 0x00007fe12e37bad3 in ?? ()
101 LWP 12725 "rpc worker-1272" 0x00007fe12e37bad3 in ?? ()
102 LWP 12726 "rpc worker-1272" 0x00007fe12e37bad3 in ?? ()
103 LWP 12728 "rpc worker-1272" 0x00007fe12e37bad3 in ?? ()
104 LWP 12730 "rpc worker-1273" 0x00007fe12e37bad3 in ?? ()
105 LWP 12732 "rpc worker-1273" 0x00007fe12e37bad3 in ?? ()
106 LWP 12735 "rpc worker-1273" 0x00007fe12e37bad3 in ?? ()
107 LWP 12736 "rpc worker-1273" 0x00007fe12e37bad3 in ?? ()
108 LWP 12737 "rpc worker-1273" 0x00007fe12e37bad3 in ?? ()
109 LWP 12738 "rpc worker-1273" 0x00007fe12e37bad3 in ?? ()
110 LWP 12739 "rpc worker-1273" 0x00007fe12e37bad3 in ?? ()
111 LWP 12742 "rpc worker-1274" 0x00007fe12e37bad3 in ?? ()
112 LWP 12743 "rpc worker-1274" 0x00007fe12e37bad3 in ?? ()
113 LWP 12744 "rpc worker-1274" 0x00007fe12e37bad3 in ?? ()
114 LWP 12745 "rpc worker-1274" 0x00007fe12e37bad3 in ?? ()
115 LWP 12746 "rpc worker-1274" 0x00007fe12e37bad3 in ?? ()
116 LWP 12747 "rpc worker-1274" 0x00007fe12e37bad3 in ?? ()
117 LWP 12748 "diag-logger-127" 0x00007fe12e37bfb9 in ?? ()
118 LWP 12749 "result-tracker-" 0x00007fe12e37bfb9 in ?? ()
119 LWP 12750 "excess-log-dele" 0x00007fe12e37bfb9 in ?? ()
120 LWP 12751 "acceptor-12751" 0x00007fe12730cfc7 in ?? ()
121 LWP 12752 "heartbeat-12752" 0x00007fe12e37bfb9 in ?? ()
122 LWP 12756 "maintenance_sch" 0x00007fe12e37bfb9 in ?? ()
123 LWP 14029 "raft [worker]-1" 0x00007fe12e37bfb9 in ?? ()
124 LWP 14057 "raft [worker]-1" 0x00007fe12e37bfb9 in ?? ()
Thread 124 (LWP 14057):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000088 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007fe0dfe5eba0 in ?? ()
#5 0x00007fe0dfe5e830 in ?? ()
#6 0x0000000000000110 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 123 (LWP 14029):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000093 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x00007fe0db731ba4 in ?? ()
#5 0x00007fe0db731830 in ?? ()
#6 0x0000000000000127 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fe0db731850 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 122 (LWP 12756):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 121 (LWP 12752):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0xffffffffffffffff in ?? ()
#2 0x000000000000005a in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x0000613000018eac in ?? ()
#5 0x00007fe0e4fa8770 in ?? ()
#6 0x00000000000000b5 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fe0e4fa8790 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007fe0e4fa8810 in ?? ()
#12 0x00000ffc1c9f5104 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 12751):
#0 0x00007fe12730cfc7 in ?? ()
#1 0x0000614000009e90 in ?? ()
#2 0x00007fe0e57bffa0 in ?? ()
#3 0x00007fe0e57bffc0 in ?? ()
#4 0x00007fe0e57c00e0 in ?? ()
#5 0x00007fe0e57bffd0 in ?? ()
#6 0x00007fe0e57c0040 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x000000000082c9d2 in __sanitizer::theDepot ()
#9 0x00000000008c3cc9 in __sanitizer::theDepot ()
#10 0x00000000008f35b0 in __sanitizer::theDepot ()
#11 0x00000000008f34b8 in __sanitizer::theDepot ()
#12 0x000060c000066058 in ?? ()
#13 0x000060c0000660b4 in ?? ()
#14 0x00000000008875e1 in __sanitizer::theDepot ()
#15 0x000000000000005c in ?? ()
#16 0x000000000088348c in __sanitizer::theDepot ()
#17 0x000060c000066058 in ?? ()
#18 0x0000000000883aba in __sanitizer::theDepot ()
#19 0x00000000008d30d7 in __sanitizer::theDepot ()
#20 0x00007fe131a6ed85 in ?? ()
#21 0x00007fe131a7174c in ?? ()
#22 0x00007fe131a715c9 in ?? ()
#23 0x00000000009edb7d in __sanitizer::theDepot ()
#24 0x00007fe12b09beaf in ?? ()
#25 0x00007fe12e3756db in ?? ()
#26 0x00007fe1272bd346 in ?? ()
#27 0x00007fe0e57bf842 in ?? ()
#28 0x000000006a7620c8 in ?? ()
#29 0x000000006a7620c8 in ?? ()
#30 0x000000000080e8d4 in __sanitizer::theDepot ()
#31 0x0000000f00000024 in ?? ()
#32 0x0000000700000012 in ?? ()
#33 0x0000640000001140 in ?? ()
#34 0x00007fe0e4fb9e60 in ?? ()
#35 0x0000640000001140 in ?? ()
#36 0x00000000008b1acd in __sanitizer::theDepot ()
#37 0x0000000000e377a0 in ?? ()
#38 0x00007fe0e374a2f8 in ?? ()
#39 0x0000000000000000 in ?? ()
Thread 119 (LWP 12750):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 118 (LWP 12749):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x00007fe0e67f2160 in ?? ()
#2 0x0000000000000047 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100006ec30 in ?? ()
#5 0x00007fe0e67f2110 in ?? ()
#6 0x000000000000008e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 12748):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 12747):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 12746):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 12745):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 12744):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 12743):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 12742):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 12739):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 12738):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 12737):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 12736):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 12735):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 12732):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 12730):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 12728):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 12726):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 12725):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 12724):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 12723):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 12722):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 12719):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 12709):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 12708):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 12707):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 12706):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 12705):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 12704):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 12703):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 12702):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 12699):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 12698):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 12697):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 12696):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 12695):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 12694):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 12693):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 12691):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 12690):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 12686):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 12679):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 12677):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 12676):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x000000000000015a in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007fe0fbbf2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe0fbbf2ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 12675):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000570 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a0088 in ?? ()
#4 0x00007fe0fc40aeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe0fc40aed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 74 (LWP 12674):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000468 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001967c8 in ?? ()
#4 0x00007fe0fcc22eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe0fcc22ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 73 (LWP 12673):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x000000000000047e in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00018ffc8 in ?? ()
#4 0x00007fe0fd43aeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe0fd43aed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 72 (LWP 12672):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 12671):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 12670):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 12668):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 12667):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 12666):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 12665):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 12664):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 12662):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 12661):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 12659):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 12657):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 12656):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 12654):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 12652):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 12650):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 12649):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 55 (LWP 12648):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 54 (LWP 12647):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 53 (LWP 12644):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 52 (LWP 12643):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 12642):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 12641):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 12640):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 12639):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 12638):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 12637):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 12636):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 12634):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 12630):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 12629):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 12628):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 12627):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 12622):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 12621):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 12620):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 12619):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000019 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007fe10ffb4eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe10ffb4ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007fe12e37b770 in ?? ()
#10 0x00007fe10ffb4ed0 in ?? ()
#11 0x00007fe10ffb4fa0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 12618):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 34 (LWP 12617):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 33 (LWP 12616):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 32 (LWP 12615):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 12614):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 12613):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 12611):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 12610):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 12608):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 12606):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 12604):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 12603):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 12601):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 12600):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 12598):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 12597):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 12596):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 12595):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 12593):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 12592):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x00000000ffffffff in ?? ()
#2 0x0000000000000007 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000019760 in ?? ()
#5 0x00007fe1198ddd30 in ?? ()
#6 0x000000000000000e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 15 (LWP 12590):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x000000000000000e in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a618 in ?? ()
#5 0x00007fe11a0df270 in ?? ()
#6 0x000000000000001c in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 12589):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000007 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000618000004da8 in ?? ()
#5 0x00007fe11a8df250 in ?? ()
#6 0x000000000000000e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 13 (LWP 12585):
#0 0x00007fe12e37bad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 12583):
#0 0x00007fe12730b947 in ?? ()
#1 0x000061400000a480 in ?? ()
#2 0x0000619000059680 in ?? ()
#3 0x00007fe11b8e2340 in ?? ()
#4 0x00007fe11b8e2540 in ?? ()
#5 0x00007fe11b8e2390 in ?? ()
#6 0x000061400000a480 in ?? ()
#7 0x00007fe11b8e2400 in ?? ()
#8 0x00007fe129912bda in ?? ()
#9 0x3fa466349c000000 in ?? ()
#10 0x0000619000059680 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059680 in ?? ()
#13 0x425ad40cac300000 in ?? ()
#14 0x00007fe11b8e2540 in ?? ()
#15 0x41da97978d7b0a9f in ?? ()
#16 0x00000000a3714480 in ?? ()
#17 0x00007fe11b8e23e0 in ?? ()
#18 0x00007fe129916228 in ?? ()
#19 0x000000001b8e23c0 in ?? ()
#20 0x0000619000059680 in ?? ()
#21 0x000061400000a480 in ?? ()
#22 0x00007fe11b8e2400 in ?? ()
#23 0x3fa466349c000000 in ?? ()
#24 0x4137c2d9def4cbbc in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 12582):
#0 0x00007fe12730b947 in ?? ()
#1 0x000061400000a280 in ?? ()
#2 0x0000619000059180 in ?? ()
#3 0x00007fe11c0e3340 in ?? ()
#4 0x00007fe11c0e3540 in ?? ()
#5 0x00007fe11c0e3390 in ?? ()
#6 0x000061400000a280 in ?? ()
#7 0x00007fe11c0e3400 in ?? ()
#8 0x00007fe129912bda in ?? ()
#9 0x3fb04a419c000000 in ?? ()
#10 0x0000619000059180 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000059180 in ?? ()
#13 0x4215acf43a000000 in ?? ()
#14 0x00007fe11c0e3540 in ?? ()
#15 0x41da97978d7b0a9f in ?? ()
#16 0x00000000a3814680 in ?? ()
#17 0x00007fe11c0e33e0 in ?? ()
#18 0x00007fe129916228 in ?? ()
#19 0x000000001c0e33c0 in ?? ()
#20 0x0000619000059180 in ?? ()
#21 0x000061400000a280 in ?? ()
#22 0x00007fe11c0e3400 in ?? ()
#23 0x3fb04a419c000000 in ?? ()
#24 0x4137c2d9d4b78552 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 12581):
#0 0x00007fe12730b947 in ?? ()
#1 0x000061400000a080 in ?? ()
#2 0x0000619000058c80 in ?? ()
#3 0x00007fe11c8e4340 in ?? ()
#4 0x00007fe11c8e4540 in ?? ()
#5 0x00007fe11c8e4390 in ?? ()
#6 0x000061400000a080 in ?? ()
#7 0x00007fe11c8e4400 in ?? ()
#8 0x00007fe129912bda in ?? ()
#9 0x3f9630e1fc000000 in ?? ()
#10 0x0000619000058c80 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058c80 in ?? ()
#13 0x421076496c000000 in ?? ()
#14 0x00007fe11c8e4540 in ?? ()
#15 0x41da97978d7b0aa5 in ?? ()
#16 0x00000000a3914880 in ?? ()
#17 0x00007fe11c8e43e0 in ?? ()
#18 0x00007fe129916228 in ?? ()
#19 0x000000001c8e43c0 in ?? ()
#20 0x0000619000058c80 in ?? ()
#21 0x000061400000a080 in ?? ()
#22 0x00007fe11c8e4400 in ?? ()
#23 0x3f9630e1fc000000 in ?? ()
#24 0x4137c2d9db5a5337 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 12580):
#0 0x00007fe12730b947 in ?? ()
#1 0x0000614000009e80 in ?? ()
#2 0x0000619000058780 in ?? ()
#3 0x00007fe11dead340 in ?? ()
#4 0x00007fe11dead540 in ?? ()
#5 0x00007fe11dead390 in ?? ()
#6 0x0000614000009e80 in ?? ()
#7 0x00007fe11dead400 in ?? ()
#8 0x00007fe129912bda in ?? ()
#9 0x3fa3f6b682000000 in ?? ()
#10 0x0000619000058780 in ?? ()
#11 0x54b249ad2594c37d in ?? ()
#12 0x0000619000058780 in ?? ()
#13 0x420a1e35ec000000 in ?? ()
#14 0x00007fe11dead540 in ?? ()
#15 0x41da97978d7b0ab3 in ?? ()
#16 0x00000000a3bcda80 in ?? ()
#17 0x00007fe11dead3e0 in ?? ()
#18 0x00007fe129916228 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 12577):
#0 0x00007fe1272febb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fe11f8b77d8 in ?? ()
#3 0x000060200004a650 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x0000000000823a92 in __sanitizer::theDepot ()
#7 0x0000000000000008 in ?? ()
#8 0x0000000000007da0 in ?? ()
#9 0x0000000000000000 in ?? ()
I20260807 18:16:48.007416 14081 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:48.007849 14081 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.009578 14081 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.010188 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:48.010705 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:48.011704 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:48.012552 11974 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 22052958d03d426ebdc2fc310637c846; no voters: 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:48.012892 14081 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 18:16:48.029259 14082 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:48.029791 14082 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.031143 14082 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.031586 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:48.031818 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:48.031924 12072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:48.032752 11790 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:48.033102 14082 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 18:16:48.038599 14083 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:48.038978 14083 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.040341 14083 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.041115 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:48.041117 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:48.041193 12072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:48.041575 12072 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 2.
I20260807 18:16:48.044706 14082 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:48.045017 14082 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.046392 14082 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.046739 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:48.046697 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:48.047082 12245 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 2.
I20260807 18:16:48.047161 12072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:48.047466 12072 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 2.
I20260807 18:16:48.048076 11790 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:48.048784 14082 raft_consensus.cc:2781] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 18:16:48.048933 14082 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:48.049067 14082 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:48.053016 14082 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.055533 14083 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:48.055490 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd"
I20260807 18:16:48.055892 14083 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.056275 14082 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 3 election: Requested vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.057677 14083 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.057935 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:16:48.058276 12245 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:48.058238 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:48.058656 11881 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 3.
I20260807 18:16:48.058604 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:48.058866 12072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:16:48.059145 12072 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:48.062276 12245 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 3.
I20260807 18:16:48.062271 14081 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:48.062877 14081 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.063433 12072 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 3.
I20260807 18:16:48.064117 11790 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:48.064054 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:48.064455 14081 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.064502 12074 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 3.
I20260807 18:16:48.065371 14082 raft_consensus.cc:2781] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 18:16:48.065502 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:48.065560 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:48.065968 11881 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 3.
I20260807 18:16:48.066149 12160 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:48.066700 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:48.067189 12245 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 3.
I20260807 18:16:48.067674 14083 raft_consensus.cc:2781] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 18:16:48.067868 14083 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:48.067868 11974 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:48.068163 14083 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:48.069175 14081 raft_consensus.cc:2781] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 18:16:48.069401 14081 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:48.069550 14081 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:48.074759 14083 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.075619 14031 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:48.075678 14081 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.075903 14031 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.076885 14031 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077)
I20260807 18:16:48.077541 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:16:48.077886 11881 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:48.078042 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:48.078641 12246 raft_consensus.cc:2379] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 3: Already voted for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in this term.
I20260807 18:16:48.079342 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:48.079708 12074 raft_consensus.cc:2379] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 3: Already voted for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in this term.
I20260807 18:16:48.082031 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:16:48.083101 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:48.084128 11881 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 4.
I20260807 18:16:48.084666 14082 raft_consensus.cc:686] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 LEADER]: Becoming Leader. State: Replica: 6a9cdd541bff40f98b3a280123bcc1a9, State: Running, Role: LEADER
I20260807 18:16:48.084932 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:16:48.085275 12074 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 41f204b71daa453ea5e1226f14f422ca in current term 4: Already voted for candidate 22052958d03d426ebdc2fc310637c846 in this term.
I20260807 18:16:48.085577 14082 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1972, Committed index: 1972, Last appended: 2.1972, Last appended by leader: 1972, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.087524 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd"
I20260807 18:16:48.088541 12163 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca; no voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:48.089445 14081 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 election: Requested vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.089928 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd"
I20260807 18:16:48.092824 13107 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:48.093680 14031 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:48.093910 14070 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:48.093616 11291 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 reported cstate change: term changed from 2 to 3, leader changed from 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) to 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67). New cstate: current_term: 3 leader_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" committed_config { opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:48.094101 14070 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.095052 14070 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077)
I20260807 18:16:48.097292 14083 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 election: Requested vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.097585 14083 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 18:16:48.097790 14031 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 18:16:48.099979 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:48.100687 11880 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 4: Already voted for candidate 22052958d03d426ebdc2fc310637c846 in this term.
I20260807 18:16:48.101516 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:48.101907 12074 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 4: Already voted for candidate 22052958d03d426ebdc2fc310637c846 in this term.
I20260807 18:16:48.101824 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:16:48.102154 12245 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22052958d03d426ebdc2fc310637c846 in current term 4: Already voted for candidate 41f204b71daa453ea5e1226f14f422ca in this term.
I20260807 18:16:48.103384 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:48.103825 12245 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 4: Already voted for candidate 41f204b71daa453ea5e1226f14f422ca in this term.
I20260807 18:16:48.104358 13107 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 50da72adf57546f5bab0a028672a51dd; no voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:48.104754 14070 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:48.109163 14070 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 18:16:48.186278 12245 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Refusing update from remote peer 6a9cdd541bff40f98b3a280123bcc1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1972. Preceding OpId from leader: term: 3 index: 1973. (index mismatch)
I20260807 18:16:48.187261 14082 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1973, Last known committed idx: 1972, Time since last communication: 0.000s
I20260807 18:16:48.211997 13257 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 3 FOLLOWER]: Refusing update from remote peer 6a9cdd541bff40f98b3a280123bcc1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1972. Preceding OpId from leader: term: 3 index: 1973. (index mismatch)
I20260807 18:16:48.213141 14082 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1973, Last known committed idx: 1972, Time since last communication: 0.000s
I20260807 18:16:48.213894 12072 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Refusing update from remote peer 6a9cdd541bff40f98b3a280123bcc1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1972. Preceding OpId from leader: term: 3 index: 1973. (index mismatch)
I20260807 18:16:48.214800 14082 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1973, Last known committed idx: 1972, Time since last communication: 0.000s
Thread 7 (LWP 12576):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x3ff0000000000000 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001a228 in ?? ()
#5 0x00007fe11f0b60d0 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 6 (LWP 12575):
#0 0x00007fe12e37f9e2 in ?? ()
#1 0x00007fe11e8b4430 in ?? ()
#2 0x00007fe11e8b3f20 in ?? ()
#3 0x00007fe11e8b3650 in ?? ()
#4 0x00007fe11e8b51c0 in ?? ()
#5 0x00007fe11e8b3ed0 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x00007fe11e8b3f30 in ?? ()
#8 0x000061100005a2d0 in ?? ()
#9 0x00007fe11e8b3f20 in ?? ()
#10 0x000000000081de90 in __sanitizer::theDepot ()
#11 0x00007fe133b43269 in ?? ()
#12 0x00000000009edb7d in __sanitizer::theDepot ()
#13 0x00007fe12b09beaf in ?? ()
#14 0x00007fe12e3756db in ?? ()
#15 0x00007fe11e8b36b0 in ?? ()
#16 0x00007fe133b51e61 in ?? ()
#17 0x00007fe11e8b3770 in ?? ()
#18 0x0000000000000003 in ?? ()
#19 0x0000000000000003 in ?? ()
#20 0x00000c2000001c59 in ?? ()
#21 0x000061100005a2e0 in ?? ()
#22 0x000060d0002d0058 in ?? ()
#23 0x0000000000000080 in ?? ()
#24 0x000061000000e240 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 5 (LWP 12562):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x00007fe1208b9060 in ?? ()
#2 0x0000000000000177 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001ab28 in ?? ()
#5 0x00007fe1208b8cd0 in ?? ()
#6 0x00000000000002ee in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 12561):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 12560):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 12559):
#0 0x00007fe12e37bfb9 in ?? ()
#1 0x0000000000008000 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000009838 in ?? ()
#5 0x00007fe1220bc450 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 12492):
#0 0x00007fe12e37fd50 in ?? ()
#1 0x0000000000000000 in ?? ()
I20260807 18:16:48.271880 14057 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50da72adf57546f5bab0a028672a51dd)
I20260807 18:16:48.272153 14057 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.273026 12674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d"
I20260807 18:16:48.273406 14057 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.273980 13257 raft_consensus.cc:1226] T 644a01df651c43d4a74ac241ea43068c P 50da72adf57546f5bab0a028672a51dd [term 3 FOLLOWER]: Rejecting Update request from peer 14597aeb31024f3bacbdbb6a99a2800d for earlier term 2. Current term is 3. Ops: []
I20260807 18:16:48.274665 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.275213 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.275472 11975 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 6a9cdd541bff40f98b3a280123bcc1a9; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:48.276831 14081 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 18:16:48.278009 13257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:48.279808 14114 consensus_queue.cc:1046] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.1972, Next index: 1973, Last known committed idx: 1973, Time since last communication: 0.000s
I20260807 18:16:48.288605 14114 raft_consensus.cc:3032] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 2 LEADER]: Stepping down as leader of term 2
I20260807 18:16:48.288849 14114 raft_consensus.cc:729] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 14597aeb31024f3bacbdbb6a99a2800d, State: Running, Role: LEADER
I20260807 18:16:48.289294 14114 consensus_queue.cc:260] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1972, Committed index: 1972, Last appended: 2.1972, Last appended by leader: 1972, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.289979 14114 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:16:48.292991 13257 raft_consensus.cc:1226] T 874ba119c7284c4d8a113d6654e0c39e P 50da72adf57546f5bab0a028672a51dd [term 4 FOLLOWER]: Rejecting Update request from peer 14597aeb31024f3bacbdbb6a99a2800d for earlier term 3. Current term is 4. Ops: []
I20260807 18:16:48.294355 14057 consensus_queue.cc:1046] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.1970, Next index: 1971, Last known committed idx: 1970, Time since last communication: 0.000s
I20260807 18:16:48.295019 14114 raft_consensus.cc:3032] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 3 LEADER]: Stepping down as leader of term 3
I20260807 18:16:48.295401 14114 raft_consensus.cc:729] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14597aeb31024f3bacbdbb6a99a2800d, State: Running, Role: LEADER
I20260807 18:16:48.295914 14114 consensus_queue.cc:260] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1970, Committed index: 1970, Last appended: 3.1970, Last appended by leader: 1970, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.296494 14114 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:48.304378 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.304689 12673 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 4.
I20260807 18:16:48.305554 12072 raft_consensus.cc:1226] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Rejecting Update request from peer 14597aeb31024f3bacbdbb6a99a2800d for earlier term 3. Current term is 4. Ops: []
I20260807 18:16:48.306716 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:48.307085 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:48.307425 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:48.309000 11881 raft_consensus.cc:1226] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 LEADER]: Rejecting Update request from peer 14597aeb31024f3bacbdbb6a99a2800d for earlier term 2. Current term is 3. Ops: []
I20260807 18:16:48.309029 12245 raft_consensus.cc:1226] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Rejecting Update request from peer 14597aeb31024f3bacbdbb6a99a2800d for earlier term 3. Current term is 4. Ops: []
I20260807 18:16:48.309293 12246 raft_consensus.cc:1226] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Rejecting Update request from peer 14597aeb31024f3bacbdbb6a99a2800d for earlier term 2. Current term is 3. Ops: []
I20260807 18:16:48.310205 11880 raft_consensus.cc:1226] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 4 FOLLOWER]: Rejecting Update request from peer 14597aeb31024f3bacbdbb6a99a2800d for earlier term 3. Current term is 4. Ops: []
I20260807 18:16:48.310289 12674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.310637 12674 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 4.
I20260807 18:16:48.310936 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.311264 12673 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 3.
I20260807 18:16:48.311364 12674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d"
I20260807 18:16:48.311617 12074 raft_consensus.cc:1226] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Rejecting Update request from peer 14597aeb31024f3bacbdbb6a99a2800d for earlier term 2. Current term is 3. Ops: []
I20260807 18:16:48.316474 12674 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 4.
I20260807 18:16:48.317585 12675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.317828 12673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d"
I20260807 18:16:48.317999 12676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1972 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.318238 12675 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 3.
I20260807 18:16:48.318852 12676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "50da72adf57546f5bab0a028672a51dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.319262 12675 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Refusing update from remote peer 6a9cdd541bff40f98b3a280123bcc1a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1972. Preceding OpId from leader: term: 3 index: 1973. (index mismatch)
I20260807 18:16:48.319442 12676 raft_consensus.cc:2379] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50da72adf57546f5bab0a028672a51dd in current term 4: Already voted for candidate 41f204b71daa453ea5e1226f14f422ca in this term.
I20260807 18:16:48.320717 12161 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 5 responses out of 5 voters: 3 yes votes; 2 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca; no voters: 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:48.321121 14105 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 6a9cdd541bff40f98b3a280123bcc1a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1973, Last known committed idx: 1972, Time since last communication: 0.000s
I20260807 18:16:48.322006 14086 raft_consensus.cc:2741] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 18:16:48.322121 12580 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d; no voters: 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:48.322702 14115 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
************************* END STACKS ***************************
I20260807 18:16:48.336746 11253 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu pid 13042
I20260807 18:16:48.338651 13345 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:16:48.520936 14086 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:16:48.521287 14086 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.523046 14086 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.523947 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:48.523952 12674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.524111 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:48.524348 12074 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 4.
I20260807 18:16:48.524363 12674 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 4.
I20260807 18:16:48.524403 11880 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 4.
I20260807 18:16:48.525098 12160 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca; no voters:
I20260807 18:16:48.525524 14086 raft_consensus.cc:2781] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 18:16:48.525672 14086 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:16:48.525820 14086 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Advancing to term 5
I20260807 18:16:48.528383 14086 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.529559 14086 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 5 election: Requested vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.529870 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:16:48.529989 12674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d"
I20260807 18:16:48.530144 11880 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 4 FOLLOWER]: Advancing to term 5
I20260807 18:16:48.530294 12674 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Advancing to term 5
I20260807 18:16:48.530376 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:16:48.530678 12074 raft_consensus.cc:3037] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Advancing to term 5
I20260807 18:16:48.533591 12674 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 5.
I20260807 18:16:48.534693 12074 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 5.
I20260807 18:16:48.534709 11880 raft_consensus.cc:2454] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 5.
I20260807 18:16:48.535424 12160 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca; no voters:
I20260807 18:16:48.535804 14086 raft_consensus.cc:2781] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 5 FOLLOWER]: Leader election won for term 5
I20260807 18:16:48.536049 14086 raft_consensus.cc:686] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [term 5 LEADER]: Becoming Leader. State: Replica: 41f204b71daa453ea5e1226f14f422ca, State: Running, Role: LEADER
I20260807 18:16:48.536465 14086 consensus_queue.cc:237] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1970, Committed index: 1970, Last appended: 3.1970, Last appended by leader: 1970, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.540653 11297 catalog_manager.cc:5495] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca reported cstate change: term changed from 3 to 5, leader changed from 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70) to 41f204b71daa453ea5e1226f14f422ca (127.10.253.69). New cstate: current_term: 5 leader_uuid: "41f204b71daa453ea5e1226f14f422ca" committed_config { opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:48.582463 14086 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50da72adf57546f5bab0a028672a51dd)
I20260807 18:16:48.582981 14086 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.585029 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:48.585086 12674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.585064 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:48.586082 12160 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:48.586711 14083 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 18:16:48.586716 14086 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.590857 14105 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50da72adf57546f5bab0a028672a51dd)
I20260807 18:16:48.591216 14105 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.592401 14105 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.593209 12674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.593297 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:48.593526 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:48.593885 12246 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9cdd541bff40f98b3a280123bcc1a9 in term 3.
I20260807 18:16:48.608362 14081 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 50da72adf57546f5bab0a028672a51dd)
I20260807 18:16:48.608776 14081 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.609998 14081 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.610838 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:48.610869 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:48.611215 12246 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 3.
I20260807 18:16:48.611209 12674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:48.611302 11880 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 3.
I20260807 18:16:48.611967 11974 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9; no voters:
I20260807 18:16:48.612488 14081 raft_consensus.cc:2781] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 18:16:48.612612 14081 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 50da72adf57546f5bab0a028672a51dd)
I20260807 18:16:48.612727 14081 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:48.614002 11880 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 6a9cdd541bff40f98b3a280123bcc1a9 [term 5 FOLLOWER]: Refusing update from remote peer 41f204b71daa453ea5e1226f14f422ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 1970. Preceding OpId from leader: term: 5 index: 1971. (index mismatch)
I20260807 18:16:48.614879 14083 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1971, Last known committed idx: 1970, Time since last communication: 0.000s
I20260807 18:16:48.615514 14081 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.617239 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:16:48.617516 12246 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:48.620633 12246 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 4.
I20260807 18:16:48.621277 11881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9"
I20260807 18:16:48.621575 11881 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:48.621969 12074 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 5 FOLLOWER]: Refusing update from remote peer 41f204b71daa453ea5e1226f14f422ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 1970. Preceding OpId from leader: term: 5 index: 1971. (index mismatch)
I20260807 18:16:48.622661 14083 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1971, Last known committed idx: 1970, Time since last communication: 0.000s
I20260807 18:16:48.625648 11881 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 4.
I20260807 18:16:48.626368 11974 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca, 6a9cdd541bff40f98b3a280123bcc1a9; no voters:
I20260807 18:16:48.626811 12674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d"
I20260807 18:16:48.626999 14124 raft_consensus.cc:2781] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 18:16:48.627177 14081 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 election: Requested vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:48.627595 12674 raft_consensus.cc:3037] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:48.631218 12674 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 4.
I20260807 18:16:48.634625 14124 raft_consensus.cc:686] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [term 4 LEADER]: Becoming Leader. State: Replica: 22052958d03d426ebdc2fc310637c846, State: Running, Role: LEADER
I20260807 18:16:48.635779 14124 consensus_queue.cc:237] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1972, Committed index: 1972, Last appended: 3.1972, Last appended by leader: 1972, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:48.636243 12674 raft_consensus.cc:1261] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 5 FOLLOWER]: Refusing update from remote peer 41f204b71daa453ea5e1226f14f422ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 1970. Preceding OpId from leader: term: 5 index: 1971. (index mismatch)
I20260807 18:16:48.637212 14083 consensus_queue.cc:1035] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1971, Last known committed idx: 1970, Time since last communication: 0.000s
I20260807 18:16:48.644766 11297 catalog_manager.cc:5495] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 reported cstate change: term changed from 3 to 4, leader changed from 50da72adf57546f5bab0a028672a51dd (127.10.253.65) to 22052958d03d426ebdc2fc310637c846 (127.10.253.68). New cstate: current_term: 4 leader_uuid: "22052958d03d426ebdc2fc310637c846" committed_config { opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 18:16:48.721629 11881 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 4 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 3 index: 1972. Preceding OpId from leader: term: 4 index: 1973. (index mismatch)
I20260807 18:16:48.722472 14124 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1973, Last known committed idx: 1972, Time since last communication: 0.000s
I20260807 18:16:48.752771 12676 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 3 index: 1972. Preceding OpId from leader: term: 4 index: 1973. (index mismatch)
I20260807 18:16:48.753690 14124 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1973, Last known committed idx: 1972, Time since last communication: 0.000s
I20260807 18:16:48.757081 12246 raft_consensus.cc:1261] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Refusing update from remote peer 22052958d03d426ebdc2fc310637c846: Log matching property violated. Preceding OpId in replica: term: 3 index: 1972. Preceding OpId from leader: term: 4 index: 1973. (index mismatch)
I20260807 18:16:48.758961 14124 consensus_queue.cc:1035] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1973, Last known committed idx: 1972, Time since last communication: 0.000s
I20260807 18:16:48.805807 13261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 1970 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:48.806403 13255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1972 } } ignore_live_leader: false dest_uuid: "50da72adf57546f5bab0a028672a51dd" is_pre_election: true
I20260807 18:16:48.806747 13253 raft_consensus.cc:3032] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 3 LEADER]: Stepping down as leader of term 3
I20260807 18:16:48.806929 13253 raft_consensus.cc:729] T 4c7eca40645d4ee29079ced64fa54d37 P 50da72adf57546f5bab0a028672a51dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50da72adf57546f5bab0a028672a51dd, State: Running, Role: LEADER
I20260807 18:16:48.807134 11253 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu with pid 13042
I20260807 18:16:48.810154 11881 raft_consensus.cc:1226] T 4c7eca40645d4ee29079ced64fa54d37 P 6a9cdd541bff40f98b3a280123bcc1a9 [term 4 FOLLOWER]: Rejecting Update request from peer 50da72adf57546f5bab0a028672a51dd for earlier term 3. Current term is 4. Ops: []
W20260807 18:16:48.900625 11977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.253.65:37131 (error 108) [suppressed 51 similar messages]
I20260807 18:16:48.900938 11253 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu pid 11768
W20260807 18:16:48.901250 11791 connection.cc:535] server connection from 127.10.253.65:50605 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 18:16:48.902448 11793 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.253.65:37131 (error 108) [suppressed 1 similar messages]
I20260807 18:16:48.903241 11936 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 18:16:48.904028 11977 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:16:48.904539 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:48.904898 11977 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:16:48.904927 12163 leader_election.cc:334] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:16:48.905505 12163 leader_election.cc:334] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:16:48.906358 12163 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:48.906642 12163 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
I20260807 18:16:49.126291 14130 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6a9cdd541bff40f98b3a280123bcc1a9)
I20260807 18:16:49.126642 14130 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:49.128103 14130 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:49.129415 12676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1973 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:49.130861 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 1973 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
W20260807 18:16:49.135661 12163 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
I20260807 18:16:49.135952 12163 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 41f204b71daa453ea5e1226f14f422ca; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd
I20260807 18:16:49.136348 14130 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 18:16:49.157124 14081 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6a9cdd541bff40f98b3a280123bcc1a9)
I20260807 18:16:49.157433 14081 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:49.158735 14081 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:49.159777 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1973 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:49.160089 12246 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22052958d03d426ebdc2fc310637c846 in term 3.
I20260807 18:16:49.160486 12676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1973 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
W20260807 18:16:49.164513 11977 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
I20260807 18:16:49.195268 14115 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6a9cdd541bff40f98b3a280123bcc1a9)
I20260807 18:16:49.195653 14115 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:49.196787 14115 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:49.197641 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 4 candidate_status { last_received { term: 3 index: 1973 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:49.198019 12246 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 3.
I20260807 18:16:49.199260 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 4 candidate_status { last_received { term: 3 index: 1973 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:49.199635 12074 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 3.
I20260807 18:16:49.200380 12580 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca; no voters:
I20260807 18:16:49.200896 14115 raft_consensus.cc:2781] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 18:16:49.201050 14115 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6a9cdd541bff40f98b3a280123bcc1a9)
I20260807 18:16:49.201181 14115 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:49.204974 14115 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:49.206897 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 4 candidate_status { last_received { term: 3 index: 1973 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca"
I20260807 18:16:49.206946 12074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 4 candidate_status { last_received { term: 3 index: 1973 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846"
I20260807 18:16:49.207216 12246 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:49.207237 12074 raft_consensus.cc:3037] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 3 FOLLOWER]: Advancing to term 4
I20260807 18:16:49.210716 12246 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 4.
I20260807 18:16:49.211376 14115 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 4 election: Requested vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:49.211745 12074 raft_consensus.cc:2454] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14597aeb31024f3bacbdbb6a99a2800d in term 4.
I20260807 18:16:49.212455 12580 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d, 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca; no voters:
I20260807 18:16:49.212801 14115 raft_consensus.cc:2781] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Leader election won for term 4
I20260807 18:16:49.213642 14115 raft_consensus.cc:686] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [term 4 LEADER]: Becoming Leader. State: Replica: 14597aeb31024f3bacbdbb6a99a2800d, State: Running, Role: LEADER
I20260807 18:16:49.214013 14115 consensus_queue.cc:237] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1973, Committed index: 1973, Last appended: 3.1973, Last appended by leader: 1973, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
W20260807 18:16:49.214377 12583 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:16:49.216785 12583 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
I20260807 18:16:49.217715 11298 catalog_manager.cc:5495] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d reported cstate change: term changed from 3 to 4, leader changed from 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67) to 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70). New cstate: current_term: 4 leader_uuid: "14597aeb31024f3bacbdbb6a99a2800d" committed_config { opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260807 18:16:49.302570 11977 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:16:49.307502 12246 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Refusing update from remote peer 14597aeb31024f3bacbdbb6a99a2800d: Log matching property violated. Preceding OpId in replica: term: 3 index: 1973. Preceding OpId from leader: term: 4 index: 1974. (index mismatch)
I20260807 18:16:49.310738 14115 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1974, Last known committed idx: 1973, Time since last communication: 0.000s
W20260807 18:16:49.313856 12583 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:49.329669 12074 raft_consensus.cc:1261] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Refusing update from remote peer 14597aeb31024f3bacbdbb6a99a2800d: Log matching property violated. Preceding OpId in replica: term: 3 index: 1973. Preceding OpId from leader: term: 4 index: 1974. (index mismatch)
I20260807 18:16:49.330492 14148 consensus_queue.cc:1035] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1974, Last known committed idx: 1973, Time since last communication: 0.000s
W20260807 18:16:49.348163 12163 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:16:49.402549 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 4 candidate_status { last_received { term: 3 index: 1973 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
I20260807 18:16:49.408993 11974 leader_election.cc:302] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 22052958d03d426ebdc2fc310637c846, 41f204b71daa453ea5e1226f14f422ca; no voters: 14597aeb31024f3bacbdbb6a99a2800d, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:49.409456 14081 raft_consensus.cc:2726] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 18:16:49.410383 11285 catalog_manager.cc:4584] TS b5bb27271da74b1a909d982e6fb2d470 (127.10.253.66:43559): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 644a01df651c43d4a74ac241ea43068c: Network error: Client connection negotiation failed: client connection to 127.10.253.66:43559: connect: Connection refused (error 111)
W20260807 18:16:49.410889 11793 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.508s user 0.004s sys 0.004s
W20260807 18:16:49.411230 11793 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.508s user 0.004s sys 0.004s
W20260807 18:16:49.411700 11793 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.253.65:37131, user_credentials={real_user=slave}} blocked reactor thread for 508939us
I20260807 18:16:49.412806 11253 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu with pid 11768
I20260807 18:16:49.412954 11880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 4 candidate_status { last_received { term: 3 index: 1973 } } ignore_live_leader: false dest_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" is_pre_election: true
W20260807 18:16:49.513638 12160 connection.cc:535] client connection to 127.10.253.67:33793 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 18:16:49.513914 12160 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 18:16:49.514115 11974 connection.cc:535] client connection to 127.10.253.67:33793 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 18:16:49.514791 11253 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu pid 11949
W20260807 18:16:49.515792 12580 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111)
W20260807 18:16:49.515988 12160 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca -> Peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Couldn't send request to peer 6a9cdd541bff40f98b3a280123bcc1a9. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:49.516287 11974 consensus_peers.cc:487] T 4c7eca40645d4ee29079ced64fa54d37 P 22052958d03d426ebdc2fc310637c846 -> Peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Couldn't send request to peer 6a9cdd541bff40f98b3a280123bcc1a9. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:49.516367 12580 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d -> Peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Couldn't send request to peer 6a9cdd541bff40f98b3a280123bcc1a9. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:49.516558 12580 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111)
I20260807 18:16:49.516888 12128 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:16:49.772630 14164 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:49.772925 14164 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:49.773926 14164 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:49.775594 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 5 candidate_status { last_received { term: 4 index: 1973 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
W20260807 18:16:49.776870 12580 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111)
W20260807 18:16:49.777078 12583 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
I20260807 18:16:49.777287 12583 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d; no voters: 41f204b71daa453ea5e1226f14f422ca, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:49.777631 14164 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 18:16:49.811656 14130 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:49.811969 14130 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:49.813220 14130 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:49.813831 12676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "41f204b71daa453ea5e1226f14f422ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 1973 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:49.814185 12676 raft_consensus.cc:2454] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f204b71daa453ea5e1226f14f422ca in term 4.
W20260807 18:16:49.815733 12160 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 41f204b71daa453ea5e1226f14f422ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111)
W20260807 18:16:49.828804 12583 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:16:49.869634 14081 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:49.870551 14081 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:49.876754 14178 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 41f204b71daa453ea5e1226f14f422ca)
I20260807 18:16:49.877305 14178 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:49.878870 14081 leader_election.cc:288] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:49.879135 12246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 5 candidate_status { last_received { term: 4 index: 1974 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:49.879897 12072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c7eca40645d4ee29079ced64fa54d37" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 5 candidate_status { last_received { term: 4 index: 1973 } } ignore_live_leader: false dest_uuid: "22052958d03d426ebdc2fc310637c846" is_pre_election: true
I20260807 18:16:49.881960 12245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 6 candidate_status { last_received { term: 5 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:49.882598 12676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "644a01df651c43d4a74ac241ea43068c" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 5 candidate_status { last_received { term: 4 index: 1974 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
I20260807 18:16:49.882721 12674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "22052958d03d426ebdc2fc310637c846" candidate_term: 6 candidate_status { last_received { term: 5 index: 1971 } } ignore_live_leader: false dest_uuid: "14597aeb31024f3bacbdbb6a99a2800d" is_pre_election: true
W20260807 18:16:49.883618 11974 leader_election.cc:334] T 644a01df651c43d4a74ac241ea43068c P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111)
I20260807 18:16:49.883806 14178 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 22052958d03d426ebdc2fc310637c846 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 14597aeb31024f3bacbdbb6a99a2800d (127.10.253.70:40077), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:49.884825 11253 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu with pid 11949
W20260807 18:16:49.920513 12580 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d -> Peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Couldn't send request to peer 6a9cdd541bff40f98b3a280123bcc1a9. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:49.966459 12160 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca -> Peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Couldn't send request to peer 6a9cdd541bff40f98b3a280123bcc1a9. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260807 18:16:49.986151 12163 connection.cc:535] server connection from 127.10.253.68:34545 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 18:16:49.986464 12580 connection.cc:535] client connection to 127.10.253.68:43889 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 18:16:49.986842 11253 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu pid 12137
W20260807 18:16:49.988286 12580 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d -> Peer 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889): Couldn't send request to peer 22052958d03d426ebdc2fc310637c846. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.68:43889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:49.988427 12303 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 18:16:49.988474 12160 consensus_peers.cc:487] T 874ba119c7284c4d8a113d6654e0c39e P 41f204b71daa453ea5e1226f14f422ca -> Peer 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889): Couldn't send request to peer 22052958d03d426ebdc2fc310637c846. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.68:43889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:16:50.198590 14191 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:50.199057 14191 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:50.200208 14191 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
W20260807 18:16:50.202279 12583 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:16:50.203012 12580 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111)
W20260807 18:16:50.203271 12580 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889): Network error: Client connection negotiation failed: client connection to 127.10.253.68:43889: connect: Connection refused (error 111)
I20260807 18:16:50.203384 12580 leader_election.cc:302] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d; no voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:50.203728 14191 raft_consensus.cc:2726] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 18:16:50.229673 14191 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 41f204b71daa453ea5e1226f14f422ca)
I20260807 18:16:50.230001 14191 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:50.231127 14191 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
W20260807 18:16:50.233036 12583 leader_election.cc:334] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111)
W20260807 18:16:50.233268 12580 leader_election.cc:334] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111)
W20260807 18:16:50.233594 12580 leader_election.cc:334] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889): Network error: Client connection negotiation failed: client connection to 127.10.253.68:43889: connect: Connection refused (error 111)
I20260807 18:16:50.233711 12580 leader_election.cc:302] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 14597aeb31024f3bacbdbb6a99a2800d; no voters: 22052958d03d426ebdc2fc310637c846, 50da72adf57546f5bab0a028672a51dd, 6a9cdd541bff40f98b3a280123bcc1a9
I20260807 18:16:50.234011 14191 raft_consensus.cc:2726] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 18:16:50.352126 12583 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d -> Peer 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131): Couldn't send request to peer 50da72adf57546f5bab0a028672a51dd. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.65:37131: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260807 18:16:50.364532 12580 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d -> Peer 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889): Couldn't send request to peer 22052958d03d426ebdc2fc310637c846. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.68:43889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260807 18:16:50.377679 12247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874ba119c7284c4d8a113d6654e0c39e" candidate_uuid: "14597aeb31024f3bacbdbb6a99a2800d" candidate_term: 6 candidate_status { last_received { term: 5 index: 1971 } } ignore_live_leader: false dest_uuid: "41f204b71daa453ea5e1226f14f422ca" is_pre_election: true
I20260807 18:16:50.377844 14157 raft_consensus.cc:482] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14597aeb31024f3bacbdbb6a99a2800d)
I20260807 18:16:50.378340 11253 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu with pid 12137
I20260807 18:16:50.378124 14157 raft_consensus.cc:504] T 644a01df651c43d4a74ac241ea43068c P 41f204b71daa453ea5e1226f14f422ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 1804 OBSOLETE_local: false peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
W20260807 18:16:50.429363 12580 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111) [suppressed 39 similar messages]
W20260807 18:16:50.431221 12580 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d -> Peer 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793): Couldn't send request to peer 6a9cdd541bff40f98b3a280123bcc1a9. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.67:33793: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260807 18:16:50.466122 11253 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu pid 12492
W20260807 18:16:50.467023 12580 consensus_peers.cc:487] T 644a01df651c43d4a74ac241ea43068c P 14597aeb31024f3bacbdbb6a99a2800d -> Peer 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839): Couldn't send request to peer 41f204b71daa453ea5e1226f14f422ca. Status: Network error: Client connection negotiation failed: client connection to 127.10.253.69:45839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 18:16:50.467310 12580 leader_election.cc:334] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839): Network error: Client connection negotiation failed: client connection to 127.10.253.69:45839: connect: Connection refused (error 111)
W20260807 18:16:50.467711 12580 leader_election.cc:334] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839): Network error: Client connection negotiation failed: client connection to 127.10.253.69:45839: connect: Connection refused (error 111)
I20260807 18:16:50.467905 12747 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:16:50.856451 14191 raft_consensus.cc:482] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22052958d03d426ebdc2fc310637c846)
I20260807 18:16:50.856711 14164 raft_consensus.cc:482] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 41f204b71daa453ea5e1226f14f422ca)
I20260807 18:16:50.856877 14191 raft_consensus.cc:504] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 1971 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:50.857014 14164 raft_consensus.cc:504] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 1969 OBSOLETE_local: false peers { permanent_uuid: "6a9cdd541bff40f98b3a280123bcc1a9" member_type: VOTER last_known_addr { host: "127.10.253.67" port: 33793 } } peers { permanent_uuid: "22052958d03d426ebdc2fc310637c846" member_type: VOTER last_known_addr { host: "127.10.253.68" port: 43889 } } peers { permanent_uuid: "41f204b71daa453ea5e1226f14f422ca" member_type: VOTER last_known_addr { host: "127.10.253.69" port: 45839 } } peers { permanent_uuid: "14597aeb31024f3bacbdbb6a99a2800d" member_type: VOTER last_known_addr { host: "127.10.253.70" port: 40077 } attrs { promote: false } } peers { permanent_uuid: "50da72adf57546f5bab0a028672a51dd" member_type: VOTER last_known_addr { host: "127.10.253.65" port: 37131 } attrs { promote: false } }
I20260807 18:16:50.859367 14164 leader_election.cc:288] T 874ba119c7284c4d8a113d6654e0c39e P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:50.860363 14191 leader_election.cc:288] T 4c7eca40645d4ee29079ced64fa54d37 P 14597aeb31024f3bacbdbb6a99a2800d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6a9cdd541bff40f98b3a280123bcc1a9 (127.10.253.67:33793), 22052958d03d426ebdc2fc310637c846 (127.10.253.68:43889), 41f204b71daa453ea5e1226f14f422ca (127.10.253.69:45839), 50da72adf57546f5bab0a028672a51dd (127.10.253.65:37131)
I20260807 18:16:50.862177 11253 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu with pid 12492
I20260807 18:16:50.954730 11253 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu pid 11262
I20260807 18:16:50.957603 11349 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 18:16:51.130052 11253 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEx6KZ7/build/asan/bin/kudu with pid 11262
2026-08-07T18:16:51Z chronyd exiting
I20260807 18:16:51.197643 11253 test_util.cc:175] -----------------------------------------------
I20260807 18:16:51.197793 11253 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskEx6KZ7/test-tmp/maintenance_mode-itest.3.MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode.1786126522650851-11253-0
[ FAILED ] MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode (88429 ms)
[----------] 1 test from MaintenanceModeRF5ITest (88429 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (88430 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] MaintenanceModeRF5ITest.TestBackgroundFailureDuringMaintenanceMode
1 FAILED TEST